00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2001 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3262 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.001 Started by timer 00:00:00.113 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.114 The recommended git tool is: git 00:00:00.114 using credential 00000000-0000-0000-0000-000000000002 00:00:00.116 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.131 Fetching changes from the remote Git repository 00:00:00.134 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.157 Using shallow fetch with depth 1 00:00:00.157 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.157 > git --version # timeout=10 00:00:00.187 > git --version # 'git version 2.39.2' 00:00:00.187 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.215 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.215 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.330 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.340 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.351 Checking out Revision 308e970df89ed396a3f9dcf22fba8891259694e4 (FETCH_HEAD) 00:00:05.351 > git config core.sparsecheckout # timeout=10 00:00:05.361 > git read-tree -mu HEAD # timeout=10 00:00:05.376 > git checkout -f 308e970df89ed396a3f9dcf22fba8891259694e4 # timeout=5 00:00:05.392 Commit message: "jjb/create-perf-report: make job run concurrent" 00:00:05.392 > git rev-list --no-walk 308e970df89ed396a3f9dcf22fba8891259694e4 # timeout=10 00:00:05.507 [Pipeline] Start of Pipeline 00:00:05.520 [Pipeline] library 00:00:05.522 Loading library shm_lib@master 00:00:05.522 Library shm_lib@master is cached. Copying from home. 00:00:05.540 [Pipeline] node 00:00:05.560 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.562 [Pipeline] { 00:00:05.571 [Pipeline] catchError 00:00:05.572 [Pipeline] { 00:00:05.584 [Pipeline] wrap 00:00:05.594 [Pipeline] { 00:00:05.600 [Pipeline] stage 00:00:05.602 [Pipeline] { (Prologue) 00:00:05.876 [Pipeline] sh 00:00:06.158 + logger -p user.info -t JENKINS-CI 00:00:06.179 [Pipeline] echo 00:00:06.180 Node: GP11 00:00:06.187 [Pipeline] sh 00:00:06.486 [Pipeline] setCustomBuildProperty 00:00:06.548 [Pipeline] echo 00:00:06.550 Cleanup processes 00:00:06.556 [Pipeline] sh 00:00:06.836 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.836 1072311 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.849 [Pipeline] sh 00:00:07.128 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.128 ++ grep -v 'sudo pgrep' 00:00:07.128 ++ awk '{print $1}' 00:00:07.128 + sudo kill -9 00:00:07.128 + true 00:00:07.141 [Pipeline] cleanWs 00:00:07.148 [WS-CLEANUP] Deleting project workspace... 00:00:07.148 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.156 [WS-CLEANUP] done 00:00:07.161 [Pipeline] setCustomBuildProperty 00:00:07.172 [Pipeline] sh 00:00:07.450 + sudo git config --global --replace-all safe.directory '*' 00:00:07.514 [Pipeline] httpRequest 00:00:07.557 [Pipeline] echo 00:00:07.558 Sorcerer 10.211.164.101 is alive 00:00:07.566 [Pipeline] httpRequest 00:00:07.570 HttpMethod: GET 00:00:07.571 URL: http://10.211.164.101/packages/jbp_308e970df89ed396a3f9dcf22fba8891259694e4.tar.gz 00:00:07.572 Sending request to url: http://10.211.164.101/packages/jbp_308e970df89ed396a3f9dcf22fba8891259694e4.tar.gz 00:00:07.575 Response Code: HTTP/1.1 200 OK 00:00:07.575 Success: Status code 200 is in the accepted range: 200,404 00:00:07.575 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_308e970df89ed396a3f9dcf22fba8891259694e4.tar.gz 00:00:08.852 [Pipeline] sh 00:00:09.136 + tar --no-same-owner -xf jbp_308e970df89ed396a3f9dcf22fba8891259694e4.tar.gz 00:00:09.153 [Pipeline] httpRequest 00:00:09.192 [Pipeline] echo 00:00:09.194 Sorcerer 10.211.164.101 is alive 00:00:09.199 [Pipeline] httpRequest 00:00:09.203 HttpMethod: GET 00:00:09.203 URL: http://10.211.164.101/packages/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:00:09.205 Sending request to url: http://10.211.164.101/packages/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:00:09.222 Response Code: HTTP/1.1 200 OK 00:00:09.223 Success: Status code 200 is in the accepted range: 200,404 00:00:09.223 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:01:11.170 [Pipeline] sh 00:01:11.453 + tar --no-same-owner -xf spdk_4b94202c659be49093c32ec1d2d75efdacf00691.tar.gz 00:01:13.988 [Pipeline] sh 00:01:14.266 + git -C spdk log --oneline -n5 00:01:14.266 4b94202c6 lib/event: Bug fix for framework_set_scheduler 00:01:14.266 507e9ba07 nvme: add lock_depth for ctrlr_lock 00:01:14.266 62fda7b5f nvme: check pthread_mutex_destroy() return value 00:01:14.266 e03c164a1 nvme: add nvme_ctrlr_lock 00:01:14.266 d61f89a86 nvme/cuse: Add ctrlr_lock for cuse register and unregister 00:01:14.277 [Pipeline] } 00:01:14.290 [Pipeline] // stage 00:01:14.297 [Pipeline] stage 00:01:14.299 [Pipeline] { (Prepare) 00:01:14.313 [Pipeline] writeFile 00:01:14.325 [Pipeline] sh 00:01:14.606 + logger -p user.info -t JENKINS-CI 00:01:14.618 [Pipeline] sh 00:01:14.901 + logger -p user.info -t JENKINS-CI 00:01:14.913 [Pipeline] sh 00:01:15.192 + cat autorun-spdk.conf 00:01:15.192 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:15.192 SPDK_TEST_NVMF=1 00:01:15.192 SPDK_TEST_NVME_CLI=1 00:01:15.192 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:15.192 SPDK_TEST_NVMF_NICS=e810 00:01:15.192 SPDK_RUN_UBSAN=1 00:01:15.192 NET_TYPE=phy 00:01:15.199 RUN_NIGHTLY=1 00:01:15.204 [Pipeline] readFile 00:01:15.230 [Pipeline] withEnv 00:01:15.232 [Pipeline] { 00:01:15.245 [Pipeline] sh 00:01:15.526 + set -ex 00:01:15.526 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:15.526 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:15.526 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:15.526 ++ SPDK_TEST_NVMF=1 00:01:15.526 ++ SPDK_TEST_NVME_CLI=1 00:01:15.526 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:15.526 ++ SPDK_TEST_NVMF_NICS=e810 00:01:15.526 ++ SPDK_RUN_UBSAN=1 00:01:15.526 ++ NET_TYPE=phy 00:01:15.526 ++ RUN_NIGHTLY=1 00:01:15.526 + case $SPDK_TEST_NVMF_NICS in 00:01:15.526 + DRIVERS=ice 00:01:15.526 + [[ tcp == \r\d\m\a ]] 00:01:15.526 + [[ -n ice ]] 00:01:15.526 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:15.526 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:15.526 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:15.526 rmmod: ERROR: Module irdma is not currently loaded 00:01:15.526 rmmod: ERROR: Module i40iw is not currently loaded 00:01:15.526 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:15.526 + true 00:01:15.526 + for D in $DRIVERS 00:01:15.526 + sudo modprobe ice 00:01:15.526 + exit 0 00:01:15.535 [Pipeline] } 00:01:15.553 [Pipeline] // withEnv 00:01:15.558 [Pipeline] } 00:01:15.572 [Pipeline] // stage 00:01:15.581 [Pipeline] catchError 00:01:15.582 [Pipeline] { 00:01:15.595 [Pipeline] timeout 00:01:15.595 Timeout set to expire in 50 min 00:01:15.597 [Pipeline] { 00:01:15.616 [Pipeline] stage 00:01:15.619 [Pipeline] { (Tests) 00:01:15.640 [Pipeline] sh 00:01:15.929 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:15.929 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:15.929 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:15.929 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:15.929 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:15.929 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:15.929 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:15.929 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:15.929 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:15.929 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:15.929 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:15.929 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:15.929 + source /etc/os-release 00:01:15.929 ++ NAME='Fedora Linux' 00:01:15.929 ++ VERSION='38 (Cloud Edition)' 00:01:15.929 ++ ID=fedora 00:01:15.929 ++ VERSION_ID=38 00:01:15.929 ++ VERSION_CODENAME= 00:01:15.929 ++ PLATFORM_ID=platform:f38 00:01:15.929 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:01:15.929 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:15.929 ++ LOGO=fedora-logo-icon 00:01:15.929 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:01:15.929 ++ HOME_URL=https://fedoraproject.org/ 00:01:15.929 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:01:15.929 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:15.929 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:15.929 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:15.929 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:01:15.929 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:15.929 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:01:15.929 ++ SUPPORT_END=2024-05-14 00:01:15.929 ++ VARIANT='Cloud Edition' 00:01:15.929 ++ VARIANT_ID=cloud 00:01:15.929 + uname -a 00:01:15.930 Linux spdk-gp-11 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:01:15.930 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:16.865 Hugepages 00:01:16.865 node hugesize free / total 00:01:16.865 node0 1048576kB 0 / 0 00:01:16.865 node0 2048kB 0 / 0 00:01:16.865 node1 1048576kB 0 / 0 00:01:16.865 node1 2048kB 0 / 0 00:01:16.865 00:01:16.865 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:16.865 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:16.865 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:16.865 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:16.865 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:16.865 + rm -f /tmp/spdk-ld-path 00:01:16.865 + source autorun-spdk.conf 00:01:16.865 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.865 ++ SPDK_TEST_NVMF=1 00:01:16.865 ++ SPDK_TEST_NVME_CLI=1 00:01:16.865 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.865 ++ SPDK_TEST_NVMF_NICS=e810 00:01:16.865 ++ SPDK_RUN_UBSAN=1 00:01:16.865 ++ NET_TYPE=phy 00:01:16.865 ++ RUN_NIGHTLY=1 00:01:16.865 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:16.865 + [[ -n '' ]] 00:01:16.865 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:16.865 + for M in /var/spdk/build-*-manifest.txt 00:01:16.865 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:16.865 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:16.865 + for M in /var/spdk/build-*-manifest.txt 00:01:16.865 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:16.865 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:16.865 ++ uname 00:01:16.865 + [[ Linux == \L\i\n\u\x ]] 00:01:16.865 + sudo dmesg -T 00:01:17.123 + sudo dmesg --clear 00:01:17.123 + dmesg_pid=1073595 00:01:17.123 + [[ Fedora Linux == FreeBSD ]] 00:01:17.123 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.123 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:17.123 + sudo dmesg -Tw 00:01:17.123 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:17.123 + [[ -x /usr/src/fio-static/fio ]] 00:01:17.123 + export FIO_BIN=/usr/src/fio-static/fio 00:01:17.123 + FIO_BIN=/usr/src/fio-static/fio 00:01:17.123 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:17.123 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:17.123 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:17.123 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.123 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:17.124 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:17.124 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.124 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:17.124 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:17.124 Test configuration: 00:01:17.124 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:17.124 SPDK_TEST_NVMF=1 00:01:17.124 SPDK_TEST_NVME_CLI=1 00:01:17.124 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:17.124 SPDK_TEST_NVMF_NICS=e810 00:01:17.124 SPDK_RUN_UBSAN=1 00:01:17.124 NET_TYPE=phy 00:01:17.124 RUN_NIGHTLY=1 12:15:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:17.124 12:15:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:17.124 12:15:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:17.124 12:15:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:17.124 12:15:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.124 12:15:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.124 12:15:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.124 12:15:10 -- paths/export.sh@5 -- $ export PATH 00:01:17.124 12:15:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:17.124 12:15:10 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:17.124 12:15:10 -- common/autobuild_common.sh@435 -- $ date +%s 00:01:17.124 12:15:10 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1720779310.XXXXXX 00:01:17.124 12:15:10 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1720779310.UMLULw 00:01:17.124 12:15:10 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:01:17.124 12:15:10 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:01:17.124 12:15:10 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:17.124 12:15:10 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:17.124 12:15:10 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:17.124 12:15:10 -- common/autobuild_common.sh@451 -- $ get_config_params 00:01:17.124 12:15:10 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:01:17.124 12:15:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.124 12:15:10 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:17.124 12:15:10 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:17.124 12:15:10 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:17.124 12:15:10 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:17.124 12:15:10 -- spdk/autobuild.sh@16 -- $ date -u 00:01:17.124 Fri Jul 12 10:15:10 AM UTC 2024 00:01:17.124 12:15:10 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:17.124 LTS-59-g4b94202c6 00:01:17.124 12:15:10 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:17.124 12:15:10 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:17.124 12:15:10 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:17.124 12:15:10 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:17.124 12:15:10 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:17.124 12:15:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.124 ************************************ 00:01:17.124 START TEST ubsan 00:01:17.124 ************************************ 00:01:17.124 12:15:10 -- common/autotest_common.sh@1104 -- $ echo 'using ubsan' 00:01:17.124 using ubsan 00:01:17.124 00:01:17.124 real 0m0.000s 00:01:17.124 user 0m0.000s 00:01:17.124 sys 0m0.000s 00:01:17.124 12:15:10 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:01:17.124 12:15:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:17.124 ************************************ 00:01:17.124 END TEST ubsan 00:01:17.124 ************************************ 00:01:17.124 12:15:10 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:17.124 12:15:10 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:17.124 12:15:10 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:17.124 12:15:10 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:17.124 12:15:10 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:17.124 12:15:10 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:17.124 12:15:10 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:17.124 12:15:10 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:17.124 12:15:10 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:17.124 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:17.124 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:17.382 Using 'verbs' RDMA provider 00:01:27.931 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:37.918 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:37.918 Creating mk/config.mk...done. 00:01:37.918 Creating mk/cc.flags.mk...done. 00:01:37.918 Type 'make' to build. 00:01:37.918 12:15:31 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:37.918 12:15:31 -- common/autotest_common.sh@1077 -- $ '[' 3 -le 1 ']' 00:01:37.918 12:15:31 -- common/autotest_common.sh@1083 -- $ xtrace_disable 00:01:37.918 12:15:31 -- common/autotest_common.sh@10 -- $ set +x 00:01:37.918 ************************************ 00:01:37.918 START TEST make 00:01:37.918 ************************************ 00:01:37.918 12:15:31 -- common/autotest_common.sh@1104 -- $ make -j48 00:01:37.918 make[1]: Nothing to be done for 'all'. 00:01:46.160 The Meson build system 00:01:46.160 Version: 1.3.1 00:01:46.160 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:46.160 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:46.160 Build type: native build 00:01:46.160 Program cat found: YES (/usr/bin/cat) 00:01:46.160 Project name: DPDK 00:01:46.160 Project version: 23.11.0 00:01:46.160 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:46.160 C linker for the host machine: cc ld.bfd 2.39-16 00:01:46.160 Host machine cpu family: x86_64 00:01:46.160 Host machine cpu: x86_64 00:01:46.160 Message: ## Building in Developer Mode ## 00:01:46.160 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:46.160 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:46.160 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:46.160 Program python3 found: YES (/usr/bin/python3) 00:01:46.160 Program cat found: YES (/usr/bin/cat) 00:01:46.160 Compiler for C supports arguments -march=native: YES 00:01:46.160 Checking for size of "void *" : 8 00:01:46.160 Checking for size of "void *" : 8 (cached) 00:01:46.160 Library m found: YES 00:01:46.160 Library numa found: YES 00:01:46.160 Has header "numaif.h" : YES 00:01:46.160 Library fdt found: NO 00:01:46.160 Library execinfo found: NO 00:01:46.160 Has header "execinfo.h" : YES 00:01:46.160 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:46.160 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:46.160 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:46.160 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:46.160 Run-time dependency openssl found: YES 3.0.9 00:01:46.160 Run-time dependency libpcap found: YES 1.10.4 00:01:46.160 Has header "pcap.h" with dependency libpcap: YES 00:01:46.160 Compiler for C supports arguments -Wcast-qual: YES 00:01:46.160 Compiler for C supports arguments -Wdeprecated: YES 00:01:46.160 Compiler for C supports arguments -Wformat: YES 00:01:46.160 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:46.160 Compiler for C supports arguments -Wformat-security: NO 00:01:46.160 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:46.160 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:46.160 Compiler for C supports arguments -Wnested-externs: YES 00:01:46.160 Compiler for C supports arguments -Wold-style-definition: YES 00:01:46.160 Compiler for C supports arguments -Wpointer-arith: YES 00:01:46.160 Compiler for C supports arguments -Wsign-compare: YES 00:01:46.160 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:46.160 Compiler for C supports arguments -Wundef: YES 00:01:46.160 Compiler for C supports arguments -Wwrite-strings: YES 00:01:46.160 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:46.160 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:46.160 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:46.160 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:46.160 Program objdump found: YES (/usr/bin/objdump) 00:01:46.160 Compiler for C supports arguments -mavx512f: YES 00:01:46.160 Checking if "AVX512 checking" compiles: YES 00:01:46.160 Fetching value of define "__SSE4_2__" : 1 00:01:46.160 Fetching value of define "__AES__" : 1 00:01:46.160 Fetching value of define "__AVX__" : 1 00:01:46.160 Fetching value of define "__AVX2__" : (undefined) 00:01:46.160 Fetching value of define "__AVX512BW__" : (undefined) 00:01:46.160 Fetching value of define "__AVX512CD__" : (undefined) 00:01:46.160 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:46.160 Fetching value of define "__AVX512F__" : (undefined) 00:01:46.160 Fetching value of define "__AVX512VL__" : (undefined) 00:01:46.160 Fetching value of define "__PCLMUL__" : 1 00:01:46.160 Fetching value of define "__RDRND__" : 1 00:01:46.160 Fetching value of define "__RDSEED__" : (undefined) 00:01:46.160 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:46.160 Fetching value of define "__znver1__" : (undefined) 00:01:46.160 Fetching value of define "__znver2__" : (undefined) 00:01:46.160 Fetching value of define "__znver3__" : (undefined) 00:01:46.160 Fetching value of define "__znver4__" : (undefined) 00:01:46.160 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:46.160 Message: lib/log: Defining dependency "log" 00:01:46.160 Message: lib/kvargs: Defining dependency "kvargs" 00:01:46.160 Message: lib/telemetry: Defining dependency "telemetry" 00:01:46.160 Checking for function "getentropy" : NO 00:01:46.160 Message: lib/eal: Defining dependency "eal" 00:01:46.160 Message: lib/ring: Defining dependency "ring" 00:01:46.160 Message: lib/rcu: Defining dependency "rcu" 00:01:46.161 Message: lib/mempool: Defining dependency "mempool" 00:01:46.161 Message: lib/mbuf: Defining dependency "mbuf" 00:01:46.161 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:46.161 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:46.161 Compiler for C supports arguments -mpclmul: YES 00:01:46.161 Compiler for C supports arguments -maes: YES 00:01:46.161 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:46.161 Compiler for C supports arguments -mavx512bw: YES 00:01:46.161 Compiler for C supports arguments -mavx512dq: YES 00:01:46.161 Compiler for C supports arguments -mavx512vl: YES 00:01:46.161 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:46.161 Compiler for C supports arguments -mavx2: YES 00:01:46.161 Compiler for C supports arguments -mavx: YES 00:01:46.161 Message: lib/net: Defining dependency "net" 00:01:46.161 Message: lib/meter: Defining dependency "meter" 00:01:46.161 Message: lib/ethdev: Defining dependency "ethdev" 00:01:46.161 Message: lib/pci: Defining dependency "pci" 00:01:46.161 Message: lib/cmdline: Defining dependency "cmdline" 00:01:46.161 Message: lib/hash: Defining dependency "hash" 00:01:46.161 Message: lib/timer: Defining dependency "timer" 00:01:46.161 Message: lib/compressdev: Defining dependency "compressdev" 00:01:46.161 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:46.161 Message: lib/dmadev: Defining dependency "dmadev" 00:01:46.161 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:46.161 Message: lib/power: Defining dependency "power" 00:01:46.161 Message: lib/reorder: Defining dependency "reorder" 00:01:46.161 Message: lib/security: Defining dependency "security" 00:01:46.161 Has header "linux/userfaultfd.h" : YES 00:01:46.161 Has header "linux/vduse.h" : YES 00:01:46.161 Message: lib/vhost: Defining dependency "vhost" 00:01:46.161 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:46.161 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:46.161 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:46.161 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:46.161 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:46.161 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:46.161 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:46.161 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:46.161 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:46.161 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:46.161 Program doxygen found: YES (/usr/bin/doxygen) 00:01:46.161 Configuring doxy-api-html.conf using configuration 00:01:46.161 Configuring doxy-api-man.conf using configuration 00:01:46.161 Program mandb found: YES (/usr/bin/mandb) 00:01:46.161 Program sphinx-build found: NO 00:01:46.161 Configuring rte_build_config.h using configuration 00:01:46.161 Message: 00:01:46.161 ================= 00:01:46.161 Applications Enabled 00:01:46.161 ================= 00:01:46.161 00:01:46.161 apps: 00:01:46.161 00:01:46.161 00:01:46.161 Message: 00:01:46.161 ================= 00:01:46.161 Libraries Enabled 00:01:46.161 ================= 00:01:46.161 00:01:46.161 libs: 00:01:46.161 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:46.161 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:46.161 cryptodev, dmadev, power, reorder, security, vhost, 00:01:46.161 00:01:46.161 Message: 00:01:46.161 =============== 00:01:46.161 Drivers Enabled 00:01:46.161 =============== 00:01:46.161 00:01:46.161 common: 00:01:46.161 00:01:46.161 bus: 00:01:46.161 pci, vdev, 00:01:46.161 mempool: 00:01:46.161 ring, 00:01:46.161 dma: 00:01:46.161 00:01:46.161 net: 00:01:46.161 00:01:46.161 crypto: 00:01:46.161 00:01:46.161 compress: 00:01:46.161 00:01:46.161 vdpa: 00:01:46.161 00:01:46.161 00:01:46.161 Message: 00:01:46.161 ================= 00:01:46.161 Content Skipped 00:01:46.161 ================= 00:01:46.161 00:01:46.161 apps: 00:01:46.161 dumpcap: explicitly disabled via build config 00:01:46.161 graph: explicitly disabled via build config 00:01:46.161 pdump: explicitly disabled via build config 00:01:46.161 proc-info: explicitly disabled via build config 00:01:46.161 test-acl: explicitly disabled via build config 00:01:46.161 test-bbdev: explicitly disabled via build config 00:01:46.161 test-cmdline: explicitly disabled via build config 00:01:46.161 test-compress-perf: explicitly disabled via build config 00:01:46.161 test-crypto-perf: explicitly disabled via build config 00:01:46.161 test-dma-perf: explicitly disabled via build config 00:01:46.161 test-eventdev: explicitly disabled via build config 00:01:46.161 test-fib: explicitly disabled via build config 00:01:46.161 test-flow-perf: explicitly disabled via build config 00:01:46.161 test-gpudev: explicitly disabled via build config 00:01:46.161 test-mldev: explicitly disabled via build config 00:01:46.161 test-pipeline: explicitly disabled via build config 00:01:46.161 test-pmd: explicitly disabled via build config 00:01:46.161 test-regex: explicitly disabled via build config 00:01:46.161 test-sad: explicitly disabled via build config 00:01:46.161 test-security-perf: explicitly disabled via build config 00:01:46.161 00:01:46.161 libs: 00:01:46.161 metrics: explicitly disabled via build config 00:01:46.161 acl: explicitly disabled via build config 00:01:46.161 bbdev: explicitly disabled via build config 00:01:46.161 bitratestats: explicitly disabled via build config 00:01:46.161 bpf: explicitly disabled via build config 00:01:46.161 cfgfile: explicitly disabled via build config 00:01:46.161 distributor: explicitly disabled via build config 00:01:46.161 efd: explicitly disabled via build config 00:01:46.161 eventdev: explicitly disabled via build config 00:01:46.161 dispatcher: explicitly disabled via build config 00:01:46.161 gpudev: explicitly disabled via build config 00:01:46.161 gro: explicitly disabled via build config 00:01:46.161 gso: explicitly disabled via build config 00:01:46.161 ip_frag: explicitly disabled via build config 00:01:46.161 jobstats: explicitly disabled via build config 00:01:46.161 latencystats: explicitly disabled via build config 00:01:46.161 lpm: explicitly disabled via build config 00:01:46.161 member: explicitly disabled via build config 00:01:46.161 pcapng: explicitly disabled via build config 00:01:46.161 rawdev: explicitly disabled via build config 00:01:46.161 regexdev: explicitly disabled via build config 00:01:46.161 mldev: explicitly disabled via build config 00:01:46.162 rib: explicitly disabled via build config 00:01:46.162 sched: explicitly disabled via build config 00:01:46.162 stack: explicitly disabled via build config 00:01:46.162 ipsec: explicitly disabled via build config 00:01:46.162 pdcp: explicitly disabled via build config 00:01:46.162 fib: explicitly disabled via build config 00:01:46.162 port: explicitly disabled via build config 00:01:46.162 pdump: explicitly disabled via build config 00:01:46.162 table: explicitly disabled via build config 00:01:46.162 pipeline: explicitly disabled via build config 00:01:46.162 graph: explicitly disabled via build config 00:01:46.162 node: explicitly disabled via build config 00:01:46.162 00:01:46.162 drivers: 00:01:46.162 common/cpt: not in enabled drivers build config 00:01:46.162 common/dpaax: not in enabled drivers build config 00:01:46.162 common/iavf: not in enabled drivers build config 00:01:46.162 common/idpf: not in enabled drivers build config 00:01:46.162 common/mvep: not in enabled drivers build config 00:01:46.162 common/octeontx: not in enabled drivers build config 00:01:46.162 bus/auxiliary: not in enabled drivers build config 00:01:46.162 bus/cdx: not in enabled drivers build config 00:01:46.162 bus/dpaa: not in enabled drivers build config 00:01:46.162 bus/fslmc: not in enabled drivers build config 00:01:46.162 bus/ifpga: not in enabled drivers build config 00:01:46.162 bus/platform: not in enabled drivers build config 00:01:46.162 bus/vmbus: not in enabled drivers build config 00:01:46.162 common/cnxk: not in enabled drivers build config 00:01:46.162 common/mlx5: not in enabled drivers build config 00:01:46.162 common/nfp: not in enabled drivers build config 00:01:46.162 common/qat: not in enabled drivers build config 00:01:46.162 common/sfc_efx: not in enabled drivers build config 00:01:46.162 mempool/bucket: not in enabled drivers build config 00:01:46.162 mempool/cnxk: not in enabled drivers build config 00:01:46.162 mempool/dpaa: not in enabled drivers build config 00:01:46.162 mempool/dpaa2: not in enabled drivers build config 00:01:46.162 mempool/octeontx: not in enabled drivers build config 00:01:46.162 mempool/stack: not in enabled drivers build config 00:01:46.162 dma/cnxk: not in enabled drivers build config 00:01:46.162 dma/dpaa: not in enabled drivers build config 00:01:46.162 dma/dpaa2: not in enabled drivers build config 00:01:46.162 dma/hisilicon: not in enabled drivers build config 00:01:46.162 dma/idxd: not in enabled drivers build config 00:01:46.162 dma/ioat: not in enabled drivers build config 00:01:46.162 dma/skeleton: not in enabled drivers build config 00:01:46.162 net/af_packet: not in enabled drivers build config 00:01:46.162 net/af_xdp: not in enabled drivers build config 00:01:46.162 net/ark: not in enabled drivers build config 00:01:46.162 net/atlantic: not in enabled drivers build config 00:01:46.162 net/avp: not in enabled drivers build config 00:01:46.162 net/axgbe: not in enabled drivers build config 00:01:46.162 net/bnx2x: not in enabled drivers build config 00:01:46.162 net/bnxt: not in enabled drivers build config 00:01:46.162 net/bonding: not in enabled drivers build config 00:01:46.162 net/cnxk: not in enabled drivers build config 00:01:46.162 net/cpfl: not in enabled drivers build config 00:01:46.162 net/cxgbe: not in enabled drivers build config 00:01:46.162 net/dpaa: not in enabled drivers build config 00:01:46.162 net/dpaa2: not in enabled drivers build config 00:01:46.162 net/e1000: not in enabled drivers build config 00:01:46.162 net/ena: not in enabled drivers build config 00:01:46.162 net/enetc: not in enabled drivers build config 00:01:46.162 net/enetfec: not in enabled drivers build config 00:01:46.162 net/enic: not in enabled drivers build config 00:01:46.162 net/failsafe: not in enabled drivers build config 00:01:46.162 net/fm10k: not in enabled drivers build config 00:01:46.162 net/gve: not in enabled drivers build config 00:01:46.162 net/hinic: not in enabled drivers build config 00:01:46.162 net/hns3: not in enabled drivers build config 00:01:46.162 net/i40e: not in enabled drivers build config 00:01:46.162 net/iavf: not in enabled drivers build config 00:01:46.162 net/ice: not in enabled drivers build config 00:01:46.162 net/idpf: not in enabled drivers build config 00:01:46.162 net/igc: not in enabled drivers build config 00:01:46.162 net/ionic: not in enabled drivers build config 00:01:46.162 net/ipn3ke: not in enabled drivers build config 00:01:46.162 net/ixgbe: not in enabled drivers build config 00:01:46.162 net/mana: not in enabled drivers build config 00:01:46.162 net/memif: not in enabled drivers build config 00:01:46.162 net/mlx4: not in enabled drivers build config 00:01:46.162 net/mlx5: not in enabled drivers build config 00:01:46.162 net/mvneta: not in enabled drivers build config 00:01:46.162 net/mvpp2: not in enabled drivers build config 00:01:46.162 net/netvsc: not in enabled drivers build config 00:01:46.162 net/nfb: not in enabled drivers build config 00:01:46.162 net/nfp: not in enabled drivers build config 00:01:46.162 net/ngbe: not in enabled drivers build config 00:01:46.162 net/null: not in enabled drivers build config 00:01:46.162 net/octeontx: not in enabled drivers build config 00:01:46.162 net/octeon_ep: not in enabled drivers build config 00:01:46.162 net/pcap: not in enabled drivers build config 00:01:46.162 net/pfe: not in enabled drivers build config 00:01:46.162 net/qede: not in enabled drivers build config 00:01:46.162 net/ring: not in enabled drivers build config 00:01:46.162 net/sfc: not in enabled drivers build config 00:01:46.162 net/softnic: not in enabled drivers build config 00:01:46.162 net/tap: not in enabled drivers build config 00:01:46.162 net/thunderx: not in enabled drivers build config 00:01:46.162 net/txgbe: not in enabled drivers build config 00:01:46.162 net/vdev_netvsc: not in enabled drivers build config 00:01:46.162 net/vhost: not in enabled drivers build config 00:01:46.162 net/virtio: not in enabled drivers build config 00:01:46.162 net/vmxnet3: not in enabled drivers build config 00:01:46.162 raw/*: missing internal dependency, "rawdev" 00:01:46.162 crypto/armv8: not in enabled drivers build config 00:01:46.162 crypto/bcmfs: not in enabled drivers build config 00:01:46.162 crypto/caam_jr: not in enabled drivers build config 00:01:46.162 crypto/ccp: not in enabled drivers build config 00:01:46.162 crypto/cnxk: not in enabled drivers build config 00:01:46.162 crypto/dpaa_sec: not in enabled drivers build config 00:01:46.162 crypto/dpaa2_sec: not in enabled drivers build config 00:01:46.162 crypto/ipsec_mb: not in enabled drivers build config 00:01:46.162 crypto/mlx5: not in enabled drivers build config 00:01:46.162 crypto/mvsam: not in enabled drivers build config 00:01:46.162 crypto/nitrox: not in enabled drivers build config 00:01:46.162 crypto/null: not in enabled drivers build config 00:01:46.162 crypto/octeontx: not in enabled drivers build config 00:01:46.162 crypto/openssl: not in enabled drivers build config 00:01:46.162 crypto/scheduler: not in enabled drivers build config 00:01:46.162 crypto/uadk: not in enabled drivers build config 00:01:46.162 crypto/virtio: not in enabled drivers build config 00:01:46.162 compress/isal: not in enabled drivers build config 00:01:46.162 compress/mlx5: not in enabled drivers build config 00:01:46.163 compress/octeontx: not in enabled drivers build config 00:01:46.163 compress/zlib: not in enabled drivers build config 00:01:46.163 regex/*: missing internal dependency, "regexdev" 00:01:46.163 ml/*: missing internal dependency, "mldev" 00:01:46.163 vdpa/ifc: not in enabled drivers build config 00:01:46.163 vdpa/mlx5: not in enabled drivers build config 00:01:46.163 vdpa/nfp: not in enabled drivers build config 00:01:46.163 vdpa/sfc: not in enabled drivers build config 00:01:46.163 event/*: missing internal dependency, "eventdev" 00:01:46.163 baseband/*: missing internal dependency, "bbdev" 00:01:46.163 gpu/*: missing internal dependency, "gpudev" 00:01:46.163 00:01:46.163 00:01:46.163 Build targets in project: 85 00:01:46.163 00:01:46.163 DPDK 23.11.0 00:01:46.163 00:01:46.163 User defined options 00:01:46.163 buildtype : debug 00:01:46.163 default_library : shared 00:01:46.163 libdir : lib 00:01:46.163 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:46.163 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:46.163 c_link_args : 00:01:46.163 cpu_instruction_set: native 00:01:46.163 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:01:46.163 disable_libs : bbdev,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:01:46.163 enable_docs : false 00:01:46.163 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:46.163 enable_kmods : false 00:01:46.163 tests : false 00:01:46.163 00:01:46.163 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:46.735 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:46.735 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:46.735 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:46.735 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:46.735 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:46.735 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:46.736 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:46.736 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:46.736 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:46.736 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:46.736 [10/265] Linking static target lib/librte_kvargs.a 00:01:46.736 [11/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:46.736 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:46.736 [13/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:46.994 [14/265] Linking static target lib/librte_log.a 00:01:46.994 [15/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:46.994 [16/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:46.994 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:46.994 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:46.994 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:46.994 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:46.994 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:47.567 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.567 [23/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:47.567 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:47.567 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:47.567 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:47.567 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:47.567 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:47.567 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:47.567 [30/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:47.567 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:47.567 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:47.567 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:47.830 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:47.830 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:47.830 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:47.830 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:47.830 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:47.830 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:47.830 [40/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:47.830 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:47.830 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:47.830 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:47.830 [44/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:47.830 [45/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:47.830 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:47.830 [47/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:47.830 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:47.830 [49/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:47.830 [50/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:47.830 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:47.830 [52/265] Linking static target lib/librte_telemetry.a 00:01:47.830 [53/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:47.830 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:47.830 [55/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:47.830 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:47.830 [57/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:47.830 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:47.830 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:47.830 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:47.830 [61/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:47.830 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:47.830 [63/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:47.830 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:47.830 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:48.088 [66/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:48.088 [67/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.088 [68/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:48.088 [69/265] Linking static target lib/librte_pci.a 00:01:48.088 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:48.088 [71/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:48.088 [72/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:48.088 [73/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:48.088 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:48.088 [75/265] Linking target lib/librte_log.so.24.0 00:01:48.088 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:48.088 [77/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:48.088 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:48.088 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:48.088 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:48.356 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:48.356 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:48.356 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:48.356 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:48.356 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:48.356 [86/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:48.356 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:48.356 [88/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:48.356 [89/265] Linking target lib/librte_kvargs.so.24.0 00:01:48.617 [90/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:48.617 [91/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:48.617 [92/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:48.617 [93/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.617 [94/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:48.617 [95/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:48.617 [96/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:48.617 [97/265] Linking static target lib/librte_ring.a 00:01:48.617 [98/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:48.617 [99/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:48.617 [100/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:48.617 [101/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:48.617 [102/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:48.617 [103/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:48.877 [104/265] Linking static target lib/librte_meter.a 00:01:48.877 [105/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:48.877 [106/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:48.877 [107/265] Linking static target lib/librte_eal.a 00:01:48.877 [108/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:48.877 [109/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:48.877 [110/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:48.877 [111/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.877 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:48.877 [113/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:48.877 [114/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:48.877 [115/265] Linking target lib/librte_telemetry.so.24.0 00:01:48.877 [116/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:48.877 [117/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:48.877 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:48.877 [119/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:48.877 [120/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:48.877 [121/265] Linking static target lib/librte_mempool.a 00:01:48.877 [122/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:48.877 [123/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:48.877 [124/265] Linking static target lib/librte_rcu.a 00:01:48.877 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:48.877 [126/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:48.877 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:49.139 [128/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:49.139 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:49.139 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:49.139 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:49.139 [132/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:49.139 [133/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:49.139 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:49.139 [135/265] Linking static target lib/librte_cmdline.a 00:01:49.139 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:49.139 [137/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.397 [138/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:49.397 [139/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:49.397 [140/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.397 [141/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:49.397 [142/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:49.397 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:49.397 [144/265] Linking static target lib/librte_net.a 00:01:49.397 [145/265] Linking static target lib/librte_timer.a 00:01:49.397 [146/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:49.397 [147/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:49.397 [148/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:49.397 [149/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:49.657 [150/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:49.657 [151/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.657 [152/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:49.657 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:49.657 [154/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:49.657 [155/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:49.657 [156/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.657 [157/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:49.657 [158/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:49.657 [159/265] Linking static target lib/librte_dmadev.a 00:01:49.657 [160/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:49.916 [161/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.916 [162/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:49.916 [163/265] Linking static target lib/librte_hash.a 00:01:49.916 [164/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:49.916 [165/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.916 [166/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:49.916 [167/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:49.916 [168/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:49.916 [169/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:49.916 [170/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:49.916 [171/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:49.916 [172/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:49.916 [173/265] Linking static target lib/librte_compressdev.a 00:01:49.916 [174/265] Linking static target lib/librte_power.a 00:01:49.916 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:50.174 [176/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:50.174 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:50.174 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:50.174 [179/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.174 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:50.174 [181/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:50.174 [182/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.174 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:50.174 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:50.174 [185/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:50.174 [186/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:50.174 [187/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:50.174 [188/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:50.174 [189/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:50.432 [190/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:50.432 [191/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:50.432 [192/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.432 [193/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:50.432 [194/265] Linking static target lib/librte_reorder.a 00:01:50.432 [195/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:50.432 [196/265] Linking static target lib/librte_mbuf.a 00:01:50.432 [197/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.432 [198/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:50.432 [199/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:50.432 [200/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:50.432 [201/265] Linking static target drivers/librte_bus_vdev.a 00:01:50.432 [202/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:50.432 [203/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:50.432 [204/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:50.432 [205/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:50.432 [206/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:50.432 [207/265] Linking static target drivers/librte_bus_pci.a 00:01:50.432 [208/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:50.432 [209/265] Linking static target lib/librte_security.a 00:01:50.432 [210/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.432 [211/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:50.691 [212/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:50.691 [213/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:50.691 [214/265] Linking static target drivers/librte_mempool_ring.a 00:01:50.691 [215/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.691 [216/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:50.691 [217/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.691 [218/265] Linking static target lib/librte_ethdev.a 00:01:50.949 [219/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.949 [220/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:50.949 [221/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.949 [222/265] Linking static target lib/librte_cryptodev.a 00:01:50.949 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.884 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.818 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:54.718 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.976 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.976 [228/265] Linking target lib/librte_eal.so.24.0 00:01:54.976 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:55.233 [230/265] Linking target lib/librte_ring.so.24.0 00:01:55.233 [231/265] Linking target lib/librte_timer.so.24.0 00:01:55.233 [232/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:55.233 [233/265] Linking target lib/librte_meter.so.24.0 00:01:55.233 [234/265] Linking target lib/librte_pci.so.24.0 00:01:55.233 [235/265] Linking target lib/librte_dmadev.so.24.0 00:01:55.233 [236/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:55.233 [237/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:55.233 [238/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:55.233 [239/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:55.233 [240/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:55.233 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:55.233 [242/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:55.233 [243/265] Linking target lib/librte_mempool.so.24.0 00:01:55.491 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:55.491 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:55.491 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:55.491 [247/265] Linking target lib/librte_mbuf.so.24.0 00:01:55.491 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:55.491 [249/265] Linking target lib/librte_reorder.so.24.0 00:01:55.491 [250/265] Linking target lib/librte_compressdev.so.24.0 00:01:55.491 [251/265] Linking target lib/librte_net.so.24.0 00:01:55.492 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:01:55.750 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:55.750 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:55.750 [255/265] Linking target lib/librte_security.so.24.0 00:01:55.750 [256/265] Linking target lib/librte_hash.so.24.0 00:01:55.750 [257/265] Linking target lib/librte_cmdline.so.24.0 00:01:55.750 [258/265] Linking target lib/librte_ethdev.so.24.0 00:01:56.008 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:56.008 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:56.008 [261/265] Linking target lib/librte_power.so.24.0 00:01:58.538 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:58.538 [263/265] Linking static target lib/librte_vhost.a 00:01:59.470 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.470 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:59.470 INFO: autodetecting backend as ninja 00:01:59.470 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:00.403 CC lib/ut_mock/mock.o 00:02:00.403 CC lib/log/log.o 00:02:00.403 CC lib/ut/ut.o 00:02:00.403 CC lib/log/log_flags.o 00:02:00.403 CC lib/log/log_deprecated.o 00:02:00.403 LIB libspdk_ut_mock.a 00:02:00.403 SO libspdk_ut_mock.so.5.0 00:02:00.403 LIB libspdk_ut.a 00:02:00.403 LIB libspdk_log.a 00:02:00.403 SO libspdk_ut.so.1.0 00:02:00.403 SO libspdk_log.so.6.1 00:02:00.403 SYMLINK libspdk_ut_mock.so 00:02:00.662 SYMLINK libspdk_ut.so 00:02:00.662 SYMLINK libspdk_log.so 00:02:00.662 CC lib/ioat/ioat.o 00:02:00.662 CXX lib/trace_parser/trace.o 00:02:00.662 CC lib/util/base64.o 00:02:00.662 CC lib/util/bit_array.o 00:02:00.662 CC lib/util/cpuset.o 00:02:00.662 CC lib/dma/dma.o 00:02:00.662 CC lib/util/crc16.o 00:02:00.662 CC lib/util/crc32.o 00:02:00.662 CC lib/util/crc32c.o 00:02:00.662 CC lib/util/crc32_ieee.o 00:02:00.662 CC lib/util/crc64.o 00:02:00.662 CC lib/util/dif.o 00:02:00.662 CC lib/util/fd.o 00:02:00.662 CC lib/util/file.o 00:02:00.662 CC lib/util/hexlify.o 00:02:00.662 CC lib/util/iov.o 00:02:00.662 CC lib/util/math.o 00:02:00.662 CC lib/util/pipe.o 00:02:00.662 CC lib/util/strerror_tls.o 00:02:00.662 CC lib/util/string.o 00:02:00.662 CC lib/util/uuid.o 00:02:00.662 CC lib/util/fd_group.o 00:02:00.662 CC lib/util/xor.o 00:02:00.662 CC lib/util/zipf.o 00:02:00.662 CC lib/vfio_user/host/vfio_user.o 00:02:00.662 CC lib/vfio_user/host/vfio_user_pci.o 00:02:00.921 LIB libspdk_dma.a 00:02:00.921 SO libspdk_dma.so.3.0 00:02:00.921 SYMLINK libspdk_dma.so 00:02:00.921 LIB libspdk_ioat.a 00:02:00.921 SO libspdk_ioat.so.6.0 00:02:00.921 SYMLINK libspdk_ioat.so 00:02:00.921 LIB libspdk_vfio_user.a 00:02:01.181 SO libspdk_vfio_user.so.4.0 00:02:01.181 SYMLINK libspdk_vfio_user.so 00:02:01.181 LIB libspdk_util.a 00:02:01.181 SO libspdk_util.so.8.0 00:02:01.513 SYMLINK libspdk_util.so 00:02:01.513 CC lib/rdma/common.o 00:02:01.513 CC lib/vmd/vmd.o 00:02:01.513 CC lib/json/json_parse.o 00:02:01.513 CC lib/idxd/idxd.o 00:02:01.513 CC lib/conf/conf.o 00:02:01.513 CC lib/rdma/rdma_verbs.o 00:02:01.513 CC lib/vmd/led.o 00:02:01.513 CC lib/json/json_util.o 00:02:01.513 CC lib/json/json_write.o 00:02:01.513 CC lib/idxd/idxd_user.o 00:02:01.513 CC lib/idxd/idxd_kernel.o 00:02:01.513 CC lib/env_dpdk/env.o 00:02:01.513 CC lib/env_dpdk/memory.o 00:02:01.513 CC lib/env_dpdk/pci.o 00:02:01.513 CC lib/env_dpdk/init.o 00:02:01.513 CC lib/env_dpdk/threads.o 00:02:01.513 CC lib/env_dpdk/pci_ioat.o 00:02:01.513 CC lib/env_dpdk/pci_virtio.o 00:02:01.513 CC lib/env_dpdk/pci_vmd.o 00:02:01.513 CC lib/env_dpdk/pci_idxd.o 00:02:01.513 CC lib/env_dpdk/pci_event.o 00:02:01.513 CC lib/env_dpdk/sigbus_handler.o 00:02:01.513 CC lib/env_dpdk/pci_dpdk.o 00:02:01.513 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:01.513 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:01.772 LIB libspdk_trace_parser.a 00:02:01.772 SO libspdk_trace_parser.so.4.0 00:02:01.772 LIB libspdk_conf.a 00:02:01.772 SYMLINK libspdk_trace_parser.so 00:02:01.772 SO libspdk_conf.so.5.0 00:02:01.772 LIB libspdk_rdma.a 00:02:01.772 LIB libspdk_json.a 00:02:01.772 SYMLINK libspdk_conf.so 00:02:01.772 SO libspdk_rdma.so.5.0 00:02:01.772 SO libspdk_json.so.5.1 00:02:02.029 SYMLINK libspdk_rdma.so 00:02:02.029 SYMLINK libspdk_json.so 00:02:02.029 CC lib/jsonrpc/jsonrpc_server.o 00:02:02.029 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:02.029 CC lib/jsonrpc/jsonrpc_client.o 00:02:02.029 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:02.029 LIB libspdk_idxd.a 00:02:02.029 SO libspdk_idxd.so.11.0 00:02:02.287 SYMLINK libspdk_idxd.so 00:02:02.287 LIB libspdk_vmd.a 00:02:02.287 SO libspdk_vmd.so.5.0 00:02:02.287 SYMLINK libspdk_vmd.so 00:02:02.287 LIB libspdk_jsonrpc.a 00:02:02.287 SO libspdk_jsonrpc.so.5.1 00:02:02.287 SYMLINK libspdk_jsonrpc.so 00:02:02.545 CC lib/rpc/rpc.o 00:02:02.802 LIB libspdk_rpc.a 00:02:02.802 SO libspdk_rpc.so.5.0 00:02:02.802 SYMLINK libspdk_rpc.so 00:02:02.802 CC lib/sock/sock.o 00:02:02.802 CC lib/sock/sock_rpc.o 00:02:02.802 CC lib/notify/notify.o 00:02:02.802 CC lib/trace/trace.o 00:02:02.803 CC lib/notify/notify_rpc.o 00:02:02.803 CC lib/trace/trace_flags.o 00:02:02.803 CC lib/trace/trace_rpc.o 00:02:03.061 LIB libspdk_notify.a 00:02:03.061 SO libspdk_notify.so.5.0 00:02:03.061 LIB libspdk_trace.a 00:02:03.061 SYMLINK libspdk_notify.so 00:02:03.061 SO libspdk_trace.so.9.0 00:02:03.319 SYMLINK libspdk_trace.so 00:02:03.319 LIB libspdk_sock.a 00:02:03.319 SO libspdk_sock.so.8.0 00:02:03.319 CC lib/thread/thread.o 00:02:03.319 CC lib/thread/iobuf.o 00:02:03.319 SYMLINK libspdk_sock.so 00:02:03.577 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:03.577 CC lib/nvme/nvme_ctrlr.o 00:02:03.577 CC lib/nvme/nvme_fabric.o 00:02:03.577 CC lib/nvme/nvme_ns_cmd.o 00:02:03.577 CC lib/nvme/nvme_ns.o 00:02:03.577 CC lib/nvme/nvme_pcie_common.o 00:02:03.577 CC lib/nvme/nvme_pcie.o 00:02:03.577 CC lib/nvme/nvme_qpair.o 00:02:03.577 CC lib/nvme/nvme.o 00:02:03.577 CC lib/nvme/nvme_quirks.o 00:02:03.577 CC lib/nvme/nvme_transport.o 00:02:03.577 CC lib/nvme/nvme_discovery.o 00:02:03.577 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:03.577 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:03.577 CC lib/nvme/nvme_tcp.o 00:02:03.577 CC lib/nvme/nvme_opal.o 00:02:03.577 CC lib/nvme/nvme_io_msg.o 00:02:03.577 CC lib/nvme/nvme_poll_group.o 00:02:03.577 CC lib/nvme/nvme_zns.o 00:02:03.577 CC lib/nvme/nvme_cuse.o 00:02:03.577 CC lib/nvme/nvme_vfio_user.o 00:02:03.577 CC lib/nvme/nvme_rdma.o 00:02:03.577 LIB libspdk_env_dpdk.a 00:02:03.577 SO libspdk_env_dpdk.so.13.0 00:02:03.836 SYMLINK libspdk_env_dpdk.so 00:02:05.209 LIB libspdk_thread.a 00:02:05.209 SO libspdk_thread.so.9.0 00:02:05.209 SYMLINK libspdk_thread.so 00:02:05.209 CC lib/accel/accel.o 00:02:05.209 CC lib/init/json_config.o 00:02:05.209 CC lib/accel/accel_rpc.o 00:02:05.209 CC lib/init/subsystem.o 00:02:05.209 CC lib/blob/blobstore.o 00:02:05.209 CC lib/virtio/virtio.o 00:02:05.209 CC lib/virtio/virtio_vhost_user.o 00:02:05.209 CC lib/init/subsystem_rpc.o 00:02:05.209 CC lib/accel/accel_sw.o 00:02:05.209 CC lib/blob/request.o 00:02:05.209 CC lib/virtio/virtio_vfio_user.o 00:02:05.209 CC lib/blob/zeroes.o 00:02:05.209 CC lib/init/rpc.o 00:02:05.209 CC lib/blob/blob_bs_dev.o 00:02:05.209 CC lib/virtio/virtio_pci.o 00:02:05.467 LIB libspdk_init.a 00:02:05.467 SO libspdk_init.so.4.0 00:02:05.467 LIB libspdk_virtio.a 00:02:05.467 SYMLINK libspdk_init.so 00:02:05.467 SO libspdk_virtio.so.6.0 00:02:05.467 SYMLINK libspdk_virtio.so 00:02:05.467 CC lib/event/app.o 00:02:05.467 CC lib/event/reactor.o 00:02:05.467 CC lib/event/log_rpc.o 00:02:05.467 CC lib/event/app_rpc.o 00:02:05.467 CC lib/event/scheduler_static.o 00:02:05.725 LIB libspdk_nvme.a 00:02:05.983 SO libspdk_nvme.so.12.0 00:02:05.983 LIB libspdk_event.a 00:02:05.983 SO libspdk_event.so.12.0 00:02:05.983 SYMLINK libspdk_event.so 00:02:06.241 LIB libspdk_accel.a 00:02:06.241 SYMLINK libspdk_nvme.so 00:02:06.241 SO libspdk_accel.so.14.0 00:02:06.241 SYMLINK libspdk_accel.so 00:02:06.241 CC lib/bdev/bdev.o 00:02:06.241 CC lib/bdev/bdev_rpc.o 00:02:06.241 CC lib/bdev/bdev_zone.o 00:02:06.241 CC lib/bdev/part.o 00:02:06.241 CC lib/bdev/scsi_nvme.o 00:02:08.138 LIB libspdk_blob.a 00:02:08.138 SO libspdk_blob.so.10.1 00:02:08.138 SYMLINK libspdk_blob.so 00:02:08.138 CC lib/blobfs/blobfs.o 00:02:08.138 CC lib/blobfs/tree.o 00:02:08.138 CC lib/lvol/lvol.o 00:02:08.702 LIB libspdk_bdev.a 00:02:08.702 SO libspdk_bdev.so.14.0 00:02:08.702 LIB libspdk_blobfs.a 00:02:08.702 SO libspdk_blobfs.so.9.0 00:02:08.969 SYMLINK libspdk_bdev.so 00:02:08.969 SYMLINK libspdk_blobfs.so 00:02:08.969 LIB libspdk_lvol.a 00:02:08.969 SO libspdk_lvol.so.9.1 00:02:08.969 SYMLINK libspdk_lvol.so 00:02:08.969 CC lib/nbd/nbd.o 00:02:08.969 CC lib/ublk/ublk.o 00:02:08.969 CC lib/scsi/dev.o 00:02:08.969 CC lib/nvmf/ctrlr.o 00:02:08.969 CC lib/ublk/ublk_rpc.o 00:02:08.969 CC lib/nbd/nbd_rpc.o 00:02:08.969 CC lib/scsi/lun.o 00:02:08.969 CC lib/nvmf/ctrlr_discovery.o 00:02:08.969 CC lib/ftl/ftl_core.o 00:02:08.969 CC lib/nvmf/ctrlr_bdev.o 00:02:08.969 CC lib/scsi/port.o 00:02:08.969 CC lib/ftl/ftl_init.o 00:02:08.969 CC lib/nvmf/subsystem.o 00:02:08.969 CC lib/ftl/ftl_layout.o 00:02:08.969 CC lib/scsi/scsi.o 00:02:08.969 CC lib/ftl/ftl_debug.o 00:02:08.969 CC lib/scsi/scsi_bdev.o 00:02:08.969 CC lib/nvmf/nvmf.o 00:02:08.969 CC lib/ftl/ftl_io.o 00:02:08.969 CC lib/nvmf/nvmf_rpc.o 00:02:08.969 CC lib/scsi/scsi_pr.o 00:02:08.969 CC lib/nvmf/transport.o 00:02:08.969 CC lib/ftl/ftl_sb.o 00:02:08.969 CC lib/scsi/scsi_rpc.o 00:02:08.969 CC lib/scsi/task.o 00:02:08.969 CC lib/ftl/ftl_l2p.o 00:02:08.969 CC lib/nvmf/tcp.o 00:02:08.969 CC lib/nvmf/rdma.o 00:02:08.969 CC lib/ftl/ftl_nv_cache.o 00:02:08.969 CC lib/ftl/ftl_l2p_flat.o 00:02:08.969 CC lib/ftl/ftl_band.o 00:02:08.969 CC lib/ftl/ftl_band_ops.o 00:02:08.969 CC lib/ftl/ftl_writer.o 00:02:08.969 CC lib/ftl/ftl_rq.o 00:02:08.969 CC lib/ftl/ftl_reloc.o 00:02:08.969 CC lib/ftl/ftl_l2p_cache.o 00:02:08.969 CC lib/ftl/ftl_p2l.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:08.969 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:09.226 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:09.226 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:09.226 CC lib/ftl/utils/ftl_conf.o 00:02:09.226 CC lib/ftl/utils/ftl_md.o 00:02:09.226 CC lib/ftl/utils/ftl_mempool.o 00:02:09.226 CC lib/ftl/utils/ftl_bitmap.o 00:02:09.484 CC lib/ftl/utils/ftl_property.o 00:02:09.484 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:09.484 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:09.484 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:09.484 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:09.484 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:09.484 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:09.484 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:09.484 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:09.484 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:09.484 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:09.484 CC lib/ftl/base/ftl_base_dev.o 00:02:09.484 CC lib/ftl/base/ftl_base_bdev.o 00:02:09.484 CC lib/ftl/ftl_trace.o 00:02:09.773 LIB libspdk_nbd.a 00:02:09.773 LIB libspdk_scsi.a 00:02:09.773 SO libspdk_nbd.so.6.0 00:02:09.773 SO libspdk_scsi.so.8.0 00:02:09.773 SYMLINK libspdk_nbd.so 00:02:09.773 SYMLINK libspdk_scsi.so 00:02:10.031 LIB libspdk_ublk.a 00:02:10.031 CC lib/vhost/vhost.o 00:02:10.031 CC lib/vhost/vhost_rpc.o 00:02:10.032 CC lib/vhost/vhost_scsi.o 00:02:10.032 CC lib/vhost/vhost_blk.o 00:02:10.032 CC lib/vhost/rte_vhost_user.o 00:02:10.032 CC lib/iscsi/conn.o 00:02:10.032 CC lib/iscsi/init_grp.o 00:02:10.032 SO libspdk_ublk.so.2.0 00:02:10.032 CC lib/iscsi/iscsi.o 00:02:10.032 CC lib/iscsi/md5.o 00:02:10.032 CC lib/iscsi/param.o 00:02:10.032 CC lib/iscsi/portal_grp.o 00:02:10.032 CC lib/iscsi/tgt_node.o 00:02:10.032 CC lib/iscsi/iscsi_subsystem.o 00:02:10.032 CC lib/iscsi/iscsi_rpc.o 00:02:10.032 CC lib/iscsi/task.o 00:02:10.032 SYMLINK libspdk_ublk.so 00:02:10.290 LIB libspdk_ftl.a 00:02:10.548 SO libspdk_ftl.so.8.0 00:02:10.806 SYMLINK libspdk_ftl.so 00:02:11.063 LIB libspdk_vhost.a 00:02:11.321 SO libspdk_vhost.so.7.1 00:02:11.321 SYMLINK libspdk_vhost.so 00:02:11.321 LIB libspdk_nvmf.a 00:02:11.321 SO libspdk_nvmf.so.17.0 00:02:11.321 LIB libspdk_iscsi.a 00:02:11.579 SO libspdk_iscsi.so.7.0 00:02:11.579 SYMLINK libspdk_nvmf.so 00:02:11.579 SYMLINK libspdk_iscsi.so 00:02:11.837 CC module/env_dpdk/env_dpdk_rpc.o 00:02:11.837 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:11.837 CC module/scheduler/gscheduler/gscheduler.o 00:02:11.837 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:11.837 CC module/accel/ioat/accel_ioat.o 00:02:11.837 CC module/sock/posix/posix.o 00:02:11.837 CC module/accel/ioat/accel_ioat_rpc.o 00:02:11.837 CC module/accel/error/accel_error.o 00:02:11.837 CC module/accel/dsa/accel_dsa.o 00:02:11.837 CC module/accel/error/accel_error_rpc.o 00:02:11.837 CC module/accel/dsa/accel_dsa_rpc.o 00:02:11.837 CC module/accel/iaa/accel_iaa.o 00:02:11.837 CC module/blob/bdev/blob_bdev.o 00:02:11.837 CC module/accel/iaa/accel_iaa_rpc.o 00:02:11.837 LIB libspdk_env_dpdk_rpc.a 00:02:12.095 SO libspdk_env_dpdk_rpc.so.5.0 00:02:12.095 LIB libspdk_scheduler_gscheduler.a 00:02:12.095 SYMLINK libspdk_env_dpdk_rpc.so 00:02:12.095 LIB libspdk_scheduler_dpdk_governor.a 00:02:12.095 SO libspdk_scheduler_gscheduler.so.3.0 00:02:12.095 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:12.095 LIB libspdk_accel_error.a 00:02:12.095 LIB libspdk_accel_ioat.a 00:02:12.095 LIB libspdk_scheduler_dynamic.a 00:02:12.095 SO libspdk_accel_error.so.1.0 00:02:12.095 LIB libspdk_accel_iaa.a 00:02:12.095 SO libspdk_accel_ioat.so.5.0 00:02:12.095 SO libspdk_scheduler_dynamic.so.3.0 00:02:12.095 SYMLINK libspdk_scheduler_gscheduler.so 00:02:12.095 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:12.095 LIB libspdk_accel_dsa.a 00:02:12.095 SO libspdk_accel_iaa.so.2.0 00:02:12.095 SYMLINK libspdk_scheduler_dynamic.so 00:02:12.095 SYMLINK libspdk_accel_error.so 00:02:12.095 SO libspdk_accel_dsa.so.4.0 00:02:12.095 SYMLINK libspdk_accel_ioat.so 00:02:12.095 LIB libspdk_blob_bdev.a 00:02:12.095 SYMLINK libspdk_accel_iaa.so 00:02:12.095 SO libspdk_blob_bdev.so.10.1 00:02:12.095 SYMLINK libspdk_accel_dsa.so 00:02:12.095 SYMLINK libspdk_blob_bdev.so 00:02:12.353 CC module/blobfs/bdev/blobfs_bdev.o 00:02:12.353 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:12.353 CC module/bdev/null/bdev_null.o 00:02:12.353 CC module/bdev/malloc/bdev_malloc.o 00:02:12.353 CC module/bdev/null/bdev_null_rpc.o 00:02:12.353 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:12.353 CC module/bdev/passthru/vbdev_passthru.o 00:02:12.353 CC module/bdev/nvme/bdev_nvme.o 00:02:12.353 CC module/bdev/delay/vbdev_delay.o 00:02:12.353 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:12.353 CC module/bdev/error/vbdev_error.o 00:02:12.353 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:12.353 CC module/bdev/lvol/vbdev_lvol.o 00:02:12.353 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:12.353 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:12.353 CC module/bdev/gpt/gpt.o 00:02:12.353 CC module/bdev/error/vbdev_error_rpc.o 00:02:12.353 CC module/bdev/nvme/nvme_rpc.o 00:02:12.353 CC module/bdev/gpt/vbdev_gpt.o 00:02:12.353 CC module/bdev/nvme/bdev_mdns_client.o 00:02:12.353 CC module/bdev/ftl/bdev_ftl.o 00:02:12.353 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:12.353 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:12.353 CC module/bdev/aio/bdev_aio.o 00:02:12.353 CC module/bdev/split/vbdev_split.o 00:02:12.353 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:12.353 CC module/bdev/nvme/vbdev_opal.o 00:02:12.353 CC module/bdev/aio/bdev_aio_rpc.o 00:02:12.353 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:12.353 CC module/bdev/split/vbdev_split_rpc.o 00:02:12.353 CC module/bdev/raid/bdev_raid.o 00:02:12.353 CC module/bdev/raid/bdev_raid_rpc.o 00:02:12.353 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:12.353 CC module/bdev/raid/bdev_raid_sb.o 00:02:12.353 CC module/bdev/raid/raid1.o 00:02:12.353 CC module/bdev/raid/raid0.o 00:02:12.353 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:12.353 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:12.353 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:12.353 CC module/bdev/raid/concat.o 00:02:12.353 CC module/bdev/iscsi/bdev_iscsi.o 00:02:12.353 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:12.613 LIB libspdk_blobfs_bdev.a 00:02:12.871 SO libspdk_blobfs_bdev.so.5.0 00:02:12.871 LIB libspdk_sock_posix.a 00:02:12.871 SO libspdk_sock_posix.so.5.0 00:02:12.871 LIB libspdk_bdev_split.a 00:02:12.871 SYMLINK libspdk_blobfs_bdev.so 00:02:12.871 SO libspdk_bdev_split.so.5.0 00:02:12.871 LIB libspdk_bdev_gpt.a 00:02:12.871 LIB libspdk_bdev_passthru.a 00:02:12.871 LIB libspdk_bdev_null.a 00:02:12.871 LIB libspdk_bdev_ftl.a 00:02:12.871 SO libspdk_bdev_passthru.so.5.0 00:02:12.871 SO libspdk_bdev_gpt.so.5.0 00:02:12.871 SYMLINK libspdk_sock_posix.so 00:02:12.871 SO libspdk_bdev_null.so.5.0 00:02:12.871 SO libspdk_bdev_ftl.so.5.0 00:02:12.871 LIB libspdk_bdev_malloc.a 00:02:12.871 LIB libspdk_bdev_error.a 00:02:12.871 SYMLINK libspdk_bdev_split.so 00:02:12.871 SO libspdk_bdev_error.so.5.0 00:02:12.871 SO libspdk_bdev_malloc.so.5.0 00:02:12.871 SYMLINK libspdk_bdev_gpt.so 00:02:12.871 SYMLINK libspdk_bdev_passthru.so 00:02:12.871 LIB libspdk_bdev_aio.a 00:02:12.871 LIB libspdk_bdev_zone_block.a 00:02:12.871 LIB libspdk_bdev_delay.a 00:02:12.871 SYMLINK libspdk_bdev_null.so 00:02:12.871 SYMLINK libspdk_bdev_ftl.so 00:02:12.871 SO libspdk_bdev_aio.so.5.0 00:02:12.871 SO libspdk_bdev_zone_block.so.5.0 00:02:12.871 SO libspdk_bdev_delay.so.5.0 00:02:12.871 SYMLINK libspdk_bdev_error.so 00:02:12.871 SYMLINK libspdk_bdev_malloc.so 00:02:12.871 LIB libspdk_bdev_virtio.a 00:02:12.871 LIB libspdk_bdev_iscsi.a 00:02:13.129 SO libspdk_bdev_virtio.so.5.0 00:02:13.129 SO libspdk_bdev_iscsi.so.5.0 00:02:13.129 SYMLINK libspdk_bdev_aio.so 00:02:13.129 SYMLINK libspdk_bdev_zone_block.so 00:02:13.129 SYMLINK libspdk_bdev_delay.so 00:02:13.130 LIB libspdk_bdev_lvol.a 00:02:13.130 SO libspdk_bdev_lvol.so.5.0 00:02:13.130 SYMLINK libspdk_bdev_iscsi.so 00:02:13.130 SYMLINK libspdk_bdev_virtio.so 00:02:13.130 SYMLINK libspdk_bdev_lvol.so 00:02:13.387 LIB libspdk_bdev_raid.a 00:02:13.387 SO libspdk_bdev_raid.so.5.0 00:02:13.644 SYMLINK libspdk_bdev_raid.so 00:02:14.579 LIB libspdk_bdev_nvme.a 00:02:14.579 SO libspdk_bdev_nvme.so.6.0 00:02:14.837 SYMLINK libspdk_bdev_nvme.so 00:02:15.095 CC module/event/subsystems/sock/sock.o 00:02:15.095 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:15.095 CC module/event/subsystems/iobuf/iobuf.o 00:02:15.095 CC module/event/subsystems/scheduler/scheduler.o 00:02:15.095 CC module/event/subsystems/vmd/vmd.o 00:02:15.095 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:15.095 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:15.095 LIB libspdk_event_sock.a 00:02:15.095 LIB libspdk_event_vhost_blk.a 00:02:15.096 LIB libspdk_event_vmd.a 00:02:15.096 LIB libspdk_event_scheduler.a 00:02:15.096 SO libspdk_event_sock.so.4.0 00:02:15.096 SO libspdk_event_vhost_blk.so.2.0 00:02:15.096 LIB libspdk_event_iobuf.a 00:02:15.096 SO libspdk_event_scheduler.so.3.0 00:02:15.096 SO libspdk_event_vmd.so.5.0 00:02:15.096 SO libspdk_event_iobuf.so.2.0 00:02:15.353 SYMLINK libspdk_event_sock.so 00:02:15.353 SYMLINK libspdk_event_vhost_blk.so 00:02:15.353 SYMLINK libspdk_event_scheduler.so 00:02:15.353 SYMLINK libspdk_event_vmd.so 00:02:15.353 SYMLINK libspdk_event_iobuf.so 00:02:15.353 CC module/event/subsystems/accel/accel.o 00:02:15.610 LIB libspdk_event_accel.a 00:02:15.610 SO libspdk_event_accel.so.5.0 00:02:15.610 SYMLINK libspdk_event_accel.so 00:02:15.610 CC module/event/subsystems/bdev/bdev.o 00:02:15.868 LIB libspdk_event_bdev.a 00:02:15.868 SO libspdk_event_bdev.so.5.0 00:02:15.868 SYMLINK libspdk_event_bdev.so 00:02:16.126 CC module/event/subsystems/nbd/nbd.o 00:02:16.126 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:16.126 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:16.126 CC module/event/subsystems/scsi/scsi.o 00:02:16.126 CC module/event/subsystems/ublk/ublk.o 00:02:16.126 LIB libspdk_event_nbd.a 00:02:16.126 LIB libspdk_event_ublk.a 00:02:16.126 SO libspdk_event_nbd.so.5.0 00:02:16.126 LIB libspdk_event_scsi.a 00:02:16.126 SO libspdk_event_ublk.so.2.0 00:02:16.126 SO libspdk_event_scsi.so.5.0 00:02:16.384 SYMLINK libspdk_event_nbd.so 00:02:16.384 SYMLINK libspdk_event_ublk.so 00:02:16.384 LIB libspdk_event_nvmf.a 00:02:16.384 SYMLINK libspdk_event_scsi.so 00:02:16.384 SO libspdk_event_nvmf.so.5.0 00:02:16.384 SYMLINK libspdk_event_nvmf.so 00:02:16.384 CC module/event/subsystems/iscsi/iscsi.o 00:02:16.384 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:16.642 LIB libspdk_event_vhost_scsi.a 00:02:16.642 SO libspdk_event_vhost_scsi.so.2.0 00:02:16.642 LIB libspdk_event_iscsi.a 00:02:16.642 SO libspdk_event_iscsi.so.5.0 00:02:16.642 SYMLINK libspdk_event_vhost_scsi.so 00:02:16.642 SYMLINK libspdk_event_iscsi.so 00:02:16.642 SO libspdk.so.5.0 00:02:16.642 SYMLINK libspdk.so 00:02:16.905 CC app/spdk_nvme_identify/identify.o 00:02:16.905 CC app/trace_record/trace_record.o 00:02:16.905 CC app/spdk_top/spdk_top.o 00:02:16.905 CXX app/trace/trace.o 00:02:16.905 CC app/spdk_nvme_perf/perf.o 00:02:16.905 CC app/spdk_lspci/spdk_lspci.o 00:02:16.905 CC app/spdk_nvme_discover/discovery_aer.o 00:02:16.905 TEST_HEADER include/spdk/accel.h 00:02:16.905 TEST_HEADER include/spdk/accel_module.h 00:02:16.905 TEST_HEADER include/spdk/assert.h 00:02:16.905 TEST_HEADER include/spdk/barrier.h 00:02:16.905 CC test/rpc_client/rpc_client_test.o 00:02:16.905 TEST_HEADER include/spdk/base64.h 00:02:16.905 TEST_HEADER include/spdk/bdev.h 00:02:16.905 TEST_HEADER include/spdk/bdev_module.h 00:02:16.905 TEST_HEADER include/spdk/bdev_zone.h 00:02:16.905 TEST_HEADER include/spdk/bit_array.h 00:02:16.905 TEST_HEADER include/spdk/bit_pool.h 00:02:16.905 TEST_HEADER include/spdk/blob_bdev.h 00:02:16.905 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:16.905 TEST_HEADER include/spdk/blobfs.h 00:02:16.905 TEST_HEADER include/spdk/blob.h 00:02:16.905 TEST_HEADER include/spdk/conf.h 00:02:16.905 TEST_HEADER include/spdk/config.h 00:02:16.905 CC app/spdk_dd/spdk_dd.o 00:02:16.905 TEST_HEADER include/spdk/cpuset.h 00:02:16.905 TEST_HEADER include/spdk/crc16.h 00:02:16.905 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:16.905 TEST_HEADER include/spdk/crc32.h 00:02:16.905 TEST_HEADER include/spdk/crc64.h 00:02:16.905 CC app/iscsi_tgt/iscsi_tgt.o 00:02:16.905 TEST_HEADER include/spdk/dif.h 00:02:16.905 CC app/nvmf_tgt/nvmf_main.o 00:02:16.905 TEST_HEADER include/spdk/dma.h 00:02:16.905 TEST_HEADER include/spdk/endian.h 00:02:16.905 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:16.905 TEST_HEADER include/spdk/env_dpdk.h 00:02:16.905 CC examples/nvme/abort/abort.o 00:02:16.905 CC app/vhost/vhost.o 00:02:16.905 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:16.905 CC examples/nvme/reconnect/reconnect.o 00:02:16.905 CC examples/nvme/hotplug/hotplug.o 00:02:16.905 CC examples/nvme/hello_world/hello_world.o 00:02:16.905 CC examples/idxd/perf/perf.o 00:02:16.905 TEST_HEADER include/spdk/env.h 00:02:16.905 CC examples/nvme/arbitration/arbitration.o 00:02:16.905 CC examples/sock/hello_world/hello_sock.o 00:02:16.905 TEST_HEADER include/spdk/event.h 00:02:16.905 CC examples/util/zipf/zipf.o 00:02:16.905 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:16.905 CC examples/vmd/lsvmd/lsvmd.o 00:02:16.905 CC examples/accel/perf/accel_perf.o 00:02:16.905 TEST_HEADER include/spdk/fd_group.h 00:02:16.905 CC examples/vmd/led/led.o 00:02:16.905 CC test/nvme/aer/aer.o 00:02:16.905 TEST_HEADER include/spdk/fd.h 00:02:16.905 TEST_HEADER include/spdk/file.h 00:02:16.905 CC examples/ioat/perf/perf.o 00:02:16.905 CC app/fio/nvme/fio_plugin.o 00:02:16.905 TEST_HEADER include/spdk/ftl.h 00:02:16.905 TEST_HEADER include/spdk/gpt_spec.h 00:02:16.905 CC test/thread/poller_perf/poller_perf.o 00:02:16.905 TEST_HEADER include/spdk/hexlify.h 00:02:16.905 CC test/event/event_perf/event_perf.o 00:02:16.905 TEST_HEADER include/spdk/histogram_data.h 00:02:16.905 CC app/spdk_tgt/spdk_tgt.o 00:02:16.905 TEST_HEADER include/spdk/idxd.h 00:02:16.905 TEST_HEADER include/spdk/idxd_spec.h 00:02:16.906 TEST_HEADER include/spdk/init.h 00:02:16.906 TEST_HEADER include/spdk/ioat.h 00:02:16.906 TEST_HEADER include/spdk/ioat_spec.h 00:02:16.906 TEST_HEADER include/spdk/iscsi_spec.h 00:02:16.906 TEST_HEADER include/spdk/json.h 00:02:16.906 TEST_HEADER include/spdk/jsonrpc.h 00:02:16.906 TEST_HEADER include/spdk/likely.h 00:02:16.906 CC examples/blob/hello_world/hello_blob.o 00:02:16.906 TEST_HEADER include/spdk/log.h 00:02:16.906 TEST_HEADER include/spdk/lvol.h 00:02:16.906 TEST_HEADER include/spdk/memory.h 00:02:16.906 TEST_HEADER include/spdk/mmio.h 00:02:16.906 CC examples/bdev/bdevperf/bdevperf.o 00:02:17.185 TEST_HEADER include/spdk/nbd.h 00:02:17.185 CC test/dma/test_dma/test_dma.o 00:02:17.185 CC examples/bdev/hello_world/hello_bdev.o 00:02:17.185 CC examples/blob/cli/blobcli.o 00:02:17.185 TEST_HEADER include/spdk/notify.h 00:02:17.185 CC examples/nvmf/nvmf/nvmf.o 00:02:17.185 CC test/accel/dif/dif.o 00:02:17.185 CC app/fio/bdev/fio_plugin.o 00:02:17.185 CC test/app/bdev_svc/bdev_svc.o 00:02:17.185 CC examples/thread/thread/thread_ex.o 00:02:17.185 TEST_HEADER include/spdk/nvme.h 00:02:17.185 CC test/bdev/bdevio/bdevio.o 00:02:17.185 CC test/blobfs/mkfs/mkfs.o 00:02:17.185 TEST_HEADER include/spdk/nvme_intel.h 00:02:17.185 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:17.185 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:17.185 TEST_HEADER include/spdk/nvme_spec.h 00:02:17.185 TEST_HEADER include/spdk/nvme_zns.h 00:02:17.185 CC test/env/mem_callbacks/mem_callbacks.o 00:02:17.185 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:17.185 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:17.185 TEST_HEADER include/spdk/nvmf.h 00:02:17.185 TEST_HEADER include/spdk/nvmf_spec.h 00:02:17.185 TEST_HEADER include/spdk/nvmf_transport.h 00:02:17.185 CC test/lvol/esnap/esnap.o 00:02:17.185 TEST_HEADER include/spdk/opal.h 00:02:17.185 TEST_HEADER include/spdk/opal_spec.h 00:02:17.185 TEST_HEADER include/spdk/pci_ids.h 00:02:17.185 TEST_HEADER include/spdk/pipe.h 00:02:17.185 TEST_HEADER include/spdk/queue.h 00:02:17.185 TEST_HEADER include/spdk/reduce.h 00:02:17.185 TEST_HEADER include/spdk/rpc.h 00:02:17.185 TEST_HEADER include/spdk/scheduler.h 00:02:17.185 TEST_HEADER include/spdk/scsi.h 00:02:17.185 TEST_HEADER include/spdk/scsi_spec.h 00:02:17.185 TEST_HEADER include/spdk/sock.h 00:02:17.185 TEST_HEADER include/spdk/stdinc.h 00:02:17.185 LINK spdk_lspci 00:02:17.185 TEST_HEADER include/spdk/string.h 00:02:17.185 TEST_HEADER include/spdk/thread.h 00:02:17.185 TEST_HEADER include/spdk/trace.h 00:02:17.185 TEST_HEADER include/spdk/trace_parser.h 00:02:17.185 TEST_HEADER include/spdk/tree.h 00:02:17.185 TEST_HEADER include/spdk/ublk.h 00:02:17.185 TEST_HEADER include/spdk/util.h 00:02:17.185 TEST_HEADER include/spdk/uuid.h 00:02:17.185 TEST_HEADER include/spdk/version.h 00:02:17.185 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:17.185 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:17.185 TEST_HEADER include/spdk/vhost.h 00:02:17.185 TEST_HEADER include/spdk/vmd.h 00:02:17.185 TEST_HEADER include/spdk/xor.h 00:02:17.185 TEST_HEADER include/spdk/zipf.h 00:02:17.185 CXX test/cpp_headers/accel.o 00:02:17.185 LINK lsvmd 00:02:17.185 LINK rpc_client_test 00:02:17.185 LINK led 00:02:17.185 LINK spdk_nvme_discover 00:02:17.185 LINK zipf 00:02:17.185 LINK poller_perf 00:02:17.185 LINK event_perf 00:02:17.185 LINK interrupt_tgt 00:02:17.185 LINK pmr_persistence 00:02:17.185 LINK nvmf_tgt 00:02:17.477 LINK cmb_copy 00:02:17.477 LINK vhost 00:02:17.477 LINK iscsi_tgt 00:02:17.477 LINK spdk_trace_record 00:02:17.477 LINK hello_world 00:02:17.477 LINK ioat_perf 00:02:17.477 LINK spdk_tgt 00:02:17.477 LINK hello_sock 00:02:17.477 LINK bdev_svc 00:02:17.478 LINK hotplug 00:02:17.478 LINK mkfs 00:02:17.478 LINK hello_blob 00:02:17.478 LINK hello_bdev 00:02:17.478 LINK aer 00:02:17.478 LINK thread 00:02:17.478 CC test/env/vtophys/vtophys.o 00:02:17.478 CXX test/cpp_headers/accel_module.o 00:02:17.478 LINK arbitration 00:02:17.748 CXX test/cpp_headers/assert.o 00:02:17.748 LINK nvmf 00:02:17.748 LINK idxd_perf 00:02:17.748 LINK spdk_dd 00:02:17.748 LINK reconnect 00:02:17.748 CC test/event/reactor/reactor.o 00:02:17.748 CC test/app/histogram_perf/histogram_perf.o 00:02:17.748 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:17.748 LINK spdk_trace 00:02:17.748 LINK abort 00:02:17.748 CC test/nvme/reset/reset.o 00:02:17.748 CC test/nvme/sgl/sgl.o 00:02:17.748 CXX test/cpp_headers/barrier.o 00:02:17.748 CC test/event/reactor_perf/reactor_perf.o 00:02:17.748 CC examples/ioat/verify/verify.o 00:02:17.748 CXX test/cpp_headers/base64.o 00:02:17.748 LINK dif 00:02:17.748 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:17.748 LINK test_dma 00:02:17.748 CC test/app/jsoncat/jsoncat.o 00:02:17.748 CC test/env/memory/memory_ut.o 00:02:17.748 CC test/event/app_repeat/app_repeat.o 00:02:17.748 LINK bdevio 00:02:17.748 CC test/env/pci/pci_ut.o 00:02:17.748 CXX test/cpp_headers/bdev.o 00:02:17.748 LINK vtophys 00:02:17.748 LINK accel_perf 00:02:17.748 CC test/nvme/e2edp/nvme_dp.o 00:02:17.748 CC test/nvme/overhead/overhead.o 00:02:18.011 LINK nvme_manage 00:02:18.011 CXX test/cpp_headers/bdev_module.o 00:02:18.011 CXX test/cpp_headers/bdev_zone.o 00:02:18.011 CC test/event/scheduler/scheduler.o 00:02:18.011 CXX test/cpp_headers/bit_array.o 00:02:18.011 CC test/nvme/err_injection/err_injection.o 00:02:18.011 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:18.011 LINK reactor 00:02:18.011 CC test/app/stub/stub.o 00:02:18.011 CXX test/cpp_headers/bit_pool.o 00:02:18.011 LINK histogram_perf 00:02:18.011 LINK blobcli 00:02:18.011 LINK spdk_nvme 00:02:18.011 LINK spdk_bdev 00:02:18.011 CXX test/cpp_headers/blob_bdev.o 00:02:18.011 LINK env_dpdk_post_init 00:02:18.011 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:18.011 LINK reactor_perf 00:02:18.011 CC test/nvme/startup/startup.o 00:02:18.011 CC test/nvme/reserve/reserve.o 00:02:18.011 CC test/nvme/simple_copy/simple_copy.o 00:02:18.011 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:18.011 CXX test/cpp_headers/blobfs_bdev.o 00:02:18.011 LINK jsoncat 00:02:18.011 LINK app_repeat 00:02:18.011 CC test/nvme/connect_stress/connect_stress.o 00:02:18.275 LINK verify 00:02:18.275 CC test/nvme/boot_partition/boot_partition.o 00:02:18.275 CXX test/cpp_headers/blobfs.o 00:02:18.275 LINK reset 00:02:18.275 CC test/nvme/compliance/nvme_compliance.o 00:02:18.275 LINK sgl 00:02:18.275 CXX test/cpp_headers/blob.o 00:02:18.275 CXX test/cpp_headers/conf.o 00:02:18.275 CXX test/cpp_headers/config.o 00:02:18.275 CXX test/cpp_headers/cpuset.o 00:02:18.275 CC test/nvme/fused_ordering/fused_ordering.o 00:02:18.275 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:18.275 CXX test/cpp_headers/crc16.o 00:02:18.275 CXX test/cpp_headers/crc32.o 00:02:18.275 CC test/nvme/fdp/fdp.o 00:02:18.275 LINK mem_callbacks 00:02:18.275 CXX test/cpp_headers/crc64.o 00:02:18.275 CXX test/cpp_headers/dif.o 00:02:18.275 CXX test/cpp_headers/dma.o 00:02:18.275 CC test/nvme/cuse/cuse.o 00:02:18.275 LINK stub 00:02:18.275 CXX test/cpp_headers/endian.o 00:02:18.275 LINK err_injection 00:02:18.275 CXX test/cpp_headers/env_dpdk.o 00:02:18.275 CXX test/cpp_headers/env.o 00:02:18.275 CXX test/cpp_headers/event.o 00:02:18.275 CXX test/cpp_headers/fd_group.o 00:02:18.275 CXX test/cpp_headers/fd.o 00:02:18.275 LINK spdk_nvme_perf 00:02:18.275 CXX test/cpp_headers/file.o 00:02:18.275 LINK scheduler 00:02:18.275 LINK startup 00:02:18.275 CXX test/cpp_headers/ftl.o 00:02:18.544 LINK nvme_dp 00:02:18.544 CXX test/cpp_headers/gpt_spec.o 00:02:18.544 LINK reserve 00:02:18.544 CXX test/cpp_headers/hexlify.o 00:02:18.544 LINK overhead 00:02:18.544 LINK bdevperf 00:02:18.544 CXX test/cpp_headers/histogram_data.o 00:02:18.544 LINK connect_stress 00:02:18.544 LINK boot_partition 00:02:18.544 CXX test/cpp_headers/idxd.o 00:02:18.544 LINK nvme_fuzz 00:02:18.544 CXX test/cpp_headers/idxd_spec.o 00:02:18.544 LINK spdk_nvme_identify 00:02:18.544 LINK pci_ut 00:02:18.544 CXX test/cpp_headers/init.o 00:02:18.544 CXX test/cpp_headers/ioat.o 00:02:18.544 LINK simple_copy 00:02:18.544 LINK spdk_top 00:02:18.544 CXX test/cpp_headers/ioat_spec.o 00:02:18.544 CXX test/cpp_headers/iscsi_spec.o 00:02:18.544 CXX test/cpp_headers/json.o 00:02:18.544 CXX test/cpp_headers/jsonrpc.o 00:02:18.544 CXX test/cpp_headers/likely.o 00:02:18.544 CXX test/cpp_headers/log.o 00:02:18.544 LINK doorbell_aers 00:02:18.544 CXX test/cpp_headers/lvol.o 00:02:18.544 CXX test/cpp_headers/memory.o 00:02:18.544 CXX test/cpp_headers/mmio.o 00:02:18.544 CXX test/cpp_headers/nbd.o 00:02:18.544 LINK fused_ordering 00:02:18.809 CXX test/cpp_headers/notify.o 00:02:18.809 CXX test/cpp_headers/nvme.o 00:02:18.809 CXX test/cpp_headers/nvme_intel.o 00:02:18.809 CXX test/cpp_headers/nvme_ocssd.o 00:02:18.809 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:18.809 CXX test/cpp_headers/nvme_spec.o 00:02:18.809 CXX test/cpp_headers/nvme_zns.o 00:02:18.809 CXX test/cpp_headers/nvmf_cmd.o 00:02:18.809 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:18.809 CXX test/cpp_headers/nvmf.o 00:02:18.809 CXX test/cpp_headers/nvmf_spec.o 00:02:18.809 CXX test/cpp_headers/nvmf_transport.o 00:02:18.809 CXX test/cpp_headers/opal.o 00:02:18.809 CXX test/cpp_headers/opal_spec.o 00:02:18.809 CXX test/cpp_headers/pci_ids.o 00:02:18.810 LINK vhost_fuzz 00:02:18.810 CXX test/cpp_headers/pipe.o 00:02:18.810 LINK nvme_compliance 00:02:18.810 CXX test/cpp_headers/queue.o 00:02:18.810 CXX test/cpp_headers/reduce.o 00:02:18.810 CXX test/cpp_headers/rpc.o 00:02:18.810 CXX test/cpp_headers/scheduler.o 00:02:18.810 CXX test/cpp_headers/scsi.o 00:02:18.810 CXX test/cpp_headers/scsi_spec.o 00:02:18.810 CXX test/cpp_headers/sock.o 00:02:18.810 CXX test/cpp_headers/stdinc.o 00:02:18.810 CXX test/cpp_headers/string.o 00:02:18.810 LINK fdp 00:02:18.810 CXX test/cpp_headers/thread.o 00:02:18.810 CXX test/cpp_headers/trace.o 00:02:18.810 CXX test/cpp_headers/trace_parser.o 00:02:18.810 CXX test/cpp_headers/tree.o 00:02:18.810 CXX test/cpp_headers/ublk.o 00:02:18.810 CXX test/cpp_headers/util.o 00:02:19.068 CXX test/cpp_headers/uuid.o 00:02:19.068 CXX test/cpp_headers/version.o 00:02:19.068 CXX test/cpp_headers/vfio_user_pci.o 00:02:19.068 CXX test/cpp_headers/vfio_user_spec.o 00:02:19.068 CXX test/cpp_headers/vhost.o 00:02:19.068 CXX test/cpp_headers/vmd.o 00:02:19.068 CXX test/cpp_headers/xor.o 00:02:19.068 CXX test/cpp_headers/zipf.o 00:02:19.325 LINK memory_ut 00:02:19.888 LINK cuse 00:02:20.146 LINK iscsi_fuzz 00:02:22.677 LINK esnap 00:02:22.677 00:02:22.677 real 0m45.154s 00:02:22.677 user 9m36.808s 00:02:22.677 sys 2m9.704s 00:02:22.677 12:16:16 -- common/autotest_common.sh@1105 -- $ xtrace_disable 00:02:22.677 12:16:16 -- common/autotest_common.sh@10 -- $ set +x 00:02:22.677 ************************************ 00:02:22.677 END TEST make 00:02:22.677 ************************************ 00:02:22.935 12:16:16 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:22.935 12:16:16 -- nvmf/common.sh@7 -- # uname -s 00:02:22.935 12:16:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:22.935 12:16:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:22.935 12:16:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:22.935 12:16:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:22.935 12:16:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:22.935 12:16:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:22.935 12:16:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:22.935 12:16:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:22.935 12:16:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:22.935 12:16:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:22.935 12:16:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:22.935 12:16:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:22.935 12:16:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:22.935 12:16:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:22.935 12:16:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:22.935 12:16:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:22.935 12:16:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:22.935 12:16:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:22.935 12:16:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:22.935 12:16:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.935 12:16:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.935 12:16:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.935 12:16:16 -- paths/export.sh@5 -- # export PATH 00:02:22.935 12:16:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:22.935 12:16:16 -- nvmf/common.sh@46 -- # : 0 00:02:22.935 12:16:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:22.935 12:16:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:22.935 12:16:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:22.935 12:16:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:22.935 12:16:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:22.935 12:16:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:22.935 12:16:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:22.935 12:16:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:22.935 12:16:16 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:22.936 12:16:16 -- spdk/autotest.sh@32 -- # uname -s 00:02:22.936 12:16:16 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:22.936 12:16:16 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:22.936 12:16:16 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:22.936 12:16:16 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:22.936 12:16:16 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:22.936 12:16:16 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:22.936 12:16:16 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:22.936 12:16:16 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:22.936 12:16:16 -- spdk/autotest.sh@48 -- # udevadm_pid=1115902 00:02:22.936 12:16:16 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:22.936 12:16:16 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:22.936 12:16:16 -- spdk/autotest.sh@54 -- # echo 1115904 00:02:22.936 12:16:16 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:22.936 12:16:16 -- spdk/autotest.sh@56 -- # echo 1115905 00:02:22.936 12:16:16 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:22.936 12:16:16 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:22.936 12:16:16 -- spdk/autotest.sh@60 -- # echo 1115906 00:02:22.936 12:16:16 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:22.936 12:16:16 -- spdk/autotest.sh@62 -- # echo 1115907 00:02:22.936 12:16:16 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:22.936 12:16:16 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:22.936 12:16:16 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:22.936 12:16:16 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:22.936 12:16:16 -- common/autotest_common.sh@10 -- # set +x 00:02:22.936 12:16:16 -- spdk/autotest.sh@70 -- # create_test_list 00:02:22.936 12:16:16 -- common/autotest_common.sh@736 -- # xtrace_disable 00:02:22.936 12:16:16 -- common/autotest_common.sh@10 -- # set +x 00:02:22.936 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:22.936 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:22.936 12:16:16 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:22.936 12:16:16 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:22.936 12:16:16 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:22.936 12:16:16 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:22.936 12:16:16 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:22.936 12:16:16 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:22.936 12:16:16 -- common/autotest_common.sh@1440 -- # uname 00:02:22.936 12:16:16 -- common/autotest_common.sh@1440 -- # '[' Linux = FreeBSD ']' 00:02:22.936 12:16:16 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:22.936 12:16:16 -- common/autotest_common.sh@1460 -- # uname 00:02:22.936 12:16:16 -- common/autotest_common.sh@1460 -- # [[ Linux = FreeBSD ]] 00:02:22.936 12:16:16 -- spdk/autotest.sh@82 -- # grep CC_TYPE mk/cc.mk 00:02:22.936 12:16:16 -- spdk/autotest.sh@82 -- # CC_TYPE=CC_TYPE=gcc 00:02:22.936 12:16:16 -- spdk/autotest.sh@83 -- # hash lcov 00:02:22.936 12:16:16 -- spdk/autotest.sh@83 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:22.936 12:16:16 -- spdk/autotest.sh@91 -- # export 'LCOV_OPTS= 00:02:22.936 --rc lcov_branch_coverage=1 00:02:22.936 --rc lcov_function_coverage=1 00:02:22.936 --rc genhtml_branch_coverage=1 00:02:22.936 --rc genhtml_function_coverage=1 00:02:22.936 --rc genhtml_legend=1 00:02:22.936 --rc geninfo_all_blocks=1 00:02:22.936 ' 00:02:22.936 12:16:16 -- spdk/autotest.sh@91 -- # LCOV_OPTS=' 00:02:22.936 --rc lcov_branch_coverage=1 00:02:22.936 --rc lcov_function_coverage=1 00:02:22.936 --rc genhtml_branch_coverage=1 00:02:22.936 --rc genhtml_function_coverage=1 00:02:22.936 --rc genhtml_legend=1 00:02:22.936 --rc geninfo_all_blocks=1 00:02:22.936 ' 00:02:22.936 12:16:16 -- spdk/autotest.sh@92 -- # export 'LCOV=lcov 00:02:22.936 --rc lcov_branch_coverage=1 00:02:22.936 --rc lcov_function_coverage=1 00:02:22.936 --rc genhtml_branch_coverage=1 00:02:22.936 --rc genhtml_function_coverage=1 00:02:22.936 --rc genhtml_legend=1 00:02:22.936 --rc geninfo_all_blocks=1 00:02:22.936 --no-external' 00:02:22.936 12:16:16 -- spdk/autotest.sh@92 -- # LCOV='lcov 00:02:22.936 --rc lcov_branch_coverage=1 00:02:22.936 --rc lcov_function_coverage=1 00:02:22.936 --rc genhtml_branch_coverage=1 00:02:22.936 --rc genhtml_function_coverage=1 00:02:22.936 --rc genhtml_legend=1 00:02:22.936 --rc geninfo_all_blocks=1 00:02:22.936 --no-external' 00:02:22.936 12:16:16 -- spdk/autotest.sh@94 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:22.936 lcov: LCOV version 1.14 00:02:22.936 12:16:16 -- spdk/autotest.sh@96 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:24.830 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:24.830 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:24.831 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:24.831 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:39.691 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:39.691 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:39.691 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:39.691 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:39.691 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:39.691 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:54.587 12:16:47 -- spdk/autotest.sh@100 -- # timing_enter pre_cleanup 00:02:54.587 12:16:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:02:54.587 12:16:47 -- common/autotest_common.sh@10 -- # set +x 00:02:54.587 12:16:47 -- spdk/autotest.sh@102 -- # rm -f 00:02:54.587 12:16:47 -- spdk/autotest.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:55.520 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:02:55.520 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:02:55.520 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:02:55.520 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:02:55.520 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:02:55.520 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:02:55.520 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:02:55.520 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:02:55.520 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:02:55.520 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:02:55.520 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:02:55.520 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:02:55.520 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:02:55.520 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:02:55.520 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:02:55.520 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:02:55.520 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:02:55.520 12:16:49 -- spdk/autotest.sh@107 -- # get_zoned_devs 00:02:55.520 12:16:49 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:55.520 12:16:49 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:55.520 12:16:49 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:55.520 12:16:49 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:55.520 12:16:49 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:55.520 12:16:49 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:55.520 12:16:49 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:55.520 12:16:49 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:55.520 12:16:49 -- spdk/autotest.sh@109 -- # (( 0 > 0 )) 00:02:55.520 12:16:49 -- spdk/autotest.sh@121 -- # ls /dev/nvme0n1 00:02:55.521 12:16:49 -- spdk/autotest.sh@121 -- # grep -v p 00:02:55.521 12:16:49 -- spdk/autotest.sh@121 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:55.521 12:16:49 -- spdk/autotest.sh@123 -- # [[ -z '' ]] 00:02:55.521 12:16:49 -- spdk/autotest.sh@124 -- # block_in_use /dev/nvme0n1 00:02:55.521 12:16:49 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:55.521 12:16:49 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:55.778 No valid GPT data, bailing 00:02:55.778 12:16:49 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:55.778 12:16:49 -- scripts/common.sh@393 -- # pt= 00:02:55.778 12:16:49 -- scripts/common.sh@394 -- # return 1 00:02:55.778 12:16:49 -- spdk/autotest.sh@125 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:55.778 1+0 records in 00:02:55.778 1+0 records out 00:02:55.778 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00281706 s, 372 MB/s 00:02:55.778 12:16:49 -- spdk/autotest.sh@129 -- # sync 00:02:55.778 12:16:49 -- spdk/autotest.sh@131 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:55.778 12:16:49 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:55.778 12:16:49 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:57.778 12:16:51 -- spdk/autotest.sh@135 -- # uname -s 00:02:57.778 12:16:51 -- spdk/autotest.sh@135 -- # '[' Linux = Linux ']' 00:02:57.778 12:16:51 -- spdk/autotest.sh@136 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:57.778 12:16:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:57.778 12:16:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:57.778 12:16:51 -- common/autotest_common.sh@10 -- # set +x 00:02:57.778 ************************************ 00:02:57.778 START TEST setup.sh 00:02:57.778 ************************************ 00:02:57.778 12:16:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:57.778 * Looking for test storage... 00:02:57.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:57.778 12:16:51 -- setup/test-setup.sh@10 -- # uname -s 00:02:57.778 12:16:51 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:57.778 12:16:51 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:57.778 12:16:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:02:57.778 12:16:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:02:57.778 12:16:51 -- common/autotest_common.sh@10 -- # set +x 00:02:57.778 ************************************ 00:02:57.778 START TEST acl 00:02:57.778 ************************************ 00:02:57.778 12:16:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:57.778 * Looking for test storage... 00:02:57.778 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:57.778 12:16:51 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:57.778 12:16:51 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:02:57.778 12:16:51 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:02:57.778 12:16:51 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:02:57.778 12:16:51 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:02:57.778 12:16:51 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:02:57.778 12:16:51 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:02:57.778 12:16:51 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:57.778 12:16:51 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:02:57.778 12:16:51 -- setup/acl.sh@12 -- # devs=() 00:02:57.778 12:16:51 -- setup/acl.sh@12 -- # declare -a devs 00:02:57.778 12:16:51 -- setup/acl.sh@13 -- # drivers=() 00:02:57.778 12:16:51 -- setup/acl.sh@13 -- # declare -A drivers 00:02:57.778 12:16:51 -- setup/acl.sh@51 -- # setup reset 00:02:57.778 12:16:51 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:57.778 12:16:51 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:59.149 12:16:52 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:59.149 12:16:52 -- setup/acl.sh@16 -- # local dev driver 00:02:59.149 12:16:52 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:59.149 12:16:52 -- setup/acl.sh@15 -- # setup output status 00:02:59.149 12:16:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:59.149 12:16:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:00.079 Hugepages 00:03:00.079 node hugesize free / total 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 00:03:00.079 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # continue 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:00.079 12:16:53 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:00.079 12:16:53 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:00.079 12:16:53 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:00.079 12:16:53 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:00.079 12:16:53 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:00.079 12:16:53 -- setup/acl.sh@54 -- # run_test denied denied 00:03:00.079 12:16:53 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:00.079 12:16:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:00.079 12:16:53 -- common/autotest_common.sh@10 -- # set +x 00:03:00.079 ************************************ 00:03:00.079 START TEST denied 00:03:00.079 ************************************ 00:03:00.079 12:16:53 -- common/autotest_common.sh@1104 -- # denied 00:03:00.079 12:16:53 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:00.079 12:16:53 -- setup/acl.sh@38 -- # setup output config 00:03:00.079 12:16:53 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:00.079 12:16:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:00.079 12:16:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:01.977 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:01.977 12:16:55 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:01.977 12:16:55 -- setup/acl.sh@28 -- # local dev driver 00:03:01.977 12:16:55 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:01.977 12:16:55 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:01.977 12:16:55 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:01.977 12:16:55 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:01.977 12:16:55 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:01.977 12:16:55 -- setup/acl.sh@41 -- # setup reset 00:03:01.977 12:16:55 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:01.977 12:16:55 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:03.870 00:03:03.870 real 0m3.702s 00:03:03.870 user 0m1.063s 00:03:03.870 sys 0m1.734s 00:03:03.870 12:16:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:03.870 12:16:57 -- common/autotest_common.sh@10 -- # set +x 00:03:03.870 ************************************ 00:03:03.870 END TEST denied 00:03:03.870 ************************************ 00:03:03.870 12:16:57 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:03.870 12:16:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:03.870 12:16:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:03.870 12:16:57 -- common/autotest_common.sh@10 -- # set +x 00:03:03.870 ************************************ 00:03:03.871 START TEST allowed 00:03:03.871 ************************************ 00:03:03.871 12:16:57 -- common/autotest_common.sh@1104 -- # allowed 00:03:03.871 12:16:57 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:03.871 12:16:57 -- setup/acl.sh@45 -- # setup output config 00:03:03.871 12:16:57 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:03.871 12:16:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:03.871 12:16:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:06.416 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:06.416 12:17:00 -- setup/acl.sh@47 -- # verify 00:03:06.416 12:17:00 -- setup/acl.sh@28 -- # local dev driver 00:03:06.416 12:17:00 -- setup/acl.sh@48 -- # setup reset 00:03:06.416 12:17:00 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:06.416 12:17:00 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:07.787 00:03:07.787 real 0m3.869s 00:03:07.787 user 0m1.045s 00:03:07.787 sys 0m1.702s 00:03:07.787 12:17:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:07.787 12:17:01 -- common/autotest_common.sh@10 -- # set +x 00:03:07.787 ************************************ 00:03:07.787 END TEST allowed 00:03:07.787 ************************************ 00:03:07.787 00:03:07.787 real 0m10.182s 00:03:07.787 user 0m3.127s 00:03:07.787 sys 0m5.116s 00:03:07.787 12:17:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:07.787 12:17:01 -- common/autotest_common.sh@10 -- # set +x 00:03:07.787 ************************************ 00:03:07.787 END TEST acl 00:03:07.787 ************************************ 00:03:07.787 12:17:01 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:07.787 12:17:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:07.787 12:17:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:07.787 12:17:01 -- common/autotest_common.sh@10 -- # set +x 00:03:07.787 ************************************ 00:03:07.787 START TEST hugepages 00:03:07.787 ************************************ 00:03:07.787 12:17:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:07.787 * Looking for test storage... 00:03:07.787 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:07.787 12:17:01 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:07.787 12:17:01 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:07.787 12:17:01 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:07.787 12:17:01 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:07.787 12:17:01 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:07.787 12:17:01 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:07.787 12:17:01 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:07.787 12:17:01 -- setup/common.sh@18 -- # local node= 00:03:07.787 12:17:01 -- setup/common.sh@19 -- # local var val 00:03:07.787 12:17:01 -- setup/common.sh@20 -- # local mem_f mem 00:03:07.787 12:17:01 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:07.787 12:17:01 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:07.787 12:17:01 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:07.787 12:17:01 -- setup/common.sh@28 -- # mapfile -t mem 00:03:07.787 12:17:01 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:07.787 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.787 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 44774880 kB' 'MemAvailable: 48230960 kB' 'Buffers: 2704 kB' 'Cached: 9325684 kB' 'SwapCached: 0 kB' 'Active: 6304192 kB' 'Inactive: 3481252 kB' 'Active(anon): 5918976 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 460244 kB' 'Mapped: 237720 kB' 'Shmem: 5461920 kB' 'KReclaimable: 166472 kB' 'Slab: 502112 kB' 'SReclaimable: 166472 kB' 'SUnreclaim: 335640 kB' 'KernelStack: 12816 kB' 'PageTables: 8452 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36562304 kB' 'Committed_AS: 7036404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195952 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.788 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.788 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # continue 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # IFS=': ' 00:03:07.789 12:17:01 -- setup/common.sh@31 -- # read -r var val _ 00:03:07.789 12:17:01 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:07.789 12:17:01 -- setup/common.sh@33 -- # echo 2048 00:03:07.789 12:17:01 -- setup/common.sh@33 -- # return 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:07.789 12:17:01 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:07.789 12:17:01 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:07.789 12:17:01 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:07.789 12:17:01 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:07.789 12:17:01 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:07.789 12:17:01 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:07.789 12:17:01 -- setup/hugepages.sh@207 -- # get_nodes 00:03:07.789 12:17:01 -- setup/hugepages.sh@27 -- # local node 00:03:07.789 12:17:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.789 12:17:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:07.789 12:17:01 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:07.789 12:17:01 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:07.789 12:17:01 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:07.789 12:17:01 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:07.789 12:17:01 -- setup/hugepages.sh@208 -- # clear_hp 00:03:07.789 12:17:01 -- setup/hugepages.sh@37 -- # local node hp 00:03:07.789 12:17:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:07.789 12:17:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.789 12:17:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.789 12:17:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:07.789 12:17:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.789 12:17:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:07.789 12:17:01 -- setup/hugepages.sh@41 -- # echo 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:07.789 12:17:01 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:07.789 12:17:01 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:07.789 12:17:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:07.789 12:17:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:07.789 12:17:01 -- common/autotest_common.sh@10 -- # set +x 00:03:07.789 ************************************ 00:03:07.789 START TEST default_setup 00:03:07.789 ************************************ 00:03:07.789 12:17:01 -- common/autotest_common.sh@1104 -- # default_setup 00:03:07.789 12:17:01 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:07.789 12:17:01 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:07.789 12:17:01 -- setup/hugepages.sh@51 -- # shift 00:03:07.789 12:17:01 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:07.789 12:17:01 -- setup/hugepages.sh@52 -- # local node_ids 00:03:07.789 12:17:01 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:07.789 12:17:01 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:07.789 12:17:01 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:07.789 12:17:01 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:07.789 12:17:01 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:07.789 12:17:01 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:07.789 12:17:01 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:07.789 12:17:01 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:07.789 12:17:01 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:07.789 12:17:01 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:07.789 12:17:01 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:07.789 12:17:01 -- setup/hugepages.sh@73 -- # return 0 00:03:07.789 12:17:01 -- setup/hugepages.sh@137 -- # setup output 00:03:07.789 12:17:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:07.789 12:17:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:09.161 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:09.161 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:09.161 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:10.091 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:10.091 12:17:04 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:10.091 12:17:04 -- setup/hugepages.sh@89 -- # local node 00:03:10.091 12:17:04 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:10.091 12:17:04 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:10.091 12:17:04 -- setup/hugepages.sh@92 -- # local surp 00:03:10.091 12:17:04 -- setup/hugepages.sh@93 -- # local resv 00:03:10.091 12:17:04 -- setup/hugepages.sh@94 -- # local anon 00:03:10.091 12:17:04 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:10.091 12:17:04 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:10.091 12:17:04 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:10.091 12:17:04 -- setup/common.sh@18 -- # local node= 00:03:10.091 12:17:04 -- setup/common.sh@19 -- # local var val 00:03:10.091 12:17:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.091 12:17:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.091 12:17:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.091 12:17:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.091 12:17:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.091 12:17:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46882204 kB' 'MemAvailable: 50338216 kB' 'Buffers: 2704 kB' 'Cached: 9325776 kB' 'SwapCached: 0 kB' 'Active: 6321968 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936752 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477508 kB' 'Mapped: 237756 kB' 'Shmem: 5462012 kB' 'KReclaimable: 166336 kB' 'Slab: 501476 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335140 kB' 'KernelStack: 12608 kB' 'PageTables: 8184 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195984 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.091 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.091 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.352 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.352 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:10.353 12:17:04 -- setup/common.sh@33 -- # echo 0 00:03:10.353 12:17:04 -- setup/common.sh@33 -- # return 0 00:03:10.353 12:17:04 -- setup/hugepages.sh@97 -- # anon=0 00:03:10.353 12:17:04 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:10.353 12:17:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.353 12:17:04 -- setup/common.sh@18 -- # local node= 00:03:10.353 12:17:04 -- setup/common.sh@19 -- # local var val 00:03:10.353 12:17:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.353 12:17:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.353 12:17:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.353 12:17:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.353 12:17:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.353 12:17:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46883948 kB' 'MemAvailable: 50339960 kB' 'Buffers: 2704 kB' 'Cached: 9325780 kB' 'SwapCached: 0 kB' 'Active: 6322568 kB' 'Inactive: 3481252 kB' 'Active(anon): 5937352 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478244 kB' 'Mapped: 237832 kB' 'Shmem: 5462016 kB' 'KReclaimable: 166336 kB' 'Slab: 501548 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335212 kB' 'KernelStack: 12624 kB' 'PageTables: 8240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195952 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.353 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.353 12:17:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.354 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.354 12:17:04 -- setup/common.sh@33 -- # echo 0 00:03:10.354 12:17:04 -- setup/common.sh@33 -- # return 0 00:03:10.354 12:17:04 -- setup/hugepages.sh@99 -- # surp=0 00:03:10.354 12:17:04 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:10.354 12:17:04 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:10.354 12:17:04 -- setup/common.sh@18 -- # local node= 00:03:10.354 12:17:04 -- setup/common.sh@19 -- # local var val 00:03:10.354 12:17:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.354 12:17:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.354 12:17:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.354 12:17:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.354 12:17:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.354 12:17:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.354 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46884000 kB' 'MemAvailable: 50340012 kB' 'Buffers: 2704 kB' 'Cached: 9325792 kB' 'SwapCached: 0 kB' 'Active: 6321368 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936152 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477436 kB' 'Mapped: 237740 kB' 'Shmem: 5462028 kB' 'KReclaimable: 166336 kB' 'Slab: 501500 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335164 kB' 'KernelStack: 12656 kB' 'PageTables: 8228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057256 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195968 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.355 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.355 12:17:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:10.356 12:17:04 -- setup/common.sh@33 -- # echo 0 00:03:10.356 12:17:04 -- setup/common.sh@33 -- # return 0 00:03:10.356 12:17:04 -- setup/hugepages.sh@100 -- # resv=0 00:03:10.356 12:17:04 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:10.356 nr_hugepages=1024 00:03:10.356 12:17:04 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:10.356 resv_hugepages=0 00:03:10.356 12:17:04 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:10.356 surplus_hugepages=0 00:03:10.356 12:17:04 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:10.356 anon_hugepages=0 00:03:10.356 12:17:04 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.356 12:17:04 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:10.356 12:17:04 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:10.356 12:17:04 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:10.356 12:17:04 -- setup/common.sh@18 -- # local node= 00:03:10.356 12:17:04 -- setup/common.sh@19 -- # local var val 00:03:10.356 12:17:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.356 12:17:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.356 12:17:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.356 12:17:04 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.356 12:17:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.356 12:17:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46884708 kB' 'MemAvailable: 50340720 kB' 'Buffers: 2704 kB' 'Cached: 9325804 kB' 'SwapCached: 0 kB' 'Active: 6321408 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936192 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477436 kB' 'Mapped: 237740 kB' 'Shmem: 5462040 kB' 'KReclaimable: 166336 kB' 'Slab: 501500 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335164 kB' 'KernelStack: 12656 kB' 'PageTables: 8228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057272 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195968 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.356 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.356 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:10.357 12:17:04 -- setup/common.sh@33 -- # echo 1024 00:03:10.357 12:17:04 -- setup/common.sh@33 -- # return 0 00:03:10.357 12:17:04 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:10.357 12:17:04 -- setup/hugepages.sh@112 -- # get_nodes 00:03:10.357 12:17:04 -- setup/hugepages.sh@27 -- # local node 00:03:10.357 12:17:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.357 12:17:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:10.357 12:17:04 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.357 12:17:04 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:10.357 12:17:04 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:10.357 12:17:04 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:10.357 12:17:04 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:10.357 12:17:04 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:10.357 12:17:04 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:10.357 12:17:04 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:10.357 12:17:04 -- setup/common.sh@18 -- # local node=0 00:03:10.357 12:17:04 -- setup/common.sh@19 -- # local var val 00:03:10.357 12:17:04 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.357 12:17:04 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.357 12:17:04 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:10.357 12:17:04 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:10.357 12:17:04 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.357 12:17:04 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.357 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.357 12:17:04 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 28148696 kB' 'MemUsed: 4681188 kB' 'SwapCached: 0 kB' 'Active: 1583764 kB' 'Inactive: 99820 kB' 'Active(anon): 1477764 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1459900 kB' 'Mapped: 49752 kB' 'AnonPages: 226876 kB' 'Shmem: 1254080 kB' 'KernelStack: 7096 kB' 'PageTables: 5100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73592 kB' 'Slab: 262512 kB' 'SReclaimable: 73592 kB' 'SUnreclaim: 188920 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # continue 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.358 12:17:04 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.358 12:17:04 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:10.358 12:17:04 -- setup/common.sh@33 -- # echo 0 00:03:10.358 12:17:04 -- setup/common.sh@33 -- # return 0 00:03:10.358 12:17:04 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:10.358 12:17:04 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:10.358 12:17:04 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:10.358 12:17:04 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:10.358 12:17:04 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:10.358 node0=1024 expecting 1024 00:03:10.358 12:17:04 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:10.358 00:03:10.358 real 0m2.448s 00:03:10.358 user 0m0.651s 00:03:10.358 sys 0m0.930s 00:03:10.358 12:17:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:10.358 12:17:04 -- common/autotest_common.sh@10 -- # set +x 00:03:10.358 ************************************ 00:03:10.358 END TEST default_setup 00:03:10.358 ************************************ 00:03:10.358 12:17:04 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:10.358 12:17:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:10.358 12:17:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:10.358 12:17:04 -- common/autotest_common.sh@10 -- # set +x 00:03:10.358 ************************************ 00:03:10.358 START TEST per_node_1G_alloc 00:03:10.358 ************************************ 00:03:10.358 12:17:04 -- common/autotest_common.sh@1104 -- # per_node_1G_alloc 00:03:10.358 12:17:04 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:10.358 12:17:04 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:10.358 12:17:04 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:10.358 12:17:04 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:10.358 12:17:04 -- setup/hugepages.sh@51 -- # shift 00:03:10.359 12:17:04 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:10.359 12:17:04 -- setup/hugepages.sh@52 -- # local node_ids 00:03:10.359 12:17:04 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.359 12:17:04 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:10.359 12:17:04 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:10.359 12:17:04 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:10.359 12:17:04 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.359 12:17:04 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:10.359 12:17:04 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.359 12:17:04 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.359 12:17:04 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.359 12:17:04 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:10.359 12:17:04 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.359 12:17:04 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.359 12:17:04 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.359 12:17:04 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:10.359 12:17:04 -- setup/hugepages.sh@73 -- # return 0 00:03:10.359 12:17:04 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:10.359 12:17:04 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:10.359 12:17:04 -- setup/hugepages.sh@146 -- # setup output 00:03:10.359 12:17:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.359 12:17:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:11.738 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:11.738 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:11.738 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:11.738 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:11.738 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:11.738 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:11.738 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:11.738 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:11.738 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:11.738 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:11.738 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:11.738 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:11.738 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:11.738 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:11.738 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:11.738 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:11.738 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:11.738 12:17:05 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:11.738 12:17:05 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:11.738 12:17:05 -- setup/hugepages.sh@89 -- # local node 00:03:11.738 12:17:05 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:11.739 12:17:05 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:11.739 12:17:05 -- setup/hugepages.sh@92 -- # local surp 00:03:11.739 12:17:05 -- setup/hugepages.sh@93 -- # local resv 00:03:11.739 12:17:05 -- setup/hugepages.sh@94 -- # local anon 00:03:11.739 12:17:05 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:11.739 12:17:05 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:11.739 12:17:05 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:11.739 12:17:05 -- setup/common.sh@18 -- # local node= 00:03:11.739 12:17:05 -- setup/common.sh@19 -- # local var val 00:03:11.739 12:17:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.739 12:17:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.739 12:17:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.739 12:17:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.739 12:17:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.739 12:17:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46866132 kB' 'MemAvailable: 50322144 kB' 'Buffers: 2704 kB' 'Cached: 9325852 kB' 'SwapCached: 0 kB' 'Active: 6321320 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936104 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477268 kB' 'Mapped: 237764 kB' 'Shmem: 5462088 kB' 'KReclaimable: 166336 kB' 'Slab: 501508 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335172 kB' 'KernelStack: 12640 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195904 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:11.739 12:17:05 -- setup/common.sh@33 -- # echo 0 00:03:11.739 12:17:05 -- setup/common.sh@33 -- # return 0 00:03:11.739 12:17:05 -- setup/hugepages.sh@97 -- # anon=0 00:03:11.739 12:17:05 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:11.739 12:17:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:11.739 12:17:05 -- setup/common.sh@18 -- # local node= 00:03:11.739 12:17:05 -- setup/common.sh@19 -- # local var val 00:03:11.739 12:17:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.739 12:17:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.739 12:17:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.739 12:17:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.739 12:17:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.739 12:17:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46866384 kB' 'MemAvailable: 50322396 kB' 'Buffers: 2704 kB' 'Cached: 9325852 kB' 'SwapCached: 0 kB' 'Active: 6322236 kB' 'Inactive: 3481252 kB' 'Active(anon): 5937020 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478160 kB' 'Mapped: 237844 kB' 'Shmem: 5462088 kB' 'KReclaimable: 166336 kB' 'Slab: 501556 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335220 kB' 'KernelStack: 12656 kB' 'PageTables: 8240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057316 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195872 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.739 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.739 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.740 12:17:05 -- setup/common.sh@33 -- # echo 0 00:03:11.740 12:17:05 -- setup/common.sh@33 -- # return 0 00:03:11.740 12:17:05 -- setup/hugepages.sh@99 -- # surp=0 00:03:11.740 12:17:05 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:11.740 12:17:05 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:11.740 12:17:05 -- setup/common.sh@18 -- # local node= 00:03:11.740 12:17:05 -- setup/common.sh@19 -- # local var val 00:03:11.740 12:17:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.740 12:17:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.740 12:17:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.740 12:17:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.740 12:17:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.740 12:17:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46866732 kB' 'MemAvailable: 50322744 kB' 'Buffers: 2704 kB' 'Cached: 9325852 kB' 'SwapCached: 0 kB' 'Active: 6321592 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936376 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477484 kB' 'Mapped: 237744 kB' 'Shmem: 5462088 kB' 'KReclaimable: 166336 kB' 'Slab: 501580 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335244 kB' 'KernelStack: 12656 kB' 'PageTables: 8168 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057328 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195872 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.740 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.740 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:11.741 12:17:05 -- setup/common.sh@33 -- # echo 0 00:03:11.741 12:17:05 -- setup/common.sh@33 -- # return 0 00:03:11.741 12:17:05 -- setup/hugepages.sh@100 -- # resv=0 00:03:11.741 12:17:05 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:11.741 nr_hugepages=1024 00:03:11.741 12:17:05 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:11.741 resv_hugepages=0 00:03:11.741 12:17:05 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:11.741 surplus_hugepages=0 00:03:11.741 12:17:05 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:11.741 anon_hugepages=0 00:03:11.741 12:17:05 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:11.741 12:17:05 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:11.741 12:17:05 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:11.741 12:17:05 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:11.741 12:17:05 -- setup/common.sh@18 -- # local node= 00:03:11.741 12:17:05 -- setup/common.sh@19 -- # local var val 00:03:11.741 12:17:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.741 12:17:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.741 12:17:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:11.741 12:17:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:11.741 12:17:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.741 12:17:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46867000 kB' 'MemAvailable: 50323012 kB' 'Buffers: 2704 kB' 'Cached: 9325880 kB' 'SwapCached: 0 kB' 'Active: 6321628 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936412 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477516 kB' 'Mapped: 237744 kB' 'Shmem: 5462116 kB' 'KReclaimable: 166336 kB' 'Slab: 501572 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335236 kB' 'KernelStack: 12672 kB' 'PageTables: 8228 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057344 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195872 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.741 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.741 12:17:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.742 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.742 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:11.743 12:17:05 -- setup/common.sh@33 -- # echo 1024 00:03:11.743 12:17:05 -- setup/common.sh@33 -- # return 0 00:03:11.743 12:17:05 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:11.743 12:17:05 -- setup/hugepages.sh@112 -- # get_nodes 00:03:11.743 12:17:05 -- setup/hugepages.sh@27 -- # local node 00:03:11.743 12:17:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:11.743 12:17:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:11.743 12:17:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:11.743 12:17:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:11.743 12:17:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:11.743 12:17:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:11.743 12:17:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:11.743 12:17:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:11.743 12:17:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:11.743 12:17:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:11.743 12:17:05 -- setup/common.sh@18 -- # local node=0 00:03:11.743 12:17:05 -- setup/common.sh@19 -- # local var val 00:03:11.743 12:17:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.743 12:17:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.743 12:17:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:11.743 12:17:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:11.743 12:17:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.743 12:17:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 29188788 kB' 'MemUsed: 3641096 kB' 'SwapCached: 0 kB' 'Active: 1584216 kB' 'Inactive: 99820 kB' 'Active(anon): 1478216 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1459972 kB' 'Mapped: 49752 kB' 'AnonPages: 227276 kB' 'Shmem: 1254152 kB' 'KernelStack: 7128 kB' 'PageTables: 5188 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73592 kB' 'Slab: 262564 kB' 'SReclaimable: 73592 kB' 'SUnreclaim: 188972 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@33 -- # echo 0 00:03:11.743 12:17:05 -- setup/common.sh@33 -- # return 0 00:03:11.743 12:17:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:11.743 12:17:05 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:11.743 12:17:05 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:11.743 12:17:05 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:11.743 12:17:05 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:11.743 12:17:05 -- setup/common.sh@18 -- # local node=1 00:03:11.743 12:17:05 -- setup/common.sh@19 -- # local var val 00:03:11.743 12:17:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:11.743 12:17:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:11.743 12:17:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:11.743 12:17:05 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:11.743 12:17:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:11.743 12:17:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.743 12:17:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 17678568 kB' 'MemUsed: 10033256 kB' 'SwapCached: 0 kB' 'Active: 4737228 kB' 'Inactive: 3381432 kB' 'Active(anon): 4458012 kB' 'Inactive(anon): 0 kB' 'Active(file): 279216 kB' 'Inactive(file): 3381432 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7868628 kB' 'Mapped: 187992 kB' 'AnonPages: 250032 kB' 'Shmem: 4207980 kB' 'KernelStack: 5528 kB' 'PageTables: 2976 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92744 kB' 'Slab: 239008 kB' 'SReclaimable: 92744 kB' 'SUnreclaim: 146264 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:11.743 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.743 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # continue 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:11.744 12:17:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:11.744 12:17:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:11.744 12:17:05 -- setup/common.sh@33 -- # echo 0 00:03:11.744 12:17:05 -- setup/common.sh@33 -- # return 0 00:03:11.744 12:17:05 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:11.744 12:17:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:11.744 12:17:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:11.744 12:17:05 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:11.744 node0=512 expecting 512 00:03:11.744 12:17:05 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:11.744 12:17:05 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:11.744 12:17:05 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:11.744 12:17:05 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:11.744 node1=512 expecting 512 00:03:11.744 12:17:05 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:11.744 00:03:11.744 real 0m1.419s 00:03:11.744 user 0m0.613s 00:03:11.744 sys 0m0.767s 00:03:11.744 12:17:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:11.744 12:17:05 -- common/autotest_common.sh@10 -- # set +x 00:03:11.744 ************************************ 00:03:11.744 END TEST per_node_1G_alloc 00:03:11.744 ************************************ 00:03:11.744 12:17:05 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:11.744 12:17:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:11.744 12:17:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:11.744 12:17:05 -- common/autotest_common.sh@10 -- # set +x 00:03:11.744 ************************************ 00:03:11.744 START TEST even_2G_alloc 00:03:11.744 ************************************ 00:03:11.744 12:17:05 -- common/autotest_common.sh@1104 -- # even_2G_alloc 00:03:11.744 12:17:05 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:11.744 12:17:05 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:11.744 12:17:05 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:11.744 12:17:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:11.744 12:17:05 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:11.744 12:17:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:11.744 12:17:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:11.744 12:17:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:11.744 12:17:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:11.744 12:17:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:11.744 12:17:05 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:11.744 12:17:05 -- setup/hugepages.sh@83 -- # : 512 00:03:11.744 12:17:05 -- setup/hugepages.sh@84 -- # : 1 00:03:11.744 12:17:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:11.744 12:17:05 -- setup/hugepages.sh@83 -- # : 0 00:03:11.744 12:17:05 -- setup/hugepages.sh@84 -- # : 0 00:03:11.744 12:17:05 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:11.744 12:17:05 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:11.744 12:17:05 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:11.744 12:17:05 -- setup/hugepages.sh@153 -- # setup output 00:03:11.744 12:17:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:11.744 12:17:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:13.118 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:13.119 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:13.119 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:13.119 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:13.119 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:13.119 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:13.119 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:13.119 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:13.119 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:13.119 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:13.119 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:13.119 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:13.119 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:13.119 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:13.119 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:13.119 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:13.119 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:13.119 12:17:06 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:13.119 12:17:06 -- setup/hugepages.sh@89 -- # local node 00:03:13.119 12:17:06 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:13.119 12:17:06 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:13.119 12:17:06 -- setup/hugepages.sh@92 -- # local surp 00:03:13.119 12:17:06 -- setup/hugepages.sh@93 -- # local resv 00:03:13.119 12:17:06 -- setup/hugepages.sh@94 -- # local anon 00:03:13.119 12:17:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:13.119 12:17:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:13.119 12:17:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:13.119 12:17:07 -- setup/common.sh@18 -- # local node= 00:03:13.119 12:17:07 -- setup/common.sh@19 -- # local var val 00:03:13.119 12:17:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.119 12:17:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.119 12:17:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.119 12:17:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.119 12:17:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.119 12:17:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46862988 kB' 'MemAvailable: 50319000 kB' 'Buffers: 2704 kB' 'Cached: 9325944 kB' 'SwapCached: 0 kB' 'Active: 6323728 kB' 'Inactive: 3481252 kB' 'Active(anon): 5938512 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479048 kB' 'Mapped: 238680 kB' 'Shmem: 5462180 kB' 'KReclaimable: 166336 kB' 'Slab: 501436 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335100 kB' 'KernelStack: 12656 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7059408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195968 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.119 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.119 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:13.120 12:17:07 -- setup/common.sh@33 -- # echo 0 00:03:13.120 12:17:07 -- setup/common.sh@33 -- # return 0 00:03:13.120 12:17:07 -- setup/hugepages.sh@97 -- # anon=0 00:03:13.120 12:17:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:13.120 12:17:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.120 12:17:07 -- setup/common.sh@18 -- # local node= 00:03:13.120 12:17:07 -- setup/common.sh@19 -- # local var val 00:03:13.120 12:17:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.120 12:17:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.120 12:17:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.120 12:17:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.120 12:17:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.120 12:17:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46874596 kB' 'MemAvailable: 50330608 kB' 'Buffers: 2704 kB' 'Cached: 9325948 kB' 'SwapCached: 0 kB' 'Active: 6327612 kB' 'Inactive: 3481252 kB' 'Active(anon): 5942396 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482940 kB' 'Mapped: 238260 kB' 'Shmem: 5462184 kB' 'KReclaimable: 166336 kB' 'Slab: 501428 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335092 kB' 'KernelStack: 12672 kB' 'PageTables: 8232 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7062092 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195936 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.120 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.120 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.381 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.381 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.382 12:17:07 -- setup/common.sh@33 -- # echo 0 00:03:13.382 12:17:07 -- setup/common.sh@33 -- # return 0 00:03:13.382 12:17:07 -- setup/hugepages.sh@99 -- # surp=0 00:03:13.382 12:17:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:13.382 12:17:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:13.382 12:17:07 -- setup/common.sh@18 -- # local node= 00:03:13.382 12:17:07 -- setup/common.sh@19 -- # local var val 00:03:13.382 12:17:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.382 12:17:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.382 12:17:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.382 12:17:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.382 12:17:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.382 12:17:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46875588 kB' 'MemAvailable: 50331600 kB' 'Buffers: 2704 kB' 'Cached: 9325956 kB' 'SwapCached: 0 kB' 'Active: 6328140 kB' 'Inactive: 3481252 kB' 'Active(anon): 5942924 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483472 kB' 'Mapped: 238584 kB' 'Shmem: 5462192 kB' 'KReclaimable: 166336 kB' 'Slab: 501452 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335116 kB' 'KernelStack: 12640 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7063308 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195908 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.382 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.382 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.383 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:13.383 12:17:07 -- setup/common.sh@33 -- # echo 0 00:03:13.383 12:17:07 -- setup/common.sh@33 -- # return 0 00:03:13.383 12:17:07 -- setup/hugepages.sh@100 -- # resv=0 00:03:13.383 12:17:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:13.383 nr_hugepages=1024 00:03:13.383 12:17:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:13.383 resv_hugepages=0 00:03:13.383 12:17:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:13.383 surplus_hugepages=0 00:03:13.383 12:17:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:13.383 anon_hugepages=0 00:03:13.383 12:17:07 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.383 12:17:07 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:13.383 12:17:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:13.383 12:17:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:13.383 12:17:07 -- setup/common.sh@18 -- # local node= 00:03:13.383 12:17:07 -- setup/common.sh@19 -- # local var val 00:03:13.383 12:17:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.383 12:17:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.383 12:17:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:13.383 12:17:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:13.383 12:17:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.383 12:17:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.383 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46880568 kB' 'MemAvailable: 50336580 kB' 'Buffers: 2704 kB' 'Cached: 9325976 kB' 'SwapCached: 0 kB' 'Active: 6322508 kB' 'Inactive: 3481252 kB' 'Active(anon): 5937292 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477824 kB' 'Mapped: 238164 kB' 'Shmem: 5462212 kB' 'KReclaimable: 166336 kB' 'Slab: 501452 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335116 kB' 'KernelStack: 12640 kB' 'PageTables: 8172 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7057336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195920 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.384 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.384 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:13.385 12:17:07 -- setup/common.sh@33 -- # echo 1024 00:03:13.385 12:17:07 -- setup/common.sh@33 -- # return 0 00:03:13.385 12:17:07 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:13.385 12:17:07 -- setup/hugepages.sh@112 -- # get_nodes 00:03:13.385 12:17:07 -- setup/hugepages.sh@27 -- # local node 00:03:13.385 12:17:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.385 12:17:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:13.385 12:17:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:13.385 12:17:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:13.385 12:17:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:13.385 12:17:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:13.385 12:17:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.385 12:17:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.385 12:17:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:13.385 12:17:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.385 12:17:07 -- setup/common.sh@18 -- # local node=0 00:03:13.385 12:17:07 -- setup/common.sh@19 -- # local var val 00:03:13.385 12:17:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.385 12:17:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.385 12:17:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:13.385 12:17:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:13.385 12:17:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.385 12:17:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 29194428 kB' 'MemUsed: 3635456 kB' 'SwapCached: 0 kB' 'Active: 1584436 kB' 'Inactive: 99820 kB' 'Active(anon): 1478436 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1460036 kB' 'Mapped: 49752 kB' 'AnonPages: 227340 kB' 'Shmem: 1254216 kB' 'KernelStack: 7144 kB' 'PageTables: 5128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73592 kB' 'Slab: 262536 kB' 'SReclaimable: 73592 kB' 'SUnreclaim: 188944 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.385 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.385 12:17:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@33 -- # echo 0 00:03:13.386 12:17:07 -- setup/common.sh@33 -- # return 0 00:03:13.386 12:17:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.386 12:17:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:13.386 12:17:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:13.386 12:17:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:13.386 12:17:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:13.386 12:17:07 -- setup/common.sh@18 -- # local node=1 00:03:13.386 12:17:07 -- setup/common.sh@19 -- # local var val 00:03:13.386 12:17:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:13.386 12:17:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:13.386 12:17:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:13.386 12:17:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:13.386 12:17:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:13.386 12:17:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 17685952 kB' 'MemUsed: 10025872 kB' 'SwapCached: 0 kB' 'Active: 4737472 kB' 'Inactive: 3381432 kB' 'Active(anon): 4458256 kB' 'Inactive(anon): 0 kB' 'Active(file): 279216 kB' 'Inactive(file): 3381432 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7868664 kB' 'Mapped: 188000 kB' 'AnonPages: 250344 kB' 'Shmem: 4208016 kB' 'KernelStack: 5528 kB' 'PageTables: 3072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92744 kB' 'Slab: 238916 kB' 'SReclaimable: 92744 kB' 'SUnreclaim: 146172 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.386 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.386 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # continue 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:13.387 12:17:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:13.387 12:17:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:13.387 12:17:07 -- setup/common.sh@33 -- # echo 0 00:03:13.387 12:17:07 -- setup/common.sh@33 -- # return 0 00:03:13.387 12:17:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.387 12:17:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.387 12:17:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.387 12:17:07 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:13.387 node0=512 expecting 512 00:03:13.387 12:17:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:13.387 12:17:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:13.387 12:17:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:13.387 12:17:07 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:13.387 node1=512 expecting 512 00:03:13.387 12:17:07 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:13.387 00:03:13.387 real 0m1.552s 00:03:13.387 user 0m0.650s 00:03:13.387 sys 0m0.868s 00:03:13.387 12:17:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:13.387 12:17:07 -- common/autotest_common.sh@10 -- # set +x 00:03:13.387 ************************************ 00:03:13.387 END TEST even_2G_alloc 00:03:13.387 ************************************ 00:03:13.387 12:17:07 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:13.387 12:17:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:13.387 12:17:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:13.387 12:17:07 -- common/autotest_common.sh@10 -- # set +x 00:03:13.387 ************************************ 00:03:13.387 START TEST odd_alloc 00:03:13.387 ************************************ 00:03:13.387 12:17:07 -- common/autotest_common.sh@1104 -- # odd_alloc 00:03:13.387 12:17:07 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:13.387 12:17:07 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:13.387 12:17:07 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:13.387 12:17:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:13.387 12:17:07 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:13.387 12:17:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:13.387 12:17:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:13.387 12:17:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:13.387 12:17:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:13.387 12:17:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:13.387 12:17:07 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:13.387 12:17:07 -- setup/hugepages.sh@83 -- # : 513 00:03:13.387 12:17:07 -- setup/hugepages.sh@84 -- # : 1 00:03:13.387 12:17:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:13.387 12:17:07 -- setup/hugepages.sh@83 -- # : 0 00:03:13.387 12:17:07 -- setup/hugepages.sh@84 -- # : 0 00:03:13.387 12:17:07 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:13.387 12:17:07 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:13.387 12:17:07 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:13.387 12:17:07 -- setup/hugepages.sh@160 -- # setup output 00:03:13.387 12:17:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:13.387 12:17:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.765 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.765 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:14.765 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.765 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.765 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.765 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.765 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.765 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.765 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.765 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:14.765 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:14.765 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:14.765 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:14.765 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:14.765 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:14.765 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:14.765 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:14.765 12:17:08 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:14.765 12:17:08 -- setup/hugepages.sh@89 -- # local node 00:03:14.765 12:17:08 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.765 12:17:08 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.765 12:17:08 -- setup/hugepages.sh@92 -- # local surp 00:03:14.765 12:17:08 -- setup/hugepages.sh@93 -- # local resv 00:03:14.765 12:17:08 -- setup/hugepages.sh@94 -- # local anon 00:03:14.765 12:17:08 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.765 12:17:08 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.765 12:17:08 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.765 12:17:08 -- setup/common.sh@18 -- # local node= 00:03:14.765 12:17:08 -- setup/common.sh@19 -- # local var val 00:03:14.765 12:17:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.765 12:17:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.765 12:17:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.765 12:17:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.765 12:17:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.765 12:17:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46867120 kB' 'MemAvailable: 50323132 kB' 'Buffers: 2704 kB' 'Cached: 9326040 kB' 'SwapCached: 0 kB' 'Active: 6320512 kB' 'Inactive: 3481252 kB' 'Active(anon): 5935296 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 476128 kB' 'Mapped: 236920 kB' 'Shmem: 5462276 kB' 'KReclaimable: 166336 kB' 'Slab: 501380 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335044 kB' 'KernelStack: 12896 kB' 'PageTables: 8668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 7047692 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196144 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.765 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.765 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.766 12:17:08 -- setup/common.sh@33 -- # echo 0 00:03:14.766 12:17:08 -- setup/common.sh@33 -- # return 0 00:03:14.766 12:17:08 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.766 12:17:08 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.766 12:17:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.766 12:17:08 -- setup/common.sh@18 -- # local node= 00:03:14.766 12:17:08 -- setup/common.sh@19 -- # local var val 00:03:14.766 12:17:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.766 12:17:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.766 12:17:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.766 12:17:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.766 12:17:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.766 12:17:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46868712 kB' 'MemAvailable: 50324724 kB' 'Buffers: 2704 kB' 'Cached: 9326048 kB' 'SwapCached: 0 kB' 'Active: 6319992 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934776 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475568 kB' 'Mapped: 236996 kB' 'Shmem: 5462284 kB' 'KReclaimable: 166336 kB' 'Slab: 501460 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335124 kB' 'KernelStack: 13072 kB' 'PageTables: 8932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 7047708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196192 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.766 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.766 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.767 12:17:08 -- setup/common.sh@33 -- # echo 0 00:03:14.767 12:17:08 -- setup/common.sh@33 -- # return 0 00:03:14.767 12:17:08 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.767 12:17:08 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.767 12:17:08 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.767 12:17:08 -- setup/common.sh@18 -- # local node= 00:03:14.767 12:17:08 -- setup/common.sh@19 -- # local var val 00:03:14.767 12:17:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.767 12:17:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.767 12:17:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.767 12:17:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.767 12:17:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.767 12:17:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46870072 kB' 'MemAvailable: 50326084 kB' 'Buffers: 2704 kB' 'Cached: 9326060 kB' 'SwapCached: 0 kB' 'Active: 6319584 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934368 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475152 kB' 'Mapped: 236880 kB' 'Shmem: 5462296 kB' 'KReclaimable: 166336 kB' 'Slab: 501420 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335084 kB' 'KernelStack: 12976 kB' 'PageTables: 8700 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 7043704 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195984 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.767 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.767 12:17:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.768 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.768 12:17:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.769 12:17:08 -- setup/common.sh@33 -- # echo 0 00:03:14.769 12:17:08 -- setup/common.sh@33 -- # return 0 00:03:14.769 12:17:08 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.769 12:17:08 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:14.769 nr_hugepages=1025 00:03:14.769 12:17:08 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.769 resv_hugepages=0 00:03:14.769 12:17:08 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.769 surplus_hugepages=0 00:03:14.769 12:17:08 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.769 anon_hugepages=0 00:03:14.769 12:17:08 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:14.769 12:17:08 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:14.769 12:17:08 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.769 12:17:08 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.769 12:17:08 -- setup/common.sh@18 -- # local node= 00:03:14.769 12:17:08 -- setup/common.sh@19 -- # local var val 00:03:14.769 12:17:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.769 12:17:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.769 12:17:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.769 12:17:08 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.769 12:17:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.769 12:17:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46870072 kB' 'MemAvailable: 50326084 kB' 'Buffers: 2704 kB' 'Cached: 9326060 kB' 'SwapCached: 0 kB' 'Active: 6318552 kB' 'Inactive: 3481252 kB' 'Active(anon): 5933336 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474132 kB' 'Mapped: 236888 kB' 'Shmem: 5462296 kB' 'KReclaimable: 166336 kB' 'Slab: 501420 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335084 kB' 'KernelStack: 12608 kB' 'PageTables: 7572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37609856 kB' 'Committed_AS: 7043716 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195984 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.769 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.769 12:17:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.770 12:17:08 -- setup/common.sh@33 -- # echo 1025 00:03:14.770 12:17:08 -- setup/common.sh@33 -- # return 0 00:03:14.770 12:17:08 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:14.770 12:17:08 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.770 12:17:08 -- setup/hugepages.sh@27 -- # local node 00:03:14.770 12:17:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.770 12:17:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.770 12:17:08 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.770 12:17:08 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:14.770 12:17:08 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.770 12:17:08 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.770 12:17:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.770 12:17:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.770 12:17:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.770 12:17:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.770 12:17:08 -- setup/common.sh@18 -- # local node=0 00:03:14.770 12:17:08 -- setup/common.sh@19 -- # local var val 00:03:14.770 12:17:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.770 12:17:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.770 12:17:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.770 12:17:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.770 12:17:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.770 12:17:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 29190712 kB' 'MemUsed: 3639172 kB' 'SwapCached: 0 kB' 'Active: 1582868 kB' 'Inactive: 99820 kB' 'Active(anon): 1476868 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1460096 kB' 'Mapped: 49024 kB' 'AnonPages: 225664 kB' 'Shmem: 1254276 kB' 'KernelStack: 7000 kB' 'PageTables: 4488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73592 kB' 'Slab: 262436 kB' 'SReclaimable: 73592 kB' 'SUnreclaim: 188844 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.770 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.770 12:17:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@33 -- # echo 0 00:03:14.771 12:17:08 -- setup/common.sh@33 -- # return 0 00:03:14.771 12:17:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.771 12:17:08 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.771 12:17:08 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.771 12:17:08 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:14.771 12:17:08 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.771 12:17:08 -- setup/common.sh@18 -- # local node=1 00:03:14.771 12:17:08 -- setup/common.sh@19 -- # local var val 00:03:14.771 12:17:08 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.771 12:17:08 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.771 12:17:08 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:14.771 12:17:08 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:14.771 12:17:08 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.771 12:17:08 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 17679108 kB' 'MemUsed: 10032716 kB' 'SwapCached: 0 kB' 'Active: 4735640 kB' 'Inactive: 3381432 kB' 'Active(anon): 4456424 kB' 'Inactive(anon): 0 kB' 'Active(file): 279216 kB' 'Inactive(file): 3381432 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7868668 kB' 'Mapped: 187864 kB' 'AnonPages: 248448 kB' 'Shmem: 4208020 kB' 'KernelStack: 5528 kB' 'PageTables: 2908 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92744 kB' 'Slab: 239052 kB' 'SReclaimable: 92744 kB' 'SUnreclaim: 146308 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.771 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.771 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # continue 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.772 12:17:08 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.772 12:17:08 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.772 12:17:08 -- setup/common.sh@33 -- # echo 0 00:03:14.772 12:17:08 -- setup/common.sh@33 -- # return 0 00:03:14.772 12:17:08 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.772 12:17:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.772 12:17:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.772 12:17:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.772 12:17:08 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:14.772 node0=512 expecting 513 00:03:14.772 12:17:08 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:14.772 12:17:08 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:14.772 12:17:08 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:14.772 12:17:08 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:14.772 node1=513 expecting 512 00:03:14.772 12:17:08 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:14.772 00:03:14.772 real 0m1.414s 00:03:14.772 user 0m0.563s 00:03:14.772 sys 0m0.814s 00:03:14.772 12:17:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:14.772 12:17:08 -- common/autotest_common.sh@10 -- # set +x 00:03:14.772 ************************************ 00:03:14.772 END TEST odd_alloc 00:03:14.772 ************************************ 00:03:14.772 12:17:08 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:14.772 12:17:08 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:14.772 12:17:08 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:14.772 12:17:08 -- common/autotest_common.sh@10 -- # set +x 00:03:14.772 ************************************ 00:03:14.772 START TEST custom_alloc 00:03:14.772 ************************************ 00:03:14.772 12:17:08 -- common/autotest_common.sh@1104 -- # custom_alloc 00:03:14.772 12:17:08 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:14.772 12:17:08 -- setup/hugepages.sh@169 -- # local node 00:03:14.772 12:17:08 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:14.772 12:17:08 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:14.772 12:17:08 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:14.772 12:17:08 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:14.772 12:17:08 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:14.772 12:17:08 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:14.772 12:17:08 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.772 12:17:08 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:14.772 12:17:08 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:14.772 12:17:08 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.772 12:17:08 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.772 12:17:08 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:14.772 12:17:08 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.772 12:17:08 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.772 12:17:08 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.772 12:17:08 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:14.772 12:17:08 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:14.772 12:17:08 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:14.773 12:17:08 -- setup/hugepages.sh@83 -- # : 256 00:03:14.773 12:17:08 -- setup/hugepages.sh@84 -- # : 1 00:03:14.773 12:17:08 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:14.773 12:17:08 -- setup/hugepages.sh@83 -- # : 0 00:03:14.773 12:17:08 -- setup/hugepages.sh@84 -- # : 0 00:03:14.773 12:17:08 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:14.773 12:17:08 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:14.773 12:17:08 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:14.773 12:17:08 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:14.773 12:17:08 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:14.773 12:17:08 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.773 12:17:08 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.773 12:17:08 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.773 12:17:08 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.773 12:17:08 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.773 12:17:08 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.773 12:17:08 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:14.773 12:17:08 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:14.773 12:17:08 -- setup/hugepages.sh@78 -- # return 0 00:03:14.773 12:17:08 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:14.773 12:17:08 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:14.773 12:17:08 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:14.773 12:17:08 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:14.773 12:17:08 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:14.773 12:17:08 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:14.773 12:17:08 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:14.773 12:17:08 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:14.773 12:17:08 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:14.773 12:17:08 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:14.773 12:17:08 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:14.773 12:17:08 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:14.773 12:17:08 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:14.773 12:17:08 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:14.773 12:17:08 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:14.773 12:17:08 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:14.773 12:17:08 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:14.773 12:17:08 -- setup/hugepages.sh@78 -- # return 0 00:03:14.773 12:17:08 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:14.773 12:17:08 -- setup/hugepages.sh@187 -- # setup output 00:03:14.773 12:17:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:14.773 12:17:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.151 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.151 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:16.151 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.151 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.151 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.151 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.151 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.151 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.151 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.151 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:16.151 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:16.151 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:16.151 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:16.151 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:16.151 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:16.151 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:16.151 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:16.151 12:17:09 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:16.151 12:17:09 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:16.151 12:17:09 -- setup/hugepages.sh@89 -- # local node 00:03:16.151 12:17:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.151 12:17:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.151 12:17:09 -- setup/hugepages.sh@92 -- # local surp 00:03:16.151 12:17:09 -- setup/hugepages.sh@93 -- # local resv 00:03:16.151 12:17:09 -- setup/hugepages.sh@94 -- # local anon 00:03:16.151 12:17:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.151 12:17:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.151 12:17:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.151 12:17:09 -- setup/common.sh@18 -- # local node= 00:03:16.151 12:17:09 -- setup/common.sh@19 -- # local var val 00:03:16.151 12:17:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.151 12:17:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.151 12:17:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.151 12:17:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.151 12:17:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.151 12:17:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 45809048 kB' 'MemAvailable: 49265060 kB' 'Buffers: 2704 kB' 'Cached: 9326136 kB' 'SwapCached: 0 kB' 'Active: 6319352 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934136 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474508 kB' 'Mapped: 236916 kB' 'Shmem: 5462372 kB' 'KReclaimable: 166336 kB' 'Slab: 501640 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335304 kB' 'KernelStack: 12608 kB' 'PageTables: 7800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 7043896 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195936 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.151 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.151 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.152 12:17:09 -- setup/common.sh@33 -- # echo 0 00:03:16.152 12:17:09 -- setup/common.sh@33 -- # return 0 00:03:16.152 12:17:09 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.152 12:17:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.152 12:17:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.152 12:17:09 -- setup/common.sh@18 -- # local node= 00:03:16.152 12:17:09 -- setup/common.sh@19 -- # local var val 00:03:16.152 12:17:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.152 12:17:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.152 12:17:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.152 12:17:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.152 12:17:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.152 12:17:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 45827776 kB' 'MemAvailable: 49283788 kB' 'Buffers: 2704 kB' 'Cached: 9326140 kB' 'SwapCached: 0 kB' 'Active: 6319648 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934432 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474852 kB' 'Mapped: 236916 kB' 'Shmem: 5462376 kB' 'KReclaimable: 166336 kB' 'Slab: 501620 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335284 kB' 'KernelStack: 12592 kB' 'PageTables: 7740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 7043908 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195920 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.152 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.152 12:17:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.153 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.153 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.153 12:17:10 -- setup/common.sh@33 -- # echo 0 00:03:16.153 12:17:10 -- setup/common.sh@33 -- # return 0 00:03:16.153 12:17:10 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.154 12:17:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.154 12:17:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.154 12:17:10 -- setup/common.sh@18 -- # local node= 00:03:16.154 12:17:10 -- setup/common.sh@19 -- # local var val 00:03:16.154 12:17:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.154 12:17:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.154 12:17:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.154 12:17:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.154 12:17:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.154 12:17:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 45827536 kB' 'MemAvailable: 49283548 kB' 'Buffers: 2704 kB' 'Cached: 9326144 kB' 'SwapCached: 0 kB' 'Active: 6318956 kB' 'Inactive: 3481252 kB' 'Active(anon): 5933740 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474116 kB' 'Mapped: 236892 kB' 'Shmem: 5462380 kB' 'KReclaimable: 166336 kB' 'Slab: 501620 kB' 'SReclaimable: 166336 kB' 'SUnreclaim: 335284 kB' 'KernelStack: 12608 kB' 'PageTables: 7768 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 7043924 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195920 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.154 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.154 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.155 12:17:10 -- setup/common.sh@33 -- # echo 0 00:03:16.155 12:17:10 -- setup/common.sh@33 -- # return 0 00:03:16.155 12:17:10 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.155 12:17:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:16.155 nr_hugepages=1536 00:03:16.155 12:17:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.155 resv_hugepages=0 00:03:16.155 12:17:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.155 surplus_hugepages=0 00:03:16.155 12:17:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.155 anon_hugepages=0 00:03:16.155 12:17:10 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:16.155 12:17:10 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:16.155 12:17:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.155 12:17:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.155 12:17:10 -- setup/common.sh@18 -- # local node= 00:03:16.155 12:17:10 -- setup/common.sh@19 -- # local var val 00:03:16.155 12:17:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.155 12:17:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.155 12:17:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.155 12:17:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.155 12:17:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.155 12:17:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 45830760 kB' 'MemAvailable: 49286788 kB' 'Buffers: 2704 kB' 'Cached: 9326164 kB' 'SwapCached: 0 kB' 'Active: 6318800 kB' 'Inactive: 3481252 kB' 'Active(anon): 5933584 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474508 kB' 'Mapped: 236892 kB' 'Shmem: 5462400 kB' 'KReclaimable: 166368 kB' 'Slab: 501684 kB' 'SReclaimable: 166368 kB' 'SUnreclaim: 335316 kB' 'KernelStack: 12576 kB' 'PageTables: 7660 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37086592 kB' 'Committed_AS: 7043936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195904 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.155 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.155 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.156 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.156 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.156 12:17:10 -- setup/common.sh@33 -- # echo 1536 00:03:16.156 12:17:10 -- setup/common.sh@33 -- # return 0 00:03:16.156 12:17:10 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:16.156 12:17:10 -- setup/hugepages.sh@112 -- # get_nodes 00:03:16.156 12:17:10 -- setup/hugepages.sh@27 -- # local node 00:03:16.156 12:17:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.156 12:17:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:16.156 12:17:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:16.156 12:17:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:16.156 12:17:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:16.156 12:17:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:16.156 12:17:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.156 12:17:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.156 12:17:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:16.472 12:17:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.472 12:17:10 -- setup/common.sh@18 -- # local node=0 00:03:16.472 12:17:10 -- setup/common.sh@19 -- # local var val 00:03:16.472 12:17:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.472 12:17:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.472 12:17:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:16.472 12:17:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:16.472 12:17:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.472 12:17:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 29176516 kB' 'MemUsed: 3653368 kB' 'SwapCached: 0 kB' 'Active: 1582924 kB' 'Inactive: 99820 kB' 'Active(anon): 1476924 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1460200 kB' 'Mapped: 49024 kB' 'AnonPages: 225772 kB' 'Shmem: 1254380 kB' 'KernelStack: 7048 kB' 'PageTables: 4876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73624 kB' 'Slab: 262528 kB' 'SReclaimable: 73624 kB' 'SUnreclaim: 188904 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.472 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.472 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@33 -- # echo 0 00:03:16.473 12:17:10 -- setup/common.sh@33 -- # return 0 00:03:16.473 12:17:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.473 12:17:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:16.473 12:17:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:16.473 12:17:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:16.473 12:17:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.473 12:17:10 -- setup/common.sh@18 -- # local node=1 00:03:16.473 12:17:10 -- setup/common.sh@19 -- # local var val 00:03:16.473 12:17:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.473 12:17:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.473 12:17:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:16.473 12:17:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:16.473 12:17:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.473 12:17:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27711824 kB' 'MemFree: 16653796 kB' 'MemUsed: 11058028 kB' 'SwapCached: 0 kB' 'Active: 4736176 kB' 'Inactive: 3381432 kB' 'Active(anon): 4456960 kB' 'Inactive(anon): 0 kB' 'Active(file): 279216 kB' 'Inactive(file): 3381432 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7868684 kB' 'Mapped: 187868 kB' 'AnonPages: 249088 kB' 'Shmem: 4208036 kB' 'KernelStack: 5592 kB' 'PageTables: 3028 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92744 kB' 'Slab: 239156 kB' 'SReclaimable: 92744 kB' 'SUnreclaim: 146412 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.473 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.473 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # continue 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.474 12:17:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.474 12:17:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.474 12:17:10 -- setup/common.sh@33 -- # echo 0 00:03:16.474 12:17:10 -- setup/common.sh@33 -- # return 0 00:03:16.474 12:17:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:16.474 12:17:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.474 12:17:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.474 12:17:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.474 12:17:10 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:16.474 node0=512 expecting 512 00:03:16.474 12:17:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:16.474 12:17:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:16.474 12:17:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:16.474 12:17:10 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:16.474 node1=1024 expecting 1024 00:03:16.474 12:17:10 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:16.474 00:03:16.474 real 0m1.489s 00:03:16.474 user 0m0.618s 00:03:16.474 sys 0m0.837s 00:03:16.474 12:17:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:16.474 12:17:10 -- common/autotest_common.sh@10 -- # set +x 00:03:16.474 ************************************ 00:03:16.474 END TEST custom_alloc 00:03:16.474 ************************************ 00:03:16.474 12:17:10 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:16.474 12:17:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:16.474 12:17:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:16.474 12:17:10 -- common/autotest_common.sh@10 -- # set +x 00:03:16.474 ************************************ 00:03:16.474 START TEST no_shrink_alloc 00:03:16.474 ************************************ 00:03:16.474 12:17:10 -- common/autotest_common.sh@1104 -- # no_shrink_alloc 00:03:16.474 12:17:10 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:16.474 12:17:10 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:16.474 12:17:10 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:16.474 12:17:10 -- setup/hugepages.sh@51 -- # shift 00:03:16.474 12:17:10 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:16.474 12:17:10 -- setup/hugepages.sh@52 -- # local node_ids 00:03:16.474 12:17:10 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:16.474 12:17:10 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:16.474 12:17:10 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:16.474 12:17:10 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:16.474 12:17:10 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:16.474 12:17:10 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:16.474 12:17:10 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:16.474 12:17:10 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:16.474 12:17:10 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:16.474 12:17:10 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:16.474 12:17:10 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:16.474 12:17:10 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:16.474 12:17:10 -- setup/hugepages.sh@73 -- # return 0 00:03:16.474 12:17:10 -- setup/hugepages.sh@198 -- # setup output 00:03:16.474 12:17:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:16.474 12:17:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.406 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.406 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.406 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.406 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.406 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.406 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.406 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.406 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.406 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.406 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:17.406 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:17.406 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:17.406 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:17.406 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:17.406 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:17.406 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:17.406 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:17.668 12:17:11 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:17.668 12:17:11 -- setup/hugepages.sh@89 -- # local node 00:03:17.668 12:17:11 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.668 12:17:11 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.668 12:17:11 -- setup/hugepages.sh@92 -- # local surp 00:03:17.668 12:17:11 -- setup/hugepages.sh@93 -- # local resv 00:03:17.668 12:17:11 -- setup/hugepages.sh@94 -- # local anon 00:03:17.668 12:17:11 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.668 12:17:11 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.668 12:17:11 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.668 12:17:11 -- setup/common.sh@18 -- # local node= 00:03:17.668 12:17:11 -- setup/common.sh@19 -- # local var val 00:03:17.668 12:17:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.668 12:17:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.668 12:17:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.668 12:17:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.668 12:17:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.668 12:17:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46820896 kB' 'MemAvailable: 50276916 kB' 'Buffers: 2704 kB' 'Cached: 9326228 kB' 'SwapCached: 0 kB' 'Active: 6319424 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934208 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474936 kB' 'Mapped: 237048 kB' 'Shmem: 5462464 kB' 'KReclaimable: 166352 kB' 'Slab: 501516 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335164 kB' 'KernelStack: 12592 kB' 'PageTables: 7696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7043768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195904 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.668 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.668 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.669 12:17:11 -- setup/common.sh@33 -- # echo 0 00:03:17.669 12:17:11 -- setup/common.sh@33 -- # return 0 00:03:17.669 12:17:11 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.669 12:17:11 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.669 12:17:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.669 12:17:11 -- setup/common.sh@18 -- # local node= 00:03:17.669 12:17:11 -- setup/common.sh@19 -- # local var val 00:03:17.669 12:17:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.669 12:17:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.669 12:17:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.669 12:17:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.669 12:17:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.669 12:17:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46822476 kB' 'MemAvailable: 50278496 kB' 'Buffers: 2704 kB' 'Cached: 9326232 kB' 'SwapCached: 0 kB' 'Active: 6319288 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934072 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 474824 kB' 'Mapped: 237036 kB' 'Shmem: 5462468 kB' 'KReclaimable: 166352 kB' 'Slab: 501504 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335152 kB' 'KernelStack: 12608 kB' 'PageTables: 7732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7043780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195872 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.669 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.669 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.670 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.670 12:17:11 -- setup/common.sh@33 -- # echo 0 00:03:17.670 12:17:11 -- setup/common.sh@33 -- # return 0 00:03:17.670 12:17:11 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.670 12:17:11 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.670 12:17:11 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.670 12:17:11 -- setup/common.sh@18 -- # local node= 00:03:17.670 12:17:11 -- setup/common.sh@19 -- # local var val 00:03:17.670 12:17:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.670 12:17:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.670 12:17:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.670 12:17:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.670 12:17:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.670 12:17:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.670 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46822612 kB' 'MemAvailable: 50278632 kB' 'Buffers: 2704 kB' 'Cached: 9326244 kB' 'SwapCached: 0 kB' 'Active: 6319516 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934300 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475076 kB' 'Mapped: 236924 kB' 'Shmem: 5462480 kB' 'KReclaimable: 166352 kB' 'Slab: 501520 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335168 kB' 'KernelStack: 12656 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7044164 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195872 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.671 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.671 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.672 12:17:11 -- setup/common.sh@33 -- # echo 0 00:03:17.672 12:17:11 -- setup/common.sh@33 -- # return 0 00:03:17.672 12:17:11 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.672 12:17:11 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.672 nr_hugepages=1024 00:03:17.672 12:17:11 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.672 resv_hugepages=0 00:03:17.672 12:17:11 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.672 surplus_hugepages=0 00:03:17.672 12:17:11 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.672 anon_hugepages=0 00:03:17.672 12:17:11 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.672 12:17:11 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.672 12:17:11 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.672 12:17:11 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.672 12:17:11 -- setup/common.sh@18 -- # local node= 00:03:17.672 12:17:11 -- setup/common.sh@19 -- # local var val 00:03:17.672 12:17:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.672 12:17:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.672 12:17:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.672 12:17:11 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.672 12:17:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.672 12:17:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46822612 kB' 'MemAvailable: 50278632 kB' 'Buffers: 2704 kB' 'Cached: 9326256 kB' 'SwapCached: 0 kB' 'Active: 6319508 kB' 'Inactive: 3481252 kB' 'Active(anon): 5934292 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 475076 kB' 'Mapped: 236924 kB' 'Shmem: 5462492 kB' 'KReclaimable: 166352 kB' 'Slab: 501520 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335168 kB' 'KernelStack: 12656 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7044180 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195872 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.672 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.672 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.673 12:17:11 -- setup/common.sh@33 -- # echo 1024 00:03:17.673 12:17:11 -- setup/common.sh@33 -- # return 0 00:03:17.673 12:17:11 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.673 12:17:11 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.673 12:17:11 -- setup/hugepages.sh@27 -- # local node 00:03:17.673 12:17:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.673 12:17:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:17.673 12:17:11 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.673 12:17:11 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:17.673 12:17:11 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.673 12:17:11 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.673 12:17:11 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.673 12:17:11 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.673 12:17:11 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.673 12:17:11 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.673 12:17:11 -- setup/common.sh@18 -- # local node=0 00:03:17.673 12:17:11 -- setup/common.sh@19 -- # local var val 00:03:17.673 12:17:11 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.673 12:17:11 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.673 12:17:11 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.673 12:17:11 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.673 12:17:11 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.673 12:17:11 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.673 12:17:11 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 28120000 kB' 'MemUsed: 4709884 kB' 'SwapCached: 0 kB' 'Active: 1582912 kB' 'Inactive: 99820 kB' 'Active(anon): 1476912 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1460204 kB' 'Mapped: 49044 kB' 'AnonPages: 225672 kB' 'Shmem: 1254384 kB' 'KernelStack: 7096 kB' 'PageTables: 4884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73624 kB' 'Slab: 262488 kB' 'SReclaimable: 73624 kB' 'SUnreclaim: 188864 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.673 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.673 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # continue 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.674 12:17:11 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.674 12:17:11 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.674 12:17:11 -- setup/common.sh@33 -- # echo 0 00:03:17.674 12:17:11 -- setup/common.sh@33 -- # return 0 00:03:17.674 12:17:11 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.674 12:17:11 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.674 12:17:11 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.674 12:17:11 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.674 12:17:11 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:17.674 node0=1024 expecting 1024 00:03:17.674 12:17:11 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:17.674 12:17:11 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:17.674 12:17:11 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:17.674 12:17:11 -- setup/hugepages.sh@202 -- # setup output 00:03:17.674 12:17:11 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.674 12:17:11 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:19.051 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.051 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.051 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.051 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.051 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.051 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.051 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.051 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.051 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.051 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:19.051 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:19.051 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:19.051 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:19.051 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:19.051 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:19.051 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:19.051 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:19.051 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:19.051 12:17:12 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:19.051 12:17:12 -- setup/hugepages.sh@89 -- # local node 00:03:19.051 12:17:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.051 12:17:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.051 12:17:12 -- setup/hugepages.sh@92 -- # local surp 00:03:19.051 12:17:12 -- setup/hugepages.sh@93 -- # local resv 00:03:19.051 12:17:12 -- setup/hugepages.sh@94 -- # local anon 00:03:19.051 12:17:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.051 12:17:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.051 12:17:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.051 12:17:12 -- setup/common.sh@18 -- # local node= 00:03:19.051 12:17:12 -- setup/common.sh@19 -- # local var val 00:03:19.051 12:17:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.051 12:17:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.051 12:17:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.051 12:17:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.051 12:17:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.051 12:17:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46816136 kB' 'MemAvailable: 50272156 kB' 'Buffers: 2704 kB' 'Cached: 9326312 kB' 'SwapCached: 0 kB' 'Active: 6325996 kB' 'Inactive: 3481252 kB' 'Active(anon): 5940780 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481576 kB' 'Mapped: 237580 kB' 'Shmem: 5462548 kB' 'KReclaimable: 166352 kB' 'Slab: 501360 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335008 kB' 'KernelStack: 12704 kB' 'PageTables: 8056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7050472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196052 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.051 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.051 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.052 12:17:12 -- setup/common.sh@33 -- # echo 0 00:03:19.052 12:17:12 -- setup/common.sh@33 -- # return 0 00:03:19.052 12:17:12 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.052 12:17:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.052 12:17:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.052 12:17:12 -- setup/common.sh@18 -- # local node= 00:03:19.052 12:17:12 -- setup/common.sh@19 -- # local var val 00:03:19.052 12:17:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.052 12:17:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.052 12:17:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.052 12:17:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.052 12:17:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.052 12:17:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46817108 kB' 'MemAvailable: 50273128 kB' 'Buffers: 2704 kB' 'Cached: 9326312 kB' 'SwapCached: 0 kB' 'Active: 6326344 kB' 'Inactive: 3481252 kB' 'Active(anon): 5941128 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481808 kB' 'Mapped: 237728 kB' 'Shmem: 5462548 kB' 'KReclaimable: 166352 kB' 'Slab: 501420 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335068 kB' 'KernelStack: 12672 kB' 'PageTables: 7996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7050484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196036 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.052 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.052 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.053 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.053 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.054 12:17:12 -- setup/common.sh@33 -- # echo 0 00:03:19.054 12:17:12 -- setup/common.sh@33 -- # return 0 00:03:19.054 12:17:12 -- setup/hugepages.sh@99 -- # surp=0 00:03:19.054 12:17:12 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:19.054 12:17:12 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:19.054 12:17:12 -- setup/common.sh@18 -- # local node= 00:03:19.054 12:17:12 -- setup/common.sh@19 -- # local var val 00:03:19.054 12:17:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.054 12:17:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.054 12:17:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.054 12:17:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.054 12:17:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.054 12:17:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46817532 kB' 'MemAvailable: 50273552 kB' 'Buffers: 2704 kB' 'Cached: 9326328 kB' 'SwapCached: 0 kB' 'Active: 6321932 kB' 'Inactive: 3481252 kB' 'Active(anon): 5936716 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 477400 kB' 'Mapped: 237712 kB' 'Shmem: 5462564 kB' 'KReclaimable: 166352 kB' 'Slab: 501428 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335076 kB' 'KernelStack: 12624 kB' 'PageTables: 7820 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7047452 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196032 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.054 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.054 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:19.055 12:17:12 -- setup/common.sh@33 -- # echo 0 00:03:19.055 12:17:12 -- setup/common.sh@33 -- # return 0 00:03:19.055 12:17:12 -- setup/hugepages.sh@100 -- # resv=0 00:03:19.055 12:17:12 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:19.055 nr_hugepages=1024 00:03:19.055 12:17:12 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:19.055 resv_hugepages=0 00:03:19.055 12:17:12 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:19.055 surplus_hugepages=0 00:03:19.055 12:17:12 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:19.055 anon_hugepages=0 00:03:19.055 12:17:12 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.055 12:17:12 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:19.055 12:17:12 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:19.055 12:17:12 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:19.055 12:17:12 -- setup/common.sh@18 -- # local node= 00:03:19.055 12:17:12 -- setup/common.sh@19 -- # local var val 00:03:19.055 12:17:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.055 12:17:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.055 12:17:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.055 12:17:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.055 12:17:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.055 12:17:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60541708 kB' 'MemFree: 46813696 kB' 'MemAvailable: 50269716 kB' 'Buffers: 2704 kB' 'Cached: 9326340 kB' 'SwapCached: 0 kB' 'Active: 6325280 kB' 'Inactive: 3481252 kB' 'Active(anon): 5940064 kB' 'Inactive(anon): 0 kB' 'Active(file): 385216 kB' 'Inactive(file): 3481252 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480736 kB' 'Mapped: 237716 kB' 'Shmem: 5462576 kB' 'KReclaimable: 166352 kB' 'Slab: 501428 kB' 'SReclaimable: 166352 kB' 'SUnreclaim: 335076 kB' 'KernelStack: 12624 kB' 'PageTables: 7796 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37610880 kB' 'Committed_AS: 7050516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 196004 kB' 'VmallocChunk: 0 kB' 'Percpu: 31296 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1504860 kB' 'DirectMap2M: 13094912 kB' 'DirectMap1G: 54525952 kB' 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.055 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.055 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.056 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.056 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:19.057 12:17:12 -- setup/common.sh@33 -- # echo 1024 00:03:19.057 12:17:12 -- setup/common.sh@33 -- # return 0 00:03:19.057 12:17:12 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:19.057 12:17:12 -- setup/hugepages.sh@112 -- # get_nodes 00:03:19.057 12:17:12 -- setup/hugepages.sh@27 -- # local node 00:03:19.057 12:17:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.057 12:17:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:19.057 12:17:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:19.057 12:17:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:19.057 12:17:12 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.057 12:17:12 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.057 12:17:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.057 12:17:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.057 12:17:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.057 12:17:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.057 12:17:12 -- setup/common.sh@18 -- # local node=0 00:03:19.057 12:17:12 -- setup/common.sh@19 -- # local var val 00:03:19.057 12:17:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.057 12:17:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.057 12:17:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.057 12:17:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.057 12:17:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.057 12:17:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32829884 kB' 'MemFree: 28107120 kB' 'MemUsed: 4722764 kB' 'SwapCached: 0 kB' 'Active: 1583052 kB' 'Inactive: 99820 kB' 'Active(anon): 1477052 kB' 'Inactive(anon): 0 kB' 'Active(file): 106000 kB' 'Inactive(file): 99820 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1460220 kB' 'Mapped: 49024 kB' 'AnonPages: 225764 kB' 'Shmem: 1254400 kB' 'KernelStack: 7064 kB' 'PageTables: 4844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 73624 kB' 'Slab: 262428 kB' 'SReclaimable: 73624 kB' 'SUnreclaim: 188804 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.057 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.057 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # continue 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.058 12:17:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.058 12:17:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.058 12:17:12 -- setup/common.sh@33 -- # echo 0 00:03:19.058 12:17:12 -- setup/common.sh@33 -- # return 0 00:03:19.058 12:17:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.058 12:17:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.058 12:17:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.058 12:17:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.058 12:17:12 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:19.058 node0=1024 expecting 1024 00:03:19.058 12:17:12 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:19.058 00:03:19.058 real 0m2.693s 00:03:19.058 user 0m1.143s 00:03:19.058 sys 0m1.476s 00:03:19.058 12:17:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:19.058 12:17:12 -- common/autotest_common.sh@10 -- # set +x 00:03:19.058 ************************************ 00:03:19.058 END TEST no_shrink_alloc 00:03:19.058 ************************************ 00:03:19.058 12:17:12 -- setup/hugepages.sh@217 -- # clear_hp 00:03:19.058 12:17:12 -- setup/hugepages.sh@37 -- # local node hp 00:03:19.058 12:17:12 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.058 12:17:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.058 12:17:12 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.058 12:17:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.058 12:17:12 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.058 12:17:12 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:19.058 12:17:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.058 12:17:12 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.058 12:17:12 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:19.058 12:17:12 -- setup/hugepages.sh@41 -- # echo 0 00:03:19.058 12:17:12 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:19.058 12:17:12 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:19.058 00:03:19.058 real 0m11.264s 00:03:19.058 user 0m4.356s 00:03:19.058 sys 0m5.849s 00:03:19.058 12:17:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:19.058 12:17:12 -- common/autotest_common.sh@10 -- # set +x 00:03:19.058 ************************************ 00:03:19.058 END TEST hugepages 00:03:19.058 ************************************ 00:03:19.058 12:17:12 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:19.058 12:17:12 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:19.058 12:17:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:19.058 12:17:12 -- common/autotest_common.sh@10 -- # set +x 00:03:19.058 ************************************ 00:03:19.058 START TEST driver 00:03:19.058 ************************************ 00:03:19.058 12:17:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:19.058 * Looking for test storage... 00:03:19.058 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:19.058 12:17:12 -- setup/driver.sh@68 -- # setup reset 00:03:19.058 12:17:12 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:19.058 12:17:12 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:21.587 12:17:15 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:21.587 12:17:15 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:21.587 12:17:15 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:21.587 12:17:15 -- common/autotest_common.sh@10 -- # set +x 00:03:21.587 ************************************ 00:03:21.587 START TEST guess_driver 00:03:21.587 ************************************ 00:03:21.587 12:17:15 -- common/autotest_common.sh@1104 -- # guess_driver 00:03:21.587 12:17:15 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:21.587 12:17:15 -- setup/driver.sh@47 -- # local fail=0 00:03:21.587 12:17:15 -- setup/driver.sh@49 -- # pick_driver 00:03:21.587 12:17:15 -- setup/driver.sh@36 -- # vfio 00:03:21.587 12:17:15 -- setup/driver.sh@21 -- # local iommu_grups 00:03:21.587 12:17:15 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:21.587 12:17:15 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:21.587 12:17:15 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:21.587 12:17:15 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:21.587 12:17:15 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:21.587 12:17:15 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:21.587 12:17:15 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:21.587 12:17:15 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:21.587 12:17:15 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:21.587 12:17:15 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:21.587 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:21.587 12:17:15 -- setup/driver.sh@30 -- # return 0 00:03:21.587 12:17:15 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:21.587 12:17:15 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:21.587 12:17:15 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:21.587 12:17:15 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:21.587 Looking for driver=vfio-pci 00:03:21.587 12:17:15 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:21.587 12:17:15 -- setup/driver.sh@45 -- # setup output config 00:03:21.587 12:17:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.587 12:17:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.959 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:22.959 12:17:16 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:22.959 12:17:16 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:22.960 12:17:16 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.896 12:17:17 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:23.896 12:17:17 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:23.896 12:17:17 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:23.896 12:17:17 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:23.896 12:17:17 -- setup/driver.sh@65 -- # setup reset 00:03:23.896 12:17:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:23.896 12:17:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:26.432 00:03:26.432 real 0m4.828s 00:03:26.432 user 0m1.127s 00:03:26.432 sys 0m1.829s 00:03:26.432 12:17:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:26.432 12:17:20 -- common/autotest_common.sh@10 -- # set +x 00:03:26.432 ************************************ 00:03:26.432 END TEST guess_driver 00:03:26.432 ************************************ 00:03:26.432 00:03:26.432 real 0m7.349s 00:03:26.432 user 0m1.696s 00:03:26.432 sys 0m2.797s 00:03:26.432 12:17:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:26.432 12:17:20 -- common/autotest_common.sh@10 -- # set +x 00:03:26.432 ************************************ 00:03:26.432 END TEST driver 00:03:26.432 ************************************ 00:03:26.432 12:17:20 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:26.432 12:17:20 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:26.433 12:17:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:26.433 12:17:20 -- common/autotest_common.sh@10 -- # set +x 00:03:26.433 ************************************ 00:03:26.433 START TEST devices 00:03:26.433 ************************************ 00:03:26.433 12:17:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:26.433 * Looking for test storage... 00:03:26.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:26.433 12:17:20 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:26.433 12:17:20 -- setup/devices.sh@192 -- # setup reset 00:03:26.433 12:17:20 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:26.433 12:17:20 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:28.333 12:17:21 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:28.333 12:17:21 -- common/autotest_common.sh@1654 -- # zoned_devs=() 00:03:28.333 12:17:21 -- common/autotest_common.sh@1654 -- # local -gA zoned_devs 00:03:28.333 12:17:21 -- common/autotest_common.sh@1655 -- # local nvme bdf 00:03:28.333 12:17:21 -- common/autotest_common.sh@1657 -- # for nvme in /sys/block/nvme* 00:03:28.333 12:17:21 -- common/autotest_common.sh@1658 -- # is_block_zoned nvme0n1 00:03:28.333 12:17:21 -- common/autotest_common.sh@1647 -- # local device=nvme0n1 00:03:28.333 12:17:21 -- common/autotest_common.sh@1649 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:28.333 12:17:21 -- common/autotest_common.sh@1650 -- # [[ none != none ]] 00:03:28.333 12:17:21 -- setup/devices.sh@196 -- # blocks=() 00:03:28.333 12:17:21 -- setup/devices.sh@196 -- # declare -a blocks 00:03:28.333 12:17:21 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:28.333 12:17:21 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:28.333 12:17:21 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:28.333 12:17:21 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:28.333 12:17:21 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:28.333 12:17:21 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:28.333 12:17:21 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:28.333 12:17:21 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:28.333 12:17:21 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:28.333 12:17:21 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:28.333 12:17:21 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:28.333 No valid GPT data, bailing 00:03:28.333 12:17:21 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:28.333 12:17:21 -- scripts/common.sh@393 -- # pt= 00:03:28.333 12:17:21 -- scripts/common.sh@394 -- # return 1 00:03:28.333 12:17:21 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:28.333 12:17:21 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:28.333 12:17:21 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:28.333 12:17:21 -- setup/common.sh@80 -- # echo 1000204886016 00:03:28.333 12:17:21 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:28.333 12:17:21 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:28.333 12:17:21 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:28.333 12:17:21 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:28.333 12:17:21 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:28.333 12:17:21 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:28.333 12:17:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:28.333 12:17:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:28.333 12:17:21 -- common/autotest_common.sh@10 -- # set +x 00:03:28.333 ************************************ 00:03:28.333 START TEST nvme_mount 00:03:28.333 ************************************ 00:03:28.333 12:17:21 -- common/autotest_common.sh@1104 -- # nvme_mount 00:03:28.333 12:17:21 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:28.333 12:17:21 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:28.333 12:17:21 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:28.333 12:17:21 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:28.333 12:17:21 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:28.333 12:17:21 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:28.333 12:17:21 -- setup/common.sh@40 -- # local part_no=1 00:03:28.333 12:17:21 -- setup/common.sh@41 -- # local size=1073741824 00:03:28.333 12:17:21 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:28.333 12:17:21 -- setup/common.sh@44 -- # parts=() 00:03:28.333 12:17:21 -- setup/common.sh@44 -- # local parts 00:03:28.333 12:17:21 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:28.333 12:17:21 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:28.333 12:17:21 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:28.333 12:17:21 -- setup/common.sh@46 -- # (( part++ )) 00:03:28.333 12:17:21 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:28.333 12:17:21 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:28.333 12:17:21 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:28.333 12:17:21 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:29.269 Creating new GPT entries in memory. 00:03:29.269 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:29.269 other utilities. 00:03:29.269 12:17:22 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:29.269 12:17:22 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:29.269 12:17:22 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:29.269 12:17:22 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:29.269 12:17:22 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:30.206 Creating new GPT entries in memory. 00:03:30.206 The operation has completed successfully. 00:03:30.206 12:17:23 -- setup/common.sh@57 -- # (( part++ )) 00:03:30.206 12:17:23 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:30.206 12:17:23 -- setup/common.sh@62 -- # wait 1135718 00:03:30.206 12:17:23 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.206 12:17:23 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:30.206 12:17:23 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.206 12:17:23 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:30.206 12:17:23 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:30.206 12:17:23 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.206 12:17:23 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:30.206 12:17:23 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:30.206 12:17:23 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:30.206 12:17:23 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:30.206 12:17:23 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:30.206 12:17:23 -- setup/devices.sh@53 -- # local found=0 00:03:30.206 12:17:23 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:30.206 12:17:23 -- setup/devices.sh@56 -- # : 00:03:30.206 12:17:23 -- setup/devices.sh@59 -- # local pci status 00:03:30.206 12:17:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:30.206 12:17:23 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:30.206 12:17:23 -- setup/devices.sh@47 -- # setup output config 00:03:30.206 12:17:23 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:30.206 12:17:23 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:31.142 12:17:24 -- setup/devices.sh@63 -- # found=1 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.142 12:17:24 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:31.142 12:17:24 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.405 12:17:25 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:31.405 12:17:25 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:31.405 12:17:25 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.405 12:17:25 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:31.405 12:17:25 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:31.405 12:17:25 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:31.405 12:17:25 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.405 12:17:25 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.405 12:17:25 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:31.405 12:17:25 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:31.405 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:31.405 12:17:25 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:31.405 12:17:25 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:31.663 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:31.663 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:31.663 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:31.663 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:31.663 12:17:25 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:31.663 12:17:25 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:31.663 12:17:25 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.663 12:17:25 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:31.663 12:17:25 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:31.663 12:17:25 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.663 12:17:25 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:31.663 12:17:25 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:31.663 12:17:25 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:31.663 12:17:25 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:31.663 12:17:25 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:31.663 12:17:25 -- setup/devices.sh@53 -- # local found=0 00:03:31.663 12:17:25 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:31.663 12:17:25 -- setup/devices.sh@56 -- # : 00:03:31.663 12:17:25 -- setup/devices.sh@59 -- # local pci status 00:03:31.663 12:17:25 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:31.663 12:17:25 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:31.663 12:17:25 -- setup/devices.sh@47 -- # setup output config 00:03:31.663 12:17:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:31.663 12:17:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:33.088 12:17:26 -- setup/devices.sh@63 -- # found=1 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:33.088 12:17:26 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:33.088 12:17:26 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.088 12:17:26 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:33.088 12:17:26 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:33.088 12:17:26 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:33.088 12:17:26 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:33.088 12:17:26 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:33.088 12:17:26 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:33.088 12:17:26 -- setup/devices.sh@50 -- # local mount_point= 00:03:33.088 12:17:26 -- setup/devices.sh@51 -- # local test_file= 00:03:33.088 12:17:26 -- setup/devices.sh@53 -- # local found=0 00:03:33.088 12:17:26 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:33.088 12:17:26 -- setup/devices.sh@59 -- # local pci status 00:03:33.088 12:17:26 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:33.088 12:17:26 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:33.088 12:17:26 -- setup/devices.sh@47 -- # setup output config 00:03:33.088 12:17:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.088 12:17:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:34.022 12:17:27 -- setup/devices.sh@63 -- # found=1 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.022 12:17:27 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:34.022 12:17:27 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:34.282 12:17:28 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:34.282 12:17:28 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:34.282 12:17:28 -- setup/devices.sh@68 -- # return 0 00:03:34.282 12:17:28 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:34.282 12:17:28 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:34.282 12:17:28 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:34.282 12:17:28 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:34.282 12:17:28 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:34.282 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:34.282 00:03:34.282 real 0m6.270s 00:03:34.282 user 0m1.418s 00:03:34.282 sys 0m2.451s 00:03:34.282 12:17:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:34.282 12:17:28 -- common/autotest_common.sh@10 -- # set +x 00:03:34.282 ************************************ 00:03:34.282 END TEST nvme_mount 00:03:34.282 ************************************ 00:03:34.282 12:17:28 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:34.282 12:17:28 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:34.282 12:17:28 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:34.282 12:17:28 -- common/autotest_common.sh@10 -- # set +x 00:03:34.282 ************************************ 00:03:34.282 START TEST dm_mount 00:03:34.282 ************************************ 00:03:34.282 12:17:28 -- common/autotest_common.sh@1104 -- # dm_mount 00:03:34.282 12:17:28 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:34.282 12:17:28 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:34.282 12:17:28 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:34.282 12:17:28 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:34.282 12:17:28 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:34.282 12:17:28 -- setup/common.sh@40 -- # local part_no=2 00:03:34.282 12:17:28 -- setup/common.sh@41 -- # local size=1073741824 00:03:34.282 12:17:28 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:34.282 12:17:28 -- setup/common.sh@44 -- # parts=() 00:03:34.282 12:17:28 -- setup/common.sh@44 -- # local parts 00:03:34.282 12:17:28 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:34.282 12:17:28 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.282 12:17:28 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:34.282 12:17:28 -- setup/common.sh@46 -- # (( part++ )) 00:03:34.282 12:17:28 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.282 12:17:28 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:34.282 12:17:28 -- setup/common.sh@46 -- # (( part++ )) 00:03:34.282 12:17:28 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:34.282 12:17:28 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:34.282 12:17:28 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:34.282 12:17:28 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:35.668 Creating new GPT entries in memory. 00:03:35.668 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:35.668 other utilities. 00:03:35.668 12:17:29 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:35.668 12:17:29 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:35.668 12:17:29 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:35.668 12:17:29 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:35.668 12:17:29 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:36.281 Creating new GPT entries in memory. 00:03:36.281 The operation has completed successfully. 00:03:36.281 12:17:30 -- setup/common.sh@57 -- # (( part++ )) 00:03:36.281 12:17:30 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:36.281 12:17:30 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:36.281 12:17:30 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:36.281 12:17:30 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:37.659 The operation has completed successfully. 00:03:37.659 12:17:31 -- setup/common.sh@57 -- # (( part++ )) 00:03:37.659 12:17:31 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:37.659 12:17:31 -- setup/common.sh@62 -- # wait 1138176 00:03:37.659 12:17:31 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:37.659 12:17:31 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:37.659 12:17:31 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:37.659 12:17:31 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:37.659 12:17:31 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:37.659 12:17:31 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:37.659 12:17:31 -- setup/devices.sh@161 -- # break 00:03:37.659 12:17:31 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:37.659 12:17:31 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:37.659 12:17:31 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:37.659 12:17:31 -- setup/devices.sh@166 -- # dm=dm-0 00:03:37.659 12:17:31 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:37.659 12:17:31 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:37.659 12:17:31 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:37.659 12:17:31 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:37.659 12:17:31 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:37.659 12:17:31 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:37.659 12:17:31 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:37.659 12:17:31 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:37.659 12:17:31 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:37.659 12:17:31 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:37.659 12:17:31 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:37.659 12:17:31 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:37.659 12:17:31 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:37.659 12:17:31 -- setup/devices.sh@53 -- # local found=0 00:03:37.659 12:17:31 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:37.659 12:17:31 -- setup/devices.sh@56 -- # : 00:03:37.659 12:17:31 -- setup/devices.sh@59 -- # local pci status 00:03:37.659 12:17:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.659 12:17:31 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:37.659 12:17:31 -- setup/devices.sh@47 -- # setup output config 00:03:37.659 12:17:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.659 12:17:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:38.596 12:17:32 -- setup/devices.sh@63 -- # found=1 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:38.596 12:17:32 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:38.596 12:17:32 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.596 12:17:32 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:38.596 12:17:32 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:38.596 12:17:32 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:38.596 12:17:32 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:38.596 12:17:32 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:38.596 12:17:32 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:38.596 12:17:32 -- setup/devices.sh@50 -- # local mount_point= 00:03:38.596 12:17:32 -- setup/devices.sh@51 -- # local test_file= 00:03:38.596 12:17:32 -- setup/devices.sh@53 -- # local found=0 00:03:38.596 12:17:32 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:38.596 12:17:32 -- setup/devices.sh@59 -- # local pci status 00:03:38.596 12:17:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.596 12:17:32 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:38.596 12:17:32 -- setup/devices.sh@47 -- # setup output config 00:03:38.596 12:17:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:38.596 12:17:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:39.533 12:17:33 -- setup/devices.sh@63 -- # found=1 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.533 12:17:33 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:39.533 12:17:33 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.791 12:17:33 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:39.791 12:17:33 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:39.791 12:17:33 -- setup/devices.sh@68 -- # return 0 00:03:39.791 12:17:33 -- setup/devices.sh@187 -- # cleanup_dm 00:03:39.791 12:17:33 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:39.791 12:17:33 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:39.791 12:17:33 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:39.791 12:17:33 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:39.791 12:17:33 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:39.791 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:39.791 12:17:33 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:39.791 12:17:33 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:39.791 00:03:39.791 real 0m5.527s 00:03:39.791 user 0m0.867s 00:03:39.791 sys 0m1.526s 00:03:39.791 12:17:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:39.791 12:17:33 -- common/autotest_common.sh@10 -- # set +x 00:03:39.791 ************************************ 00:03:39.791 END TEST dm_mount 00:03:39.791 ************************************ 00:03:39.791 12:17:33 -- setup/devices.sh@1 -- # cleanup 00:03:39.791 12:17:33 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:39.791 12:17:33 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.791 12:17:33 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:39.791 12:17:33 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:39.791 12:17:33 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:39.791 12:17:33 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:40.050 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:40.050 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:40.050 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:40.050 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:40.050 12:17:33 -- setup/devices.sh@12 -- # cleanup_dm 00:03:40.050 12:17:33 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:40.309 12:17:33 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:40.309 12:17:33 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:40.309 12:17:33 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:40.309 12:17:33 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:40.309 12:17:33 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:40.309 00:03:40.309 real 0m13.720s 00:03:40.309 user 0m2.954s 00:03:40.309 sys 0m4.992s 00:03:40.309 12:17:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:40.309 12:17:33 -- common/autotest_common.sh@10 -- # set +x 00:03:40.309 ************************************ 00:03:40.309 END TEST devices 00:03:40.309 ************************************ 00:03:40.309 00:03:40.309 real 0m42.664s 00:03:40.309 user 0m12.202s 00:03:40.309 sys 0m18.854s 00:03:40.309 12:17:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:40.309 12:17:33 -- common/autotest_common.sh@10 -- # set +x 00:03:40.309 ************************************ 00:03:40.309 END TEST setup.sh 00:03:40.309 ************************************ 00:03:40.309 12:17:34 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:41.245 Hugepages 00:03:41.245 node hugesize free / total 00:03:41.245 node0 1048576kB 0 / 0 00:03:41.245 node0 2048kB 2048 / 2048 00:03:41.245 node1 1048576kB 0 / 0 00:03:41.245 node1 2048kB 0 / 0 00:03:41.245 00:03:41.245 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:41.245 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:41.245 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:41.245 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:41.245 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:41.245 12:17:35 -- spdk/autotest.sh@141 -- # uname -s 00:03:41.245 12:17:35 -- spdk/autotest.sh@141 -- # [[ Linux == Linux ]] 00:03:41.245 12:17:35 -- spdk/autotest.sh@143 -- # nvme_namespace_revert 00:03:41.245 12:17:35 -- common/autotest_common.sh@1516 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:42.623 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:42.623 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:42.623 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:43.559 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:43.559 12:17:37 -- common/autotest_common.sh@1517 -- # sleep 1 00:03:44.938 12:17:38 -- common/autotest_common.sh@1518 -- # bdfs=() 00:03:44.938 12:17:38 -- common/autotest_common.sh@1518 -- # local bdfs 00:03:44.938 12:17:38 -- common/autotest_common.sh@1519 -- # bdfs=($(get_nvme_bdfs)) 00:03:44.938 12:17:38 -- common/autotest_common.sh@1519 -- # get_nvme_bdfs 00:03:44.938 12:17:38 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:44.938 12:17:38 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:44.938 12:17:38 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:44.938 12:17:38 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:44.938 12:17:38 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:44.938 12:17:38 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:44.938 12:17:38 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:03:44.938 12:17:38 -- common/autotest_common.sh@1521 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:45.872 Waiting for block devices as requested 00:03:45.872 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:45.872 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:46.132 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:46.132 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:46.132 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:46.132 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:46.392 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:46.392 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:46.392 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:46.392 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:46.651 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:46.651 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:46.651 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:46.651 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:46.909 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:46.909 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:46.909 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:47.168 12:17:40 -- common/autotest_common.sh@1523 -- # for bdf in "${bdfs[@]}" 00:03:47.168 12:17:40 -- common/autotest_common.sh@1524 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1487 -- # readlink -f /sys/class/nvme/nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1487 -- # grep 0000:88:00.0/nvme/nvme 00:03:47.168 12:17:40 -- common/autotest_common.sh@1487 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1488 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:47.168 12:17:40 -- common/autotest_common.sh@1492 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1492 -- # printf '%s\n' nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1524 -- # nvme_ctrlr=/dev/nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1525 -- # [[ -z /dev/nvme0 ]] 00:03:47.168 12:17:40 -- common/autotest_common.sh@1530 -- # nvme id-ctrl /dev/nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1530 -- # grep oacs 00:03:47.168 12:17:40 -- common/autotest_common.sh@1530 -- # cut -d: -f2 00:03:47.168 12:17:40 -- common/autotest_common.sh@1530 -- # oacs=' 0xf' 00:03:47.168 12:17:40 -- common/autotest_common.sh@1531 -- # oacs_ns_manage=8 00:03:47.168 12:17:40 -- common/autotest_common.sh@1533 -- # [[ 8 -ne 0 ]] 00:03:47.168 12:17:40 -- common/autotest_common.sh@1539 -- # nvme id-ctrl /dev/nvme0 00:03:47.168 12:17:40 -- common/autotest_common.sh@1539 -- # grep unvmcap 00:03:47.168 12:17:40 -- common/autotest_common.sh@1539 -- # cut -d: -f2 00:03:47.168 12:17:40 -- common/autotest_common.sh@1539 -- # unvmcap=' 0' 00:03:47.168 12:17:40 -- common/autotest_common.sh@1540 -- # [[ 0 -eq 0 ]] 00:03:47.168 12:17:40 -- common/autotest_common.sh@1542 -- # continue 00:03:47.168 12:17:40 -- spdk/autotest.sh@146 -- # timing_exit pre_cleanup 00:03:47.168 12:17:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:47.168 12:17:40 -- common/autotest_common.sh@10 -- # set +x 00:03:47.168 12:17:40 -- spdk/autotest.sh@149 -- # timing_enter afterboot 00:03:47.168 12:17:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:47.168 12:17:40 -- common/autotest_common.sh@10 -- # set +x 00:03:47.168 12:17:40 -- spdk/autotest.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:48.544 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:48.544 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:48.544 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:49.480 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:49.481 12:17:43 -- spdk/autotest.sh@151 -- # timing_exit afterboot 00:03:49.481 12:17:43 -- common/autotest_common.sh@718 -- # xtrace_disable 00:03:49.481 12:17:43 -- common/autotest_common.sh@10 -- # set +x 00:03:49.481 12:17:43 -- spdk/autotest.sh@155 -- # opal_revert_cleanup 00:03:49.481 12:17:43 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:03:49.481 12:17:43 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:03:49.481 12:17:43 -- common/autotest_common.sh@1562 -- # bdfs=() 00:03:49.481 12:17:43 -- common/autotest_common.sh@1562 -- # local bdfs 00:03:49.481 12:17:43 -- common/autotest_common.sh@1564 -- # get_nvme_bdfs 00:03:49.481 12:17:43 -- common/autotest_common.sh@1498 -- # bdfs=() 00:03:49.481 12:17:43 -- common/autotest_common.sh@1498 -- # local bdfs 00:03:49.481 12:17:43 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:49.481 12:17:43 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:49.481 12:17:43 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:03:49.481 12:17:43 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:03:49.481 12:17:43 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:03:49.481 12:17:43 -- common/autotest_common.sh@1564 -- # for bdf in $(get_nvme_bdfs) 00:03:49.481 12:17:43 -- common/autotest_common.sh@1565 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:49.481 12:17:43 -- common/autotest_common.sh@1565 -- # device=0x0a54 00:03:49.481 12:17:43 -- common/autotest_common.sh@1566 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:49.481 12:17:43 -- common/autotest_common.sh@1567 -- # bdfs+=($bdf) 00:03:49.481 12:17:43 -- common/autotest_common.sh@1571 -- # printf '%s\n' 0000:88:00.0 00:03:49.481 12:17:43 -- common/autotest_common.sh@1577 -- # [[ -z 0000:88:00.0 ]] 00:03:49.481 12:17:43 -- common/autotest_common.sh@1582 -- # spdk_tgt_pid=1143471 00:03:49.481 12:17:43 -- common/autotest_common.sh@1583 -- # waitforlisten 1143471 00:03:49.481 12:17:43 -- common/autotest_common.sh@1581 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:49.481 12:17:43 -- common/autotest_common.sh@819 -- # '[' -z 1143471 ']' 00:03:49.481 12:17:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:49.481 12:17:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:03:49.481 12:17:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:49.481 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:49.481 12:17:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:03:49.481 12:17:43 -- common/autotest_common.sh@10 -- # set +x 00:03:49.481 [2024-07-12 12:17:43.340978] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:03:49.481 [2024-07-12 12:17:43.341076] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1143471 ] 00:03:49.481 EAL: No free 2048 kB hugepages reported on node 1 00:03:49.739 [2024-07-12 12:17:43.402154] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:49.739 [2024-07-12 12:17:43.509663] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:49.739 [2024-07-12 12:17:43.509838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:50.676 12:17:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:03:50.676 12:17:44 -- common/autotest_common.sh@852 -- # return 0 00:03:50.676 12:17:44 -- common/autotest_common.sh@1585 -- # bdf_id=0 00:03:50.676 12:17:44 -- common/autotest_common.sh@1586 -- # for bdf in "${bdfs[@]}" 00:03:50.676 12:17:44 -- common/autotest_common.sh@1587 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:03:53.957 nvme0n1 00:03:53.957 12:17:47 -- common/autotest_common.sh@1589 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:03:53.957 [2024-07-12 12:17:47.597987] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:03:53.957 [2024-07-12 12:17:47.598030] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:03:53.957 request: 00:03:53.957 { 00:03:53.957 "nvme_ctrlr_name": "nvme0", 00:03:53.957 "password": "test", 00:03:53.957 "method": "bdev_nvme_opal_revert", 00:03:53.957 "req_id": 1 00:03:53.957 } 00:03:53.957 Got JSON-RPC error response 00:03:53.957 response: 00:03:53.957 { 00:03:53.957 "code": -32603, 00:03:53.957 "message": "Internal error" 00:03:53.957 } 00:03:53.957 12:17:47 -- common/autotest_common.sh@1589 -- # true 00:03:53.957 12:17:47 -- common/autotest_common.sh@1590 -- # (( ++bdf_id )) 00:03:53.957 12:17:47 -- common/autotest_common.sh@1593 -- # killprocess 1143471 00:03:53.957 12:17:47 -- common/autotest_common.sh@926 -- # '[' -z 1143471 ']' 00:03:53.957 12:17:47 -- common/autotest_common.sh@930 -- # kill -0 1143471 00:03:53.957 12:17:47 -- common/autotest_common.sh@931 -- # uname 00:03:53.958 12:17:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:03:53.958 12:17:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1143471 00:03:53.958 12:17:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:03:53.958 12:17:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:03:53.958 12:17:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1143471' 00:03:53.958 killing process with pid 1143471 00:03:53.958 12:17:47 -- common/autotest_common.sh@945 -- # kill 1143471 00:03:53.958 12:17:47 -- common/autotest_common.sh@950 -- # wait 1143471 00:03:55.888 12:17:49 -- spdk/autotest.sh@161 -- # '[' 0 -eq 1 ']' 00:03:55.888 12:17:49 -- spdk/autotest.sh@165 -- # '[' 1 -eq 1 ']' 00:03:55.888 12:17:49 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:03:55.889 12:17:49 -- spdk/autotest.sh@166 -- # [[ 0 -eq 1 ]] 00:03:55.889 12:17:49 -- spdk/autotest.sh@173 -- # timing_enter lib 00:03:55.889 12:17:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:03:55.889 12:17:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.889 12:17:49 -- spdk/autotest.sh@175 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:55.889 12:17:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:55.889 12:17:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:55.889 12:17:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.889 ************************************ 00:03:55.889 START TEST env 00:03:55.889 ************************************ 00:03:55.889 12:17:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:03:55.889 * Looking for test storage... 00:03:55.889 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:03:55.889 12:17:49 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:55.889 12:17:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:55.889 12:17:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:55.889 12:17:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.889 ************************************ 00:03:55.889 START TEST env_memory 00:03:55.889 ************************************ 00:03:55.889 12:17:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:03:55.889 00:03:55.889 00:03:55.889 CUnit - A unit testing framework for C - Version 2.1-3 00:03:55.889 http://cunit.sourceforge.net/ 00:03:55.889 00:03:55.889 00:03:55.889 Suite: memory 00:03:55.889 Test: alloc and free memory map ...[2024-07-12 12:17:49.519804] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:03:55.889 passed 00:03:55.889 Test: mem map translation ...[2024-07-12 12:17:49.541043] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:03:55.889 [2024-07-12 12:17:49.541066] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:03:55.889 [2024-07-12 12:17:49.541125] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:03:55.889 [2024-07-12 12:17:49.541137] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:03:55.889 passed 00:03:55.889 Test: mem map registration ...[2024-07-12 12:17:49.584677] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:03:55.889 [2024-07-12 12:17:49.584697] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:03:55.889 passed 00:03:55.889 Test: mem map adjacent registrations ...passed 00:03:55.889 00:03:55.889 Run Summary: Type Total Ran Passed Failed Inactive 00:03:55.889 suites 1 1 n/a 0 0 00:03:55.889 tests 4 4 4 0 0 00:03:55.889 asserts 152 152 152 0 n/a 00:03:55.889 00:03:55.889 Elapsed time = 0.146 seconds 00:03:55.889 00:03:55.889 real 0m0.152s 00:03:55.889 user 0m0.143s 00:03:55.889 sys 0m0.009s 00:03:55.889 12:17:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:55.889 12:17:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.889 ************************************ 00:03:55.889 END TEST env_memory 00:03:55.889 ************************************ 00:03:55.889 12:17:49 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:55.889 12:17:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:55.889 12:17:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:55.889 12:17:49 -- common/autotest_common.sh@10 -- # set +x 00:03:55.889 ************************************ 00:03:55.889 START TEST env_vtophys 00:03:55.889 ************************************ 00:03:55.889 12:17:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:03:55.889 EAL: lib.eal log level changed from notice to debug 00:03:55.889 EAL: Detected lcore 0 as core 0 on socket 0 00:03:55.889 EAL: Detected lcore 1 as core 1 on socket 0 00:03:55.889 EAL: Detected lcore 2 as core 2 on socket 0 00:03:55.889 EAL: Detected lcore 3 as core 3 on socket 0 00:03:55.889 EAL: Detected lcore 4 as core 4 on socket 0 00:03:55.889 EAL: Detected lcore 5 as core 5 on socket 0 00:03:55.889 EAL: Detected lcore 6 as core 8 on socket 0 00:03:55.889 EAL: Detected lcore 7 as core 9 on socket 0 00:03:55.889 EAL: Detected lcore 8 as core 10 on socket 0 00:03:55.889 EAL: Detected lcore 9 as core 11 on socket 0 00:03:55.889 EAL: Detected lcore 10 as core 12 on socket 0 00:03:55.889 EAL: Detected lcore 11 as core 13 on socket 0 00:03:55.889 EAL: Detected lcore 12 as core 0 on socket 1 00:03:55.889 EAL: Detected lcore 13 as core 1 on socket 1 00:03:55.889 EAL: Detected lcore 14 as core 2 on socket 1 00:03:55.889 EAL: Detected lcore 15 as core 3 on socket 1 00:03:55.889 EAL: Detected lcore 16 as core 4 on socket 1 00:03:55.889 EAL: Detected lcore 17 as core 5 on socket 1 00:03:55.889 EAL: Detected lcore 18 as core 8 on socket 1 00:03:55.889 EAL: Detected lcore 19 as core 9 on socket 1 00:03:55.889 EAL: Detected lcore 20 as core 10 on socket 1 00:03:55.889 EAL: Detected lcore 21 as core 11 on socket 1 00:03:55.889 EAL: Detected lcore 22 as core 12 on socket 1 00:03:55.889 EAL: Detected lcore 23 as core 13 on socket 1 00:03:55.889 EAL: Detected lcore 24 as core 0 on socket 0 00:03:55.889 EAL: Detected lcore 25 as core 1 on socket 0 00:03:55.889 EAL: Detected lcore 26 as core 2 on socket 0 00:03:55.889 EAL: Detected lcore 27 as core 3 on socket 0 00:03:55.889 EAL: Detected lcore 28 as core 4 on socket 0 00:03:55.889 EAL: Detected lcore 29 as core 5 on socket 0 00:03:55.889 EAL: Detected lcore 30 as core 8 on socket 0 00:03:55.889 EAL: Detected lcore 31 as core 9 on socket 0 00:03:55.889 EAL: Detected lcore 32 as core 10 on socket 0 00:03:55.889 EAL: Detected lcore 33 as core 11 on socket 0 00:03:55.889 EAL: Detected lcore 34 as core 12 on socket 0 00:03:55.889 EAL: Detected lcore 35 as core 13 on socket 0 00:03:55.889 EAL: Detected lcore 36 as core 0 on socket 1 00:03:55.889 EAL: Detected lcore 37 as core 1 on socket 1 00:03:55.889 EAL: Detected lcore 38 as core 2 on socket 1 00:03:55.889 EAL: Detected lcore 39 as core 3 on socket 1 00:03:55.889 EAL: Detected lcore 40 as core 4 on socket 1 00:03:55.889 EAL: Detected lcore 41 as core 5 on socket 1 00:03:55.889 EAL: Detected lcore 42 as core 8 on socket 1 00:03:55.889 EAL: Detected lcore 43 as core 9 on socket 1 00:03:55.889 EAL: Detected lcore 44 as core 10 on socket 1 00:03:55.889 EAL: Detected lcore 45 as core 11 on socket 1 00:03:55.889 EAL: Detected lcore 46 as core 12 on socket 1 00:03:55.889 EAL: Detected lcore 47 as core 13 on socket 1 00:03:55.889 EAL: Maximum logical cores by configuration: 128 00:03:55.889 EAL: Detected CPU lcores: 48 00:03:55.889 EAL: Detected NUMA nodes: 2 00:03:55.889 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:03:55.889 EAL: Detected shared linkage of DPDK 00:03:55.889 EAL: No shared files mode enabled, IPC will be disabled 00:03:55.889 EAL: Bus pci wants IOVA as 'DC' 00:03:55.889 EAL: Buses did not request a specific IOVA mode. 00:03:55.889 EAL: IOMMU is available, selecting IOVA as VA mode. 00:03:55.889 EAL: Selected IOVA mode 'VA' 00:03:55.889 EAL: No free 2048 kB hugepages reported on node 1 00:03:55.889 EAL: Probing VFIO support... 00:03:55.889 EAL: IOMMU type 1 (Type 1) is supported 00:03:55.889 EAL: IOMMU type 7 (sPAPR) is not supported 00:03:55.889 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:03:55.889 EAL: VFIO support initialized 00:03:55.889 EAL: Ask a virtual area of 0x2e000 bytes 00:03:55.889 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:03:55.889 EAL: Setting up physically contiguous memory... 00:03:55.889 EAL: Setting maximum number of open files to 524288 00:03:55.889 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:03:55.889 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:03:55.889 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:03:55.889 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:03:55.889 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:03:55.889 EAL: Ask a virtual area of 0x61000 bytes 00:03:55.889 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:03:55.889 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:03:55.889 EAL: Ask a virtual area of 0x400000000 bytes 00:03:55.889 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:03:55.890 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:03:55.890 EAL: Hugepages will be freed exactly as allocated. 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: TSC frequency is ~2700000 KHz 00:03:55.890 EAL: Main lcore 0 is ready (tid=7f975b85aa00;cpuset=[0]) 00:03:55.890 EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:55.890 EAL: Restoring previous memory policy: 0 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was expanded by 2MB 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: No PCI address specified using 'addr=' in: bus=pci 00:03:55.890 EAL: Mem event callback 'spdk:(nil)' registered 00:03:55.890 00:03:55.890 00:03:55.890 CUnit - A unit testing framework for C - Version 2.1-3 00:03:55.890 http://cunit.sourceforge.net/ 00:03:55.890 00:03:55.890 00:03:55.890 Suite: components_suite 00:03:55.890 Test: vtophys_malloc_test ...passed 00:03:55.890 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:55.890 EAL: Restoring previous memory policy: 4 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was expanded by 4MB 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was shrunk by 4MB 00:03:55.890 EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:55.890 EAL: Restoring previous memory policy: 4 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was expanded by 6MB 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was shrunk by 6MB 00:03:55.890 EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:55.890 EAL: Restoring previous memory policy: 4 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was expanded by 10MB 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was shrunk by 10MB 00:03:55.890 EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:55.890 EAL: Restoring previous memory policy: 4 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was expanded by 18MB 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was shrunk by 18MB 00:03:55.890 EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:55.890 EAL: Restoring previous memory policy: 4 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was expanded by 34MB 00:03:55.890 EAL: Calling mem event callback 'spdk:(nil)' 00:03:55.890 EAL: request: mp_malloc_sync 00:03:55.890 EAL: No shared files mode enabled, IPC is disabled 00:03:55.890 EAL: Heap on socket 0 was shrunk by 34MB 00:03:55.890 EAL: Trying to obtain current memory policy. 00:03:55.890 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:56.148 EAL: Restoring previous memory policy: 4 00:03:56.148 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.148 EAL: request: mp_malloc_sync 00:03:56.148 EAL: No shared files mode enabled, IPC is disabled 00:03:56.148 EAL: Heap on socket 0 was expanded by 66MB 00:03:56.148 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.148 EAL: request: mp_malloc_sync 00:03:56.148 EAL: No shared files mode enabled, IPC is disabled 00:03:56.148 EAL: Heap on socket 0 was shrunk by 66MB 00:03:56.148 EAL: Trying to obtain current memory policy. 00:03:56.148 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:56.148 EAL: Restoring previous memory policy: 4 00:03:56.148 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.148 EAL: request: mp_malloc_sync 00:03:56.148 EAL: No shared files mode enabled, IPC is disabled 00:03:56.148 EAL: Heap on socket 0 was expanded by 130MB 00:03:56.148 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.148 EAL: request: mp_malloc_sync 00:03:56.148 EAL: No shared files mode enabled, IPC is disabled 00:03:56.148 EAL: Heap on socket 0 was shrunk by 130MB 00:03:56.148 EAL: Trying to obtain current memory policy. 00:03:56.148 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:56.148 EAL: Restoring previous memory policy: 4 00:03:56.148 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.148 EAL: request: mp_malloc_sync 00:03:56.148 EAL: No shared files mode enabled, IPC is disabled 00:03:56.148 EAL: Heap on socket 0 was expanded by 258MB 00:03:56.148 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.406 EAL: request: mp_malloc_sync 00:03:56.406 EAL: No shared files mode enabled, IPC is disabled 00:03:56.406 EAL: Heap on socket 0 was shrunk by 258MB 00:03:56.406 EAL: Trying to obtain current memory policy. 00:03:56.406 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:56.406 EAL: Restoring previous memory policy: 4 00:03:56.406 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.406 EAL: request: mp_malloc_sync 00:03:56.406 EAL: No shared files mode enabled, IPC is disabled 00:03:56.406 EAL: Heap on socket 0 was expanded by 514MB 00:03:56.664 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.664 EAL: request: mp_malloc_sync 00:03:56.664 EAL: No shared files mode enabled, IPC is disabled 00:03:56.664 EAL: Heap on socket 0 was shrunk by 514MB 00:03:56.664 EAL: Trying to obtain current memory policy. 00:03:56.664 EAL: Setting policy MPOL_PREFERRED for socket 0 00:03:56.921 EAL: Restoring previous memory policy: 4 00:03:56.921 EAL: Calling mem event callback 'spdk:(nil)' 00:03:56.921 EAL: request: mp_malloc_sync 00:03:56.921 EAL: No shared files mode enabled, IPC is disabled 00:03:56.921 EAL: Heap on socket 0 was expanded by 1026MB 00:03:57.179 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.437 EAL: request: mp_malloc_sync 00:03:57.437 EAL: No shared files mode enabled, IPC is disabled 00:03:57.437 EAL: Heap on socket 0 was shrunk by 1026MB 00:03:57.437 passed 00:03:57.437 00:03:57.437 Run Summary: Type Total Ran Passed Failed Inactive 00:03:57.437 suites 1 1 n/a 0 0 00:03:57.437 tests 2 2 2 0 0 00:03:57.437 asserts 497 497 497 0 n/a 00:03:57.437 00:03:57.437 Elapsed time = 1.369 seconds 00:03:57.437 EAL: Calling mem event callback 'spdk:(nil)' 00:03:57.437 EAL: request: mp_malloc_sync 00:03:57.437 EAL: No shared files mode enabled, IPC is disabled 00:03:57.437 EAL: Heap on socket 0 was shrunk by 2MB 00:03:57.437 EAL: No shared files mode enabled, IPC is disabled 00:03:57.437 EAL: No shared files mode enabled, IPC is disabled 00:03:57.437 EAL: No shared files mode enabled, IPC is disabled 00:03:57.437 00:03:57.437 real 0m1.488s 00:03:57.437 user 0m0.847s 00:03:57.437 sys 0m0.608s 00:03:57.437 12:17:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:57.437 12:17:51 -- common/autotest_common.sh@10 -- # set +x 00:03:57.437 ************************************ 00:03:57.437 END TEST env_vtophys 00:03:57.437 ************************************ 00:03:57.437 12:17:51 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:57.437 12:17:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:03:57.437 12:17:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:57.437 12:17:51 -- common/autotest_common.sh@10 -- # set +x 00:03:57.437 ************************************ 00:03:57.437 START TEST env_pci 00:03:57.437 ************************************ 00:03:57.437 12:17:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:03:57.437 00:03:57.437 00:03:57.437 CUnit - A unit testing framework for C - Version 2.1-3 00:03:57.437 http://cunit.sourceforge.net/ 00:03:57.437 00:03:57.437 00:03:57.437 Suite: pci 00:03:57.437 Test: pci_hook ...[2024-07-12 12:17:51.195105] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 1144506 has claimed it 00:03:57.437 EAL: Cannot find device (10000:00:01.0) 00:03:57.437 EAL: Failed to attach device on primary process 00:03:57.437 passed 00:03:57.437 00:03:57.437 Run Summary: Type Total Ran Passed Failed Inactive 00:03:57.437 suites 1 1 n/a 0 0 00:03:57.437 tests 1 1 1 0 0 00:03:57.437 asserts 25 25 25 0 n/a 00:03:57.437 00:03:57.437 Elapsed time = 0.022 seconds 00:03:57.437 00:03:57.437 real 0m0.036s 00:03:57.437 user 0m0.010s 00:03:57.437 sys 0m0.026s 00:03:57.437 12:17:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:03:57.437 12:17:51 -- common/autotest_common.sh@10 -- # set +x 00:03:57.437 ************************************ 00:03:57.437 END TEST env_pci 00:03:57.437 ************************************ 00:03:57.437 12:17:51 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:03:57.437 12:17:51 -- env/env.sh@15 -- # uname 00:03:57.437 12:17:51 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:03:57.437 12:17:51 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:03:57.437 12:17:51 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:57.437 12:17:51 -- common/autotest_common.sh@1077 -- # '[' 5 -le 1 ']' 00:03:57.437 12:17:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:03:57.437 12:17:51 -- common/autotest_common.sh@10 -- # set +x 00:03:57.437 ************************************ 00:03:57.437 START TEST env_dpdk_post_init 00:03:57.437 ************************************ 00:03:57.437 12:17:51 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:03:57.437 EAL: Detected CPU lcores: 48 00:03:57.437 EAL: Detected NUMA nodes: 2 00:03:57.437 EAL: Detected shared linkage of DPDK 00:03:57.437 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:03:57.437 EAL: Selected IOVA mode 'VA' 00:03:57.437 EAL: No free 2048 kB hugepages reported on node 1 00:03:57.437 EAL: VFIO support initialized 00:03:57.437 TELEMETRY: No legacy callbacks, legacy socket not created 00:03:57.437 EAL: Using IOMMU type 1 (Type 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:03:57.695 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:03:58.628 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:01.900 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:01.900 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:01.900 Starting DPDK initialization... 00:04:01.900 Starting SPDK post initialization... 00:04:01.900 SPDK NVMe probe 00:04:01.900 Attaching to 0000:88:00.0 00:04:01.900 Attached to 0000:88:00.0 00:04:01.900 Cleaning up... 00:04:01.900 00:04:01.900 real 0m4.395s 00:04:01.900 user 0m3.259s 00:04:01.900 sys 0m0.192s 00:04:01.900 12:17:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:01.900 12:17:55 -- common/autotest_common.sh@10 -- # set +x 00:04:01.900 ************************************ 00:04:01.900 END TEST env_dpdk_post_init 00:04:01.900 ************************************ 00:04:01.900 12:17:55 -- env/env.sh@26 -- # uname 00:04:01.900 12:17:55 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:01.900 12:17:55 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:01.900 12:17:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:01.900 12:17:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:01.900 12:17:55 -- common/autotest_common.sh@10 -- # set +x 00:04:01.900 ************************************ 00:04:01.900 START TEST env_mem_callbacks 00:04:01.900 ************************************ 00:04:01.900 12:17:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:01.900 EAL: Detected CPU lcores: 48 00:04:01.900 EAL: Detected NUMA nodes: 2 00:04:01.900 EAL: Detected shared linkage of DPDK 00:04:01.900 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:01.900 EAL: Selected IOVA mode 'VA' 00:04:01.900 EAL: No free 2048 kB hugepages reported on node 1 00:04:01.900 EAL: VFIO support initialized 00:04:01.900 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:01.900 00:04:01.900 00:04:01.900 CUnit - A unit testing framework for C - Version 2.1-3 00:04:01.900 http://cunit.sourceforge.net/ 00:04:01.900 00:04:01.900 00:04:01.900 Suite: memory 00:04:01.900 Test: test ... 00:04:01.900 register 0x200000200000 2097152 00:04:01.900 malloc 3145728 00:04:01.900 register 0x200000400000 4194304 00:04:01.900 buf 0x200000500000 len 3145728 PASSED 00:04:01.900 malloc 64 00:04:01.900 buf 0x2000004fff40 len 64 PASSED 00:04:01.900 malloc 4194304 00:04:01.900 register 0x200000800000 6291456 00:04:01.900 buf 0x200000a00000 len 4194304 PASSED 00:04:01.900 free 0x200000500000 3145728 00:04:01.900 free 0x2000004fff40 64 00:04:01.900 unregister 0x200000400000 4194304 PASSED 00:04:01.900 free 0x200000a00000 4194304 00:04:01.900 unregister 0x200000800000 6291456 PASSED 00:04:01.900 malloc 8388608 00:04:01.900 register 0x200000400000 10485760 00:04:01.900 buf 0x200000600000 len 8388608 PASSED 00:04:01.900 free 0x200000600000 8388608 00:04:01.900 unregister 0x200000400000 10485760 PASSED 00:04:01.900 passed 00:04:01.900 00:04:01.900 Run Summary: Type Total Ran Passed Failed Inactive 00:04:01.900 suites 1 1 n/a 0 0 00:04:01.900 tests 1 1 1 0 0 00:04:01.900 asserts 15 15 15 0 n/a 00:04:01.900 00:04:01.900 Elapsed time = 0.005 seconds 00:04:01.900 00:04:01.900 real 0m0.047s 00:04:01.900 user 0m0.015s 00:04:01.900 sys 0m0.032s 00:04:01.900 12:17:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:01.900 12:17:55 -- common/autotest_common.sh@10 -- # set +x 00:04:01.900 ************************************ 00:04:01.900 END TEST env_mem_callbacks 00:04:01.900 ************************************ 00:04:01.900 00:04:01.900 real 0m6.299s 00:04:01.900 user 0m4.349s 00:04:01.900 sys 0m0.999s 00:04:01.900 12:17:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:01.900 12:17:55 -- common/autotest_common.sh@10 -- # set +x 00:04:01.900 ************************************ 00:04:01.900 END TEST env 00:04:01.900 ************************************ 00:04:01.900 12:17:55 -- spdk/autotest.sh@176 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:01.900 12:17:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:01.900 12:17:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:01.900 12:17:55 -- common/autotest_common.sh@10 -- # set +x 00:04:01.900 ************************************ 00:04:01.900 START TEST rpc 00:04:01.900 ************************************ 00:04:01.900 12:17:55 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:01.900 * Looking for test storage... 00:04:01.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:01.900 12:17:55 -- rpc/rpc.sh@65 -- # spdk_pid=1145166 00:04:01.900 12:17:55 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:01.900 12:17:55 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:01.900 12:17:55 -- rpc/rpc.sh@67 -- # waitforlisten 1145166 00:04:01.900 12:17:55 -- common/autotest_common.sh@819 -- # '[' -z 1145166 ']' 00:04:01.900 12:17:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:01.900 12:17:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:01.900 12:17:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:01.900 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:01.900 12:17:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:01.900 12:17:55 -- common/autotest_common.sh@10 -- # set +x 00:04:02.158 [2024-07-12 12:17:55.863239] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:02.158 [2024-07-12 12:17:55.863318] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1145166 ] 00:04:02.158 EAL: No free 2048 kB hugepages reported on node 1 00:04:02.158 [2024-07-12 12:17:55.923935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:02.158 [2024-07-12 12:17:56.037983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:02.158 [2024-07-12 12:17:56.038142] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:02.158 [2024-07-12 12:17:56.038162] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 1145166' to capture a snapshot of events at runtime. 00:04:02.158 [2024-07-12 12:17:56.038182] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid1145166 for offline analysis/debug. 00:04:02.158 [2024-07-12 12:17:56.038219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:03.091 12:17:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:03.091 12:17:56 -- common/autotest_common.sh@852 -- # return 0 00:04:03.091 12:17:56 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:03.091 12:17:56 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:03.091 12:17:56 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:03.091 12:17:56 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:03.091 12:17:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:03.091 12:17:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 ************************************ 00:04:03.091 START TEST rpc_integrity 00:04:03.091 ************************************ 00:04:03.091 12:17:56 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:03.091 12:17:56 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:03.091 12:17:56 -- rpc/rpc.sh@13 -- # jq length 00:04:03.091 12:17:56 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:03.091 12:17:56 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:03.091 12:17:56 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:03.091 { 00:04:03.091 "name": "Malloc0", 00:04:03.091 "aliases": [ 00:04:03.091 "4f84db57-2433-4ba9-a4ea-a484af9cf838" 00:04:03.091 ], 00:04:03.091 "product_name": "Malloc disk", 00:04:03.091 "block_size": 512, 00:04:03.091 "num_blocks": 16384, 00:04:03.091 "uuid": "4f84db57-2433-4ba9-a4ea-a484af9cf838", 00:04:03.091 "assigned_rate_limits": { 00:04:03.091 "rw_ios_per_sec": 0, 00:04:03.091 "rw_mbytes_per_sec": 0, 00:04:03.091 "r_mbytes_per_sec": 0, 00:04:03.091 "w_mbytes_per_sec": 0 00:04:03.091 }, 00:04:03.091 "claimed": false, 00:04:03.091 "zoned": false, 00:04:03.091 "supported_io_types": { 00:04:03.091 "read": true, 00:04:03.091 "write": true, 00:04:03.091 "unmap": true, 00:04:03.091 "write_zeroes": true, 00:04:03.091 "flush": true, 00:04:03.091 "reset": true, 00:04:03.091 "compare": false, 00:04:03.091 "compare_and_write": false, 00:04:03.091 "abort": true, 00:04:03.091 "nvme_admin": false, 00:04:03.091 "nvme_io": false 00:04:03.091 }, 00:04:03.091 "memory_domains": [ 00:04:03.091 { 00:04:03.091 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.091 "dma_device_type": 2 00:04:03.091 } 00:04:03.091 ], 00:04:03.091 "driver_specific": {} 00:04:03.091 } 00:04:03.091 ]' 00:04:03.091 12:17:56 -- rpc/rpc.sh@17 -- # jq length 00:04:03.091 12:17:56 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:03.091 12:17:56 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 [2024-07-12 12:17:56.895884] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:03.091 [2024-07-12 12:17:56.895947] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:03.091 [2024-07-12 12:17:56.895969] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xda5f70 00:04:03.091 [2024-07-12 12:17:56.895984] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:03.091 [2024-07-12 12:17:56.897504] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:03.091 [2024-07-12 12:17:56.897531] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:03.091 Passthru0 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:03.091 { 00:04:03.091 "name": "Malloc0", 00:04:03.091 "aliases": [ 00:04:03.091 "4f84db57-2433-4ba9-a4ea-a484af9cf838" 00:04:03.091 ], 00:04:03.091 "product_name": "Malloc disk", 00:04:03.091 "block_size": 512, 00:04:03.091 "num_blocks": 16384, 00:04:03.091 "uuid": "4f84db57-2433-4ba9-a4ea-a484af9cf838", 00:04:03.091 "assigned_rate_limits": { 00:04:03.091 "rw_ios_per_sec": 0, 00:04:03.091 "rw_mbytes_per_sec": 0, 00:04:03.091 "r_mbytes_per_sec": 0, 00:04:03.091 "w_mbytes_per_sec": 0 00:04:03.091 }, 00:04:03.091 "claimed": true, 00:04:03.091 "claim_type": "exclusive_write", 00:04:03.091 "zoned": false, 00:04:03.091 "supported_io_types": { 00:04:03.091 "read": true, 00:04:03.091 "write": true, 00:04:03.091 "unmap": true, 00:04:03.091 "write_zeroes": true, 00:04:03.091 "flush": true, 00:04:03.091 "reset": true, 00:04:03.091 "compare": false, 00:04:03.091 "compare_and_write": false, 00:04:03.091 "abort": true, 00:04:03.091 "nvme_admin": false, 00:04:03.091 "nvme_io": false 00:04:03.091 }, 00:04:03.091 "memory_domains": [ 00:04:03.091 { 00:04:03.091 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.091 "dma_device_type": 2 00:04:03.091 } 00:04:03.091 ], 00:04:03.091 "driver_specific": {} 00:04:03.091 }, 00:04:03.091 { 00:04:03.091 "name": "Passthru0", 00:04:03.091 "aliases": [ 00:04:03.091 "691cef42-19b9-543e-9f0a-5bde04c84c4e" 00:04:03.091 ], 00:04:03.091 "product_name": "passthru", 00:04:03.091 "block_size": 512, 00:04:03.091 "num_blocks": 16384, 00:04:03.091 "uuid": "691cef42-19b9-543e-9f0a-5bde04c84c4e", 00:04:03.091 "assigned_rate_limits": { 00:04:03.091 "rw_ios_per_sec": 0, 00:04:03.091 "rw_mbytes_per_sec": 0, 00:04:03.091 "r_mbytes_per_sec": 0, 00:04:03.091 "w_mbytes_per_sec": 0 00:04:03.091 }, 00:04:03.091 "claimed": false, 00:04:03.091 "zoned": false, 00:04:03.091 "supported_io_types": { 00:04:03.091 "read": true, 00:04:03.091 "write": true, 00:04:03.091 "unmap": true, 00:04:03.091 "write_zeroes": true, 00:04:03.091 "flush": true, 00:04:03.091 "reset": true, 00:04:03.091 "compare": false, 00:04:03.091 "compare_and_write": false, 00:04:03.091 "abort": true, 00:04:03.091 "nvme_admin": false, 00:04:03.091 "nvme_io": false 00:04:03.091 }, 00:04:03.091 "memory_domains": [ 00:04:03.091 { 00:04:03.091 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.091 "dma_device_type": 2 00:04:03.091 } 00:04:03.091 ], 00:04:03.091 "driver_specific": { 00:04:03.091 "passthru": { 00:04:03.091 "name": "Passthru0", 00:04:03.091 "base_bdev_name": "Malloc0" 00:04:03.091 } 00:04:03.091 } 00:04:03.091 } 00:04:03.091 ]' 00:04:03.091 12:17:56 -- rpc/rpc.sh@21 -- # jq length 00:04:03.091 12:17:56 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:03.091 12:17:56 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:03.091 12:17:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.091 12:17:56 -- common/autotest_common.sh@10 -- # set +x 00:04:03.091 12:17:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.091 12:17:56 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:03.091 12:17:56 -- rpc/rpc.sh@26 -- # jq length 00:04:03.349 12:17:57 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:03.349 00:04:03.349 real 0m0.227s 00:04:03.349 user 0m0.148s 00:04:03.349 sys 0m0.018s 00:04:03.349 12:17:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 ************************************ 00:04:03.349 END TEST rpc_integrity 00:04:03.349 ************************************ 00:04:03.349 12:17:57 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:03.349 12:17:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:03.349 12:17:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 ************************************ 00:04:03.349 START TEST rpc_plugins 00:04:03.349 ************************************ 00:04:03.349 12:17:57 -- common/autotest_common.sh@1104 -- # rpc_plugins 00:04:03.349 12:17:57 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:03.349 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.349 12:17:57 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:03.349 12:17:57 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:03.349 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.349 12:17:57 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:03.349 { 00:04:03.349 "name": "Malloc1", 00:04:03.349 "aliases": [ 00:04:03.349 "f7a4c99f-2397-4ae4-a336-2c9221593ec3" 00:04:03.349 ], 00:04:03.349 "product_name": "Malloc disk", 00:04:03.349 "block_size": 4096, 00:04:03.349 "num_blocks": 256, 00:04:03.349 "uuid": "f7a4c99f-2397-4ae4-a336-2c9221593ec3", 00:04:03.349 "assigned_rate_limits": { 00:04:03.349 "rw_ios_per_sec": 0, 00:04:03.349 "rw_mbytes_per_sec": 0, 00:04:03.349 "r_mbytes_per_sec": 0, 00:04:03.349 "w_mbytes_per_sec": 0 00:04:03.349 }, 00:04:03.349 "claimed": false, 00:04:03.349 "zoned": false, 00:04:03.349 "supported_io_types": { 00:04:03.349 "read": true, 00:04:03.349 "write": true, 00:04:03.349 "unmap": true, 00:04:03.349 "write_zeroes": true, 00:04:03.349 "flush": true, 00:04:03.349 "reset": true, 00:04:03.349 "compare": false, 00:04:03.349 "compare_and_write": false, 00:04:03.349 "abort": true, 00:04:03.349 "nvme_admin": false, 00:04:03.349 "nvme_io": false 00:04:03.349 }, 00:04:03.349 "memory_domains": [ 00:04:03.349 { 00:04:03.349 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.349 "dma_device_type": 2 00:04:03.349 } 00:04:03.349 ], 00:04:03.349 "driver_specific": {} 00:04:03.349 } 00:04:03.349 ]' 00:04:03.349 12:17:57 -- rpc/rpc.sh@32 -- # jq length 00:04:03.349 12:17:57 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:03.349 12:17:57 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:03.349 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.349 12:17:57 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:03.349 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.349 12:17:57 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:03.349 12:17:57 -- rpc/rpc.sh@36 -- # jq length 00:04:03.349 12:17:57 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:03.349 00:04:03.349 real 0m0.110s 00:04:03.349 user 0m0.071s 00:04:03.349 sys 0m0.011s 00:04:03.349 12:17:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 ************************************ 00:04:03.349 END TEST rpc_plugins 00:04:03.349 ************************************ 00:04:03.349 12:17:57 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:03.349 12:17:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:03.349 12:17:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 ************************************ 00:04:03.349 START TEST rpc_trace_cmd_test 00:04:03.349 ************************************ 00:04:03.349 12:17:57 -- common/autotest_common.sh@1104 -- # rpc_trace_cmd_test 00:04:03.349 12:17:57 -- rpc/rpc.sh@40 -- # local info 00:04:03.349 12:17:57 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:03.349 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.349 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.349 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.349 12:17:57 -- rpc/rpc.sh@42 -- # info='{ 00:04:03.349 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid1145166", 00:04:03.349 "tpoint_group_mask": "0x8", 00:04:03.349 "iscsi_conn": { 00:04:03.349 "mask": "0x2", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "scsi": { 00:04:03.349 "mask": "0x4", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "bdev": { 00:04:03.349 "mask": "0x8", 00:04:03.349 "tpoint_mask": "0xffffffffffffffff" 00:04:03.349 }, 00:04:03.349 "nvmf_rdma": { 00:04:03.349 "mask": "0x10", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "nvmf_tcp": { 00:04:03.349 "mask": "0x20", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "ftl": { 00:04:03.349 "mask": "0x40", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "blobfs": { 00:04:03.349 "mask": "0x80", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "dsa": { 00:04:03.349 "mask": "0x200", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "thread": { 00:04:03.349 "mask": "0x400", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "nvme_pcie": { 00:04:03.349 "mask": "0x800", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "iaa": { 00:04:03.349 "mask": "0x1000", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "nvme_tcp": { 00:04:03.349 "mask": "0x2000", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 }, 00:04:03.349 "bdev_nvme": { 00:04:03.349 "mask": "0x4000", 00:04:03.349 "tpoint_mask": "0x0" 00:04:03.349 } 00:04:03.349 }' 00:04:03.349 12:17:57 -- rpc/rpc.sh@43 -- # jq length 00:04:03.349 12:17:57 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:03.349 12:17:57 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:03.349 12:17:57 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:03.349 12:17:57 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:03.607 12:17:57 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:03.607 12:17:57 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:03.607 12:17:57 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:03.607 12:17:57 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:03.607 12:17:57 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:03.607 00:04:03.607 real 0m0.198s 00:04:03.607 user 0m0.175s 00:04:03.607 sys 0m0.015s 00:04:03.607 12:17:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 ************************************ 00:04:03.607 END TEST rpc_trace_cmd_test 00:04:03.607 ************************************ 00:04:03.607 12:17:57 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:03.607 12:17:57 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:03.607 12:17:57 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:03.607 12:17:57 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:03.607 12:17:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 ************************************ 00:04:03.607 START TEST rpc_daemon_integrity 00:04:03.607 ************************************ 00:04:03.607 12:17:57 -- common/autotest_common.sh@1104 -- # rpc_integrity 00:04:03.607 12:17:57 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:03.607 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.607 12:17:57 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:03.607 12:17:57 -- rpc/rpc.sh@13 -- # jq length 00:04:03.607 12:17:57 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:03.607 12:17:57 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:03.607 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.607 12:17:57 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:03.607 12:17:57 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:03.607 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.607 12:17:57 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:03.607 { 00:04:03.607 "name": "Malloc2", 00:04:03.607 "aliases": [ 00:04:03.607 "1b5a9cf2-8d11-497c-a40a-ede3ea920ed9" 00:04:03.607 ], 00:04:03.607 "product_name": "Malloc disk", 00:04:03.607 "block_size": 512, 00:04:03.607 "num_blocks": 16384, 00:04:03.607 "uuid": "1b5a9cf2-8d11-497c-a40a-ede3ea920ed9", 00:04:03.607 "assigned_rate_limits": { 00:04:03.607 "rw_ios_per_sec": 0, 00:04:03.607 "rw_mbytes_per_sec": 0, 00:04:03.607 "r_mbytes_per_sec": 0, 00:04:03.607 "w_mbytes_per_sec": 0 00:04:03.607 }, 00:04:03.607 "claimed": false, 00:04:03.607 "zoned": false, 00:04:03.607 "supported_io_types": { 00:04:03.607 "read": true, 00:04:03.607 "write": true, 00:04:03.607 "unmap": true, 00:04:03.607 "write_zeroes": true, 00:04:03.607 "flush": true, 00:04:03.607 "reset": true, 00:04:03.607 "compare": false, 00:04:03.607 "compare_and_write": false, 00:04:03.607 "abort": true, 00:04:03.607 "nvme_admin": false, 00:04:03.607 "nvme_io": false 00:04:03.607 }, 00:04:03.607 "memory_domains": [ 00:04:03.607 { 00:04:03.607 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.607 "dma_device_type": 2 00:04:03.607 } 00:04:03.607 ], 00:04:03.607 "driver_specific": {} 00:04:03.607 } 00:04:03.607 ]' 00:04:03.607 12:17:57 -- rpc/rpc.sh@17 -- # jq length 00:04:03.607 12:17:57 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:03.607 12:17:57 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:03.607 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 [2024-07-12 12:17:57.501601] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:03.607 [2024-07-12 12:17:57.501645] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:03.607 [2024-07-12 12:17:57.501669] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xf45970 00:04:03.607 [2024-07-12 12:17:57.501686] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:03.607 [2024-07-12 12:17:57.503044] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:03.607 [2024-07-12 12:17:57.503069] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:03.607 Passthru0 00:04:03.607 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.607 12:17:57 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:03.607 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.607 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.607 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.607 12:17:57 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:03.607 { 00:04:03.607 "name": "Malloc2", 00:04:03.607 "aliases": [ 00:04:03.607 "1b5a9cf2-8d11-497c-a40a-ede3ea920ed9" 00:04:03.607 ], 00:04:03.607 "product_name": "Malloc disk", 00:04:03.607 "block_size": 512, 00:04:03.607 "num_blocks": 16384, 00:04:03.607 "uuid": "1b5a9cf2-8d11-497c-a40a-ede3ea920ed9", 00:04:03.607 "assigned_rate_limits": { 00:04:03.607 "rw_ios_per_sec": 0, 00:04:03.607 "rw_mbytes_per_sec": 0, 00:04:03.607 "r_mbytes_per_sec": 0, 00:04:03.607 "w_mbytes_per_sec": 0 00:04:03.607 }, 00:04:03.607 "claimed": true, 00:04:03.607 "claim_type": "exclusive_write", 00:04:03.607 "zoned": false, 00:04:03.607 "supported_io_types": { 00:04:03.607 "read": true, 00:04:03.607 "write": true, 00:04:03.607 "unmap": true, 00:04:03.607 "write_zeroes": true, 00:04:03.607 "flush": true, 00:04:03.607 "reset": true, 00:04:03.607 "compare": false, 00:04:03.607 "compare_and_write": false, 00:04:03.607 "abort": true, 00:04:03.607 "nvme_admin": false, 00:04:03.607 "nvme_io": false 00:04:03.607 }, 00:04:03.607 "memory_domains": [ 00:04:03.607 { 00:04:03.607 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.607 "dma_device_type": 2 00:04:03.607 } 00:04:03.607 ], 00:04:03.607 "driver_specific": {} 00:04:03.607 }, 00:04:03.607 { 00:04:03.607 "name": "Passthru0", 00:04:03.607 "aliases": [ 00:04:03.607 "560c067a-f47d-5762-bd7c-6d4c83c0aeb0" 00:04:03.607 ], 00:04:03.607 "product_name": "passthru", 00:04:03.607 "block_size": 512, 00:04:03.607 "num_blocks": 16384, 00:04:03.607 "uuid": "560c067a-f47d-5762-bd7c-6d4c83c0aeb0", 00:04:03.607 "assigned_rate_limits": { 00:04:03.607 "rw_ios_per_sec": 0, 00:04:03.607 "rw_mbytes_per_sec": 0, 00:04:03.607 "r_mbytes_per_sec": 0, 00:04:03.607 "w_mbytes_per_sec": 0 00:04:03.607 }, 00:04:03.607 "claimed": false, 00:04:03.607 "zoned": false, 00:04:03.607 "supported_io_types": { 00:04:03.607 "read": true, 00:04:03.607 "write": true, 00:04:03.607 "unmap": true, 00:04:03.607 "write_zeroes": true, 00:04:03.607 "flush": true, 00:04:03.607 "reset": true, 00:04:03.607 "compare": false, 00:04:03.607 "compare_and_write": false, 00:04:03.607 "abort": true, 00:04:03.607 "nvme_admin": false, 00:04:03.607 "nvme_io": false 00:04:03.607 }, 00:04:03.607 "memory_domains": [ 00:04:03.607 { 00:04:03.607 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:03.607 "dma_device_type": 2 00:04:03.607 } 00:04:03.607 ], 00:04:03.607 "driver_specific": { 00:04:03.607 "passthru": { 00:04:03.607 "name": "Passthru0", 00:04:03.607 "base_bdev_name": "Malloc2" 00:04:03.607 } 00:04:03.607 } 00:04:03.607 } 00:04:03.607 ]' 00:04:03.607 12:17:57 -- rpc/rpc.sh@21 -- # jq length 00:04:03.865 12:17:57 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:03.865 12:17:57 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:03.865 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.865 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.865 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.865 12:17:57 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:03.865 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.865 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.865 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.865 12:17:57 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:03.865 12:17:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:03.865 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.865 12:17:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:03.865 12:17:57 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:03.865 12:17:57 -- rpc/rpc.sh@26 -- # jq length 00:04:03.865 12:17:57 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:03.865 00:04:03.865 real 0m0.220s 00:04:03.865 user 0m0.144s 00:04:03.865 sys 0m0.019s 00:04:03.865 12:17:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:03.865 12:17:57 -- common/autotest_common.sh@10 -- # set +x 00:04:03.865 ************************************ 00:04:03.865 END TEST rpc_daemon_integrity 00:04:03.865 ************************************ 00:04:03.865 12:17:57 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:03.865 12:17:57 -- rpc/rpc.sh@84 -- # killprocess 1145166 00:04:03.865 12:17:57 -- common/autotest_common.sh@926 -- # '[' -z 1145166 ']' 00:04:03.865 12:17:57 -- common/autotest_common.sh@930 -- # kill -0 1145166 00:04:03.865 12:17:57 -- common/autotest_common.sh@931 -- # uname 00:04:03.865 12:17:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:03.865 12:17:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1145166 00:04:03.865 12:17:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:03.865 12:17:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:03.865 12:17:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1145166' 00:04:03.865 killing process with pid 1145166 00:04:03.865 12:17:57 -- common/autotest_common.sh@945 -- # kill 1145166 00:04:03.865 12:17:57 -- common/autotest_common.sh@950 -- # wait 1145166 00:04:04.431 00:04:04.431 real 0m2.355s 00:04:04.431 user 0m2.986s 00:04:04.431 sys 0m0.555s 00:04:04.431 12:17:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:04.431 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.431 ************************************ 00:04:04.431 END TEST rpc 00:04:04.431 ************************************ 00:04:04.431 12:17:58 -- spdk/autotest.sh@177 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:04.431 12:17:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:04.431 12:17:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:04.431 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.431 ************************************ 00:04:04.431 START TEST rpc_client 00:04:04.431 ************************************ 00:04:04.431 12:17:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:04.431 * Looking for test storage... 00:04:04.431 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:04.431 12:17:58 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:04.431 OK 00:04:04.431 12:17:58 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:04.431 00:04:04.431 real 0m0.063s 00:04:04.431 user 0m0.032s 00:04:04.431 sys 0m0.036s 00:04:04.431 12:17:58 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:04.431 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.431 ************************************ 00:04:04.431 END TEST rpc_client 00:04:04.431 ************************************ 00:04:04.431 12:17:58 -- spdk/autotest.sh@178 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:04.431 12:17:58 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:04.431 12:17:58 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:04.431 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.431 ************************************ 00:04:04.431 START TEST json_config 00:04:04.431 ************************************ 00:04:04.431 12:17:58 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:04.431 12:17:58 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:04.431 12:17:58 -- nvmf/common.sh@7 -- # uname -s 00:04:04.431 12:17:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:04.431 12:17:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:04.431 12:17:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:04.431 12:17:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:04.431 12:17:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:04.431 12:17:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:04.431 12:17:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:04.431 12:17:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:04.431 12:17:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:04.431 12:17:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:04.431 12:17:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:04.431 12:17:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:04.431 12:17:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:04.431 12:17:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:04.431 12:17:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:04.431 12:17:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:04.431 12:17:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:04.431 12:17:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:04.431 12:17:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:04.431 12:17:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.431 12:17:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.431 12:17:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.431 12:17:58 -- paths/export.sh@5 -- # export PATH 00:04:04.431 12:17:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:04.431 12:17:58 -- nvmf/common.sh@46 -- # : 0 00:04:04.431 12:17:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:04.431 12:17:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:04.431 12:17:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:04.431 12:17:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:04.431 12:17:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:04.431 12:17:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:04.431 12:17:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:04.431 12:17:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:04.431 12:17:58 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:04.431 12:17:58 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:04.431 12:17:58 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:04.431 12:17:58 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:04.431 12:17:58 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:04.431 12:17:58 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:04.431 12:17:58 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:04.431 12:17:58 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:04.431 12:17:58 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:04.431 12:17:58 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:04.431 12:17:58 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:04.431 12:17:58 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:04.431 12:17:58 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:04.431 12:17:58 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:04.432 12:17:58 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:04.432 INFO: JSON configuration test init 00:04:04.432 12:17:58 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:04.432 12:17:58 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:04.432 12:17:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:04.432 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.432 12:17:58 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:04.432 12:17:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:04.432 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.432 12:17:58 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:04.432 12:17:58 -- json_config/json_config.sh@98 -- # local app=target 00:04:04.432 12:17:58 -- json_config/json_config.sh@99 -- # shift 00:04:04.432 12:17:58 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:04.432 12:17:58 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:04.432 12:17:58 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:04.432 12:17:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:04.432 12:17:58 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:04.432 12:17:58 -- json_config/json_config.sh@111 -- # app_pid[$app]=1145648 00:04:04.432 12:17:58 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:04.432 12:17:58 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:04.432 Waiting for target to run... 00:04:04.432 12:17:58 -- json_config/json_config.sh@114 -- # waitforlisten 1145648 /var/tmp/spdk_tgt.sock 00:04:04.432 12:17:58 -- common/autotest_common.sh@819 -- # '[' -z 1145648 ']' 00:04:04.432 12:17:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:04.432 12:17:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:04.432 12:17:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:04.432 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:04.432 12:17:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:04.432 12:17:58 -- common/autotest_common.sh@10 -- # set +x 00:04:04.432 [2024-07-12 12:17:58.336275] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:04.432 [2024-07-12 12:17:58.336373] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1145648 ] 00:04:04.690 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.947 [2024-07-12 12:17:58.681897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:04.947 [2024-07-12 12:17:58.768599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:04.947 [2024-07-12 12:17:58.768784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:05.512 12:17:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:05.512 12:17:59 -- common/autotest_common.sh@852 -- # return 0 00:04:05.512 12:17:59 -- json_config/json_config.sh@115 -- # echo '' 00:04:05.512 00:04:05.512 12:17:59 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:05.512 12:17:59 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:05.512 12:17:59 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:05.512 12:17:59 -- common/autotest_common.sh@10 -- # set +x 00:04:05.512 12:17:59 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:05.512 12:17:59 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:05.512 12:17:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:05.512 12:17:59 -- common/autotest_common.sh@10 -- # set +x 00:04:05.512 12:17:59 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:05.512 12:17:59 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:05.512 12:17:59 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:08.794 12:18:02 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:08.794 12:18:02 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:08.794 12:18:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:08.794 12:18:02 -- common/autotest_common.sh@10 -- # set +x 00:04:08.794 12:18:02 -- json_config/json_config.sh@48 -- # local ret=0 00:04:08.794 12:18:02 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:08.794 12:18:02 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:08.794 12:18:02 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:08.794 12:18:02 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:08.794 12:18:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:08.794 12:18:02 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:08.794 12:18:02 -- json_config/json_config.sh@51 -- # local get_types 00:04:08.794 12:18:02 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:08.794 12:18:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:08.794 12:18:02 -- common/autotest_common.sh@10 -- # set +x 00:04:08.794 12:18:02 -- json_config/json_config.sh@58 -- # return 0 00:04:08.794 12:18:02 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:08.794 12:18:02 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:08.794 12:18:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:08.794 12:18:02 -- common/autotest_common.sh@10 -- # set +x 00:04:08.794 12:18:02 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:08.794 12:18:02 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:08.794 12:18:02 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:08.794 12:18:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:09.052 MallocForNvmf0 00:04:09.052 12:18:02 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:09.052 12:18:02 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:09.309 MallocForNvmf1 00:04:09.309 12:18:03 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:09.309 12:18:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:09.565 [2024-07-12 12:18:03.383174] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:09.565 12:18:03 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:09.565 12:18:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:09.822 12:18:03 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:09.822 12:18:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:10.080 12:18:03 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:10.080 12:18:03 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:10.337 12:18:04 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:10.337 12:18:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:10.595 [2024-07-12 12:18:04.346351] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:10.595 12:18:04 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:10.595 12:18:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:10.595 12:18:04 -- common/autotest_common.sh@10 -- # set +x 00:04:10.595 12:18:04 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:10.595 12:18:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:10.595 12:18:04 -- common/autotest_common.sh@10 -- # set +x 00:04:10.595 12:18:04 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:10.595 12:18:04 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:10.595 12:18:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:10.853 MallocBdevForConfigChangeCheck 00:04:10.853 12:18:04 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:10.853 12:18:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:10.853 12:18:04 -- common/autotest_common.sh@10 -- # set +x 00:04:10.853 12:18:04 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:10.853 12:18:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:11.110 12:18:05 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:11.110 INFO: shutting down applications... 00:04:11.110 12:18:05 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:11.110 12:18:05 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:11.110 12:18:05 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:11.110 12:18:05 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:13.006 Calling clear_iscsi_subsystem 00:04:13.006 Calling clear_nvmf_subsystem 00:04:13.006 Calling clear_nbd_subsystem 00:04:13.006 Calling clear_ublk_subsystem 00:04:13.006 Calling clear_vhost_blk_subsystem 00:04:13.006 Calling clear_vhost_scsi_subsystem 00:04:13.006 Calling clear_scheduler_subsystem 00:04:13.006 Calling clear_bdev_subsystem 00:04:13.006 Calling clear_accel_subsystem 00:04:13.006 Calling clear_vmd_subsystem 00:04:13.006 Calling clear_sock_subsystem 00:04:13.006 Calling clear_iobuf_subsystem 00:04:13.006 12:18:06 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:13.006 12:18:06 -- json_config/json_config.sh@396 -- # count=100 00:04:13.006 12:18:06 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:13.006 12:18:06 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:13.006 12:18:06 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:13.006 12:18:06 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:13.264 12:18:06 -- json_config/json_config.sh@398 -- # break 00:04:13.264 12:18:06 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:13.264 12:18:06 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:13.264 12:18:06 -- json_config/json_config.sh@120 -- # local app=target 00:04:13.264 12:18:06 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:13.264 12:18:06 -- json_config/json_config.sh@124 -- # [[ -n 1145648 ]] 00:04:13.264 12:18:06 -- json_config/json_config.sh@127 -- # kill -SIGINT 1145648 00:04:13.264 12:18:06 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:13.264 12:18:06 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:13.264 12:18:06 -- json_config/json_config.sh@130 -- # kill -0 1145648 00:04:13.264 12:18:06 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:13.831 12:18:07 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:13.831 12:18:07 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:13.831 12:18:07 -- json_config/json_config.sh@130 -- # kill -0 1145648 00:04:13.831 12:18:07 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:13.831 12:18:07 -- json_config/json_config.sh@132 -- # break 00:04:13.831 12:18:07 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:13.831 12:18:07 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:13.831 SPDK target shutdown done 00:04:13.831 12:18:07 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:13.831 INFO: relaunching applications... 00:04:13.831 12:18:07 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:13.831 12:18:07 -- json_config/json_config.sh@98 -- # local app=target 00:04:13.831 12:18:07 -- json_config/json_config.sh@99 -- # shift 00:04:13.831 12:18:07 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:13.831 12:18:07 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:13.831 12:18:07 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:13.831 12:18:07 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:13.831 12:18:07 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:13.831 12:18:07 -- json_config/json_config.sh@111 -- # app_pid[$app]=1147026 00:04:13.831 12:18:07 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:13.831 12:18:07 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:13.831 Waiting for target to run... 00:04:13.831 12:18:07 -- json_config/json_config.sh@114 -- # waitforlisten 1147026 /var/tmp/spdk_tgt.sock 00:04:13.831 12:18:07 -- common/autotest_common.sh@819 -- # '[' -z 1147026 ']' 00:04:13.831 12:18:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:13.831 12:18:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:13.831 12:18:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:13.831 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:13.831 12:18:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:13.831 12:18:07 -- common/autotest_common.sh@10 -- # set +x 00:04:13.831 [2024-07-12 12:18:07.531808] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:13.831 [2024-07-12 12:18:07.531918] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1147026 ] 00:04:13.831 EAL: No free 2048 kB hugepages reported on node 1 00:04:14.397 [2024-07-12 12:18:08.033020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:14.397 [2024-07-12 12:18:08.138290] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:14.397 [2024-07-12 12:18:08.138478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:17.724 [2024-07-12 12:18:11.170712] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:17.724 [2024-07-12 12:18:11.203186] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:17.724 12:18:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:17.724 12:18:11 -- common/autotest_common.sh@852 -- # return 0 00:04:17.724 12:18:11 -- json_config/json_config.sh@115 -- # echo '' 00:04:17.724 00:04:17.724 12:18:11 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:17.724 12:18:11 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:17.724 INFO: Checking if target configuration is the same... 00:04:17.724 12:18:11 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:17.724 12:18:11 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:17.724 12:18:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:17.724 + '[' 2 -ne 2 ']' 00:04:17.724 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:17.724 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:17.724 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:17.724 +++ basename /dev/fd/62 00:04:17.724 ++ mktemp /tmp/62.XXX 00:04:17.724 + tmp_file_1=/tmp/62.z1c 00:04:17.724 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:17.724 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:17.724 + tmp_file_2=/tmp/spdk_tgt_config.json.yj8 00:04:17.724 + ret=0 00:04:17.724 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:17.982 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:17.982 + diff -u /tmp/62.z1c /tmp/spdk_tgt_config.json.yj8 00:04:17.982 + echo 'INFO: JSON config files are the same' 00:04:17.982 INFO: JSON config files are the same 00:04:17.982 + rm /tmp/62.z1c /tmp/spdk_tgt_config.json.yj8 00:04:17.982 + exit 0 00:04:17.982 12:18:11 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:17.982 12:18:11 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:17.982 INFO: changing configuration and checking if this can be detected... 00:04:17.982 12:18:11 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:17.982 12:18:11 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:18.239 12:18:12 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:18.239 12:18:12 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:18.239 12:18:12 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:18.239 + '[' 2 -ne 2 ']' 00:04:18.239 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:18.239 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:18.239 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:18.239 +++ basename /dev/fd/62 00:04:18.239 ++ mktemp /tmp/62.XXX 00:04:18.239 + tmp_file_1=/tmp/62.SrS 00:04:18.239 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:18.239 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:18.239 + tmp_file_2=/tmp/spdk_tgt_config.json.F4Z 00:04:18.239 + ret=0 00:04:18.239 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:18.497 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:18.753 + diff -u /tmp/62.SrS /tmp/spdk_tgt_config.json.F4Z 00:04:18.753 + ret=1 00:04:18.753 + echo '=== Start of file: /tmp/62.SrS ===' 00:04:18.753 + cat /tmp/62.SrS 00:04:18.753 + echo '=== End of file: /tmp/62.SrS ===' 00:04:18.753 + echo '' 00:04:18.753 + echo '=== Start of file: /tmp/spdk_tgt_config.json.F4Z ===' 00:04:18.753 + cat /tmp/spdk_tgt_config.json.F4Z 00:04:18.753 + echo '=== End of file: /tmp/spdk_tgt_config.json.F4Z ===' 00:04:18.753 + echo '' 00:04:18.753 + rm /tmp/62.SrS /tmp/spdk_tgt_config.json.F4Z 00:04:18.753 + exit 1 00:04:18.753 12:18:12 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:18.753 INFO: configuration change detected. 00:04:18.753 12:18:12 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:18.754 12:18:12 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:18.754 12:18:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:18.754 12:18:12 -- common/autotest_common.sh@10 -- # set +x 00:04:18.754 12:18:12 -- json_config/json_config.sh@360 -- # local ret=0 00:04:18.754 12:18:12 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:18.754 12:18:12 -- json_config/json_config.sh@370 -- # [[ -n 1147026 ]] 00:04:18.754 12:18:12 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:18.754 12:18:12 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:18.754 12:18:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:18.754 12:18:12 -- common/autotest_common.sh@10 -- # set +x 00:04:18.754 12:18:12 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:18.754 12:18:12 -- json_config/json_config.sh@246 -- # uname -s 00:04:18.754 12:18:12 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:18.754 12:18:12 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:18.754 12:18:12 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:18.754 12:18:12 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:18.754 12:18:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:18.754 12:18:12 -- common/autotest_common.sh@10 -- # set +x 00:04:18.754 12:18:12 -- json_config/json_config.sh@376 -- # killprocess 1147026 00:04:18.754 12:18:12 -- common/autotest_common.sh@926 -- # '[' -z 1147026 ']' 00:04:18.754 12:18:12 -- common/autotest_common.sh@930 -- # kill -0 1147026 00:04:18.754 12:18:12 -- common/autotest_common.sh@931 -- # uname 00:04:18.754 12:18:12 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:18.754 12:18:12 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1147026 00:04:18.754 12:18:12 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:18.754 12:18:12 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:18.754 12:18:12 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1147026' 00:04:18.754 killing process with pid 1147026 00:04:18.754 12:18:12 -- common/autotest_common.sh@945 -- # kill 1147026 00:04:18.754 12:18:12 -- common/autotest_common.sh@950 -- # wait 1147026 00:04:20.652 12:18:14 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:20.652 12:18:14 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:20.652 12:18:14 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:20.652 12:18:14 -- common/autotest_common.sh@10 -- # set +x 00:04:20.652 12:18:14 -- json_config/json_config.sh@381 -- # return 0 00:04:20.652 12:18:14 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:20.652 INFO: Success 00:04:20.652 00:04:20.652 real 0m15.979s 00:04:20.652 user 0m18.241s 00:04:20.652 sys 0m2.050s 00:04:20.652 12:18:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:20.652 12:18:14 -- common/autotest_common.sh@10 -- # set +x 00:04:20.652 ************************************ 00:04:20.652 END TEST json_config 00:04:20.652 ************************************ 00:04:20.652 12:18:14 -- spdk/autotest.sh@179 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:20.652 12:18:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:20.652 12:18:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:20.652 12:18:14 -- common/autotest_common.sh@10 -- # set +x 00:04:20.652 ************************************ 00:04:20.652 START TEST json_config_extra_key 00:04:20.652 ************************************ 00:04:20.652 12:18:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:20.652 12:18:14 -- nvmf/common.sh@7 -- # uname -s 00:04:20.652 12:18:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:20.652 12:18:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:20.652 12:18:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:20.652 12:18:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:20.652 12:18:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:20.652 12:18:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:20.652 12:18:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:20.652 12:18:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:20.652 12:18:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:20.652 12:18:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:20.652 12:18:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:20.652 12:18:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:20.652 12:18:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:20.652 12:18:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:20.652 12:18:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:20.652 12:18:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:20.652 12:18:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:20.652 12:18:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:20.652 12:18:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:20.652 12:18:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.652 12:18:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.652 12:18:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.652 12:18:14 -- paths/export.sh@5 -- # export PATH 00:04:20.652 12:18:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.652 12:18:14 -- nvmf/common.sh@46 -- # : 0 00:04:20.652 12:18:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:20.652 12:18:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:20.652 12:18:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:20.652 12:18:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:20.652 12:18:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:20.652 12:18:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:20.652 12:18:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:20.652 12:18:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:20.652 INFO: launching applications... 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=1148433 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:20.652 Waiting for target to run... 00:04:20.652 12:18:14 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 1148433 /var/tmp/spdk_tgt.sock 00:04:20.652 12:18:14 -- common/autotest_common.sh@819 -- # '[' -z 1148433 ']' 00:04:20.652 12:18:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:20.652 12:18:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:20.652 12:18:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:20.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:20.652 12:18:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:20.652 12:18:14 -- common/autotest_common.sh@10 -- # set +x 00:04:20.652 [2024-07-12 12:18:14.336432] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:20.652 [2024-07-12 12:18:14.336520] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1148433 ] 00:04:20.652 EAL: No free 2048 kB hugepages reported on node 1 00:04:20.910 [2024-07-12 12:18:14.827286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:21.167 [2024-07-12 12:18:14.924200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:21.167 [2024-07-12 12:18:14.924371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.425 12:18:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:21.425 12:18:15 -- common/autotest_common.sh@852 -- # return 0 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:21.425 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:21.425 INFO: shutting down applications... 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 1148433 ]] 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 1148433 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1148433 00:04:21.425 12:18:15 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:21.989 12:18:15 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:21.989 12:18:15 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:21.989 12:18:15 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1148433 00:04:21.989 12:18:15 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@50 -- # kill -0 1148433 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:22.556 SPDK target shutdown done 00:04:22.556 12:18:16 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:22.556 Success 00:04:22.556 00:04:22.556 real 0m2.028s 00:04:22.556 user 0m1.376s 00:04:22.556 sys 0m0.582s 00:04:22.556 12:18:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:22.556 12:18:16 -- common/autotest_common.sh@10 -- # set +x 00:04:22.556 ************************************ 00:04:22.556 END TEST json_config_extra_key 00:04:22.556 ************************************ 00:04:22.556 12:18:16 -- spdk/autotest.sh@180 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:22.556 12:18:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:22.556 12:18:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:22.556 12:18:16 -- common/autotest_common.sh@10 -- # set +x 00:04:22.556 ************************************ 00:04:22.556 START TEST alias_rpc 00:04:22.556 ************************************ 00:04:22.556 12:18:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:22.556 * Looking for test storage... 00:04:22.556 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:22.556 12:18:16 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:22.556 12:18:16 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=1148753 00:04:22.556 12:18:16 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:22.556 12:18:16 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 1148753 00:04:22.556 12:18:16 -- common/autotest_common.sh@819 -- # '[' -z 1148753 ']' 00:04:22.556 12:18:16 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:22.556 12:18:16 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:22.556 12:18:16 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:22.556 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:22.556 12:18:16 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:22.556 12:18:16 -- common/autotest_common.sh@10 -- # set +x 00:04:22.556 [2024-07-12 12:18:16.391154] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:22.556 [2024-07-12 12:18:16.391260] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1148753 ] 00:04:22.556 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.556 [2024-07-12 12:18:16.447290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:22.814 [2024-07-12 12:18:16.552276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:22.814 [2024-07-12 12:18:16.552450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:23.747 12:18:17 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:23.747 12:18:17 -- common/autotest_common.sh@852 -- # return 0 00:04:23.747 12:18:17 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:23.747 12:18:17 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 1148753 00:04:23.747 12:18:17 -- common/autotest_common.sh@926 -- # '[' -z 1148753 ']' 00:04:23.747 12:18:17 -- common/autotest_common.sh@930 -- # kill -0 1148753 00:04:23.747 12:18:17 -- common/autotest_common.sh@931 -- # uname 00:04:23.747 12:18:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:23.747 12:18:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1148753 00:04:23.747 12:18:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:23.747 12:18:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:23.747 12:18:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1148753' 00:04:23.747 killing process with pid 1148753 00:04:23.747 12:18:17 -- common/autotest_common.sh@945 -- # kill 1148753 00:04:23.747 12:18:17 -- common/autotest_common.sh@950 -- # wait 1148753 00:04:24.311 00:04:24.311 real 0m1.762s 00:04:24.311 user 0m2.011s 00:04:24.311 sys 0m0.445s 00:04:24.311 12:18:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:24.311 12:18:18 -- common/autotest_common.sh@10 -- # set +x 00:04:24.311 ************************************ 00:04:24.311 END TEST alias_rpc 00:04:24.311 ************************************ 00:04:24.311 12:18:18 -- spdk/autotest.sh@182 -- # [[ 0 -eq 0 ]] 00:04:24.311 12:18:18 -- spdk/autotest.sh@183 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:24.311 12:18:18 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:24.311 12:18:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:24.311 12:18:18 -- common/autotest_common.sh@10 -- # set +x 00:04:24.311 ************************************ 00:04:24.312 START TEST spdkcli_tcp 00:04:24.312 ************************************ 00:04:24.312 12:18:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:24.312 * Looking for test storage... 00:04:24.312 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:24.312 12:18:18 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:24.312 12:18:18 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:24.312 12:18:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:04:24.312 12:18:18 -- common/autotest_common.sh@10 -- # set +x 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=1149023 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:24.312 12:18:18 -- spdkcli/tcp.sh@27 -- # waitforlisten 1149023 00:04:24.312 12:18:18 -- common/autotest_common.sh@819 -- # '[' -z 1149023 ']' 00:04:24.312 12:18:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.312 12:18:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:24.312 12:18:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.312 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.312 12:18:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:24.312 12:18:18 -- common/autotest_common.sh@10 -- # set +x 00:04:24.312 [2024-07-12 12:18:18.183879] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:24.312 [2024-07-12 12:18:18.183966] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1149023 ] 00:04:24.312 EAL: No free 2048 kB hugepages reported on node 1 00:04:24.569 [2024-07-12 12:18:18.246646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:24.569 [2024-07-12 12:18:18.368319] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:24.569 [2024-07-12 12:18:18.368498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:24.569 [2024-07-12 12:18:18.368504] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.502 12:18:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:25.502 12:18:19 -- common/autotest_common.sh@852 -- # return 0 00:04:25.502 12:18:19 -- spdkcli/tcp.sh@31 -- # socat_pid=1149084 00:04:25.502 12:18:19 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:25.502 12:18:19 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:25.502 [ 00:04:25.502 "bdev_malloc_delete", 00:04:25.502 "bdev_malloc_create", 00:04:25.502 "bdev_null_resize", 00:04:25.502 "bdev_null_delete", 00:04:25.502 "bdev_null_create", 00:04:25.502 "bdev_nvme_cuse_unregister", 00:04:25.502 "bdev_nvme_cuse_register", 00:04:25.502 "bdev_opal_new_user", 00:04:25.502 "bdev_opal_set_lock_state", 00:04:25.502 "bdev_opal_delete", 00:04:25.502 "bdev_opal_get_info", 00:04:25.502 "bdev_opal_create", 00:04:25.502 "bdev_nvme_opal_revert", 00:04:25.502 "bdev_nvme_opal_init", 00:04:25.502 "bdev_nvme_send_cmd", 00:04:25.502 "bdev_nvme_get_path_iostat", 00:04:25.502 "bdev_nvme_get_mdns_discovery_info", 00:04:25.502 "bdev_nvme_stop_mdns_discovery", 00:04:25.502 "bdev_nvme_start_mdns_discovery", 00:04:25.502 "bdev_nvme_set_multipath_policy", 00:04:25.502 "bdev_nvme_set_preferred_path", 00:04:25.502 "bdev_nvme_get_io_paths", 00:04:25.502 "bdev_nvme_remove_error_injection", 00:04:25.502 "bdev_nvme_add_error_injection", 00:04:25.502 "bdev_nvme_get_discovery_info", 00:04:25.502 "bdev_nvme_stop_discovery", 00:04:25.502 "bdev_nvme_start_discovery", 00:04:25.502 "bdev_nvme_get_controller_health_info", 00:04:25.502 "bdev_nvme_disable_controller", 00:04:25.502 "bdev_nvme_enable_controller", 00:04:25.502 "bdev_nvme_reset_controller", 00:04:25.502 "bdev_nvme_get_transport_statistics", 00:04:25.502 "bdev_nvme_apply_firmware", 00:04:25.502 "bdev_nvme_detach_controller", 00:04:25.502 "bdev_nvme_get_controllers", 00:04:25.502 "bdev_nvme_attach_controller", 00:04:25.502 "bdev_nvme_set_hotplug", 00:04:25.502 "bdev_nvme_set_options", 00:04:25.502 "bdev_passthru_delete", 00:04:25.502 "bdev_passthru_create", 00:04:25.502 "bdev_lvol_grow_lvstore", 00:04:25.502 "bdev_lvol_get_lvols", 00:04:25.502 "bdev_lvol_get_lvstores", 00:04:25.502 "bdev_lvol_delete", 00:04:25.502 "bdev_lvol_set_read_only", 00:04:25.502 "bdev_lvol_resize", 00:04:25.502 "bdev_lvol_decouple_parent", 00:04:25.502 "bdev_lvol_inflate", 00:04:25.502 "bdev_lvol_rename", 00:04:25.502 "bdev_lvol_clone_bdev", 00:04:25.502 "bdev_lvol_clone", 00:04:25.502 "bdev_lvol_snapshot", 00:04:25.502 "bdev_lvol_create", 00:04:25.502 "bdev_lvol_delete_lvstore", 00:04:25.502 "bdev_lvol_rename_lvstore", 00:04:25.502 "bdev_lvol_create_lvstore", 00:04:25.502 "bdev_raid_set_options", 00:04:25.502 "bdev_raid_remove_base_bdev", 00:04:25.502 "bdev_raid_add_base_bdev", 00:04:25.502 "bdev_raid_delete", 00:04:25.502 "bdev_raid_create", 00:04:25.502 "bdev_raid_get_bdevs", 00:04:25.502 "bdev_error_inject_error", 00:04:25.502 "bdev_error_delete", 00:04:25.502 "bdev_error_create", 00:04:25.502 "bdev_split_delete", 00:04:25.502 "bdev_split_create", 00:04:25.502 "bdev_delay_delete", 00:04:25.502 "bdev_delay_create", 00:04:25.502 "bdev_delay_update_latency", 00:04:25.502 "bdev_zone_block_delete", 00:04:25.502 "bdev_zone_block_create", 00:04:25.502 "blobfs_create", 00:04:25.502 "blobfs_detect", 00:04:25.502 "blobfs_set_cache_size", 00:04:25.502 "bdev_aio_delete", 00:04:25.502 "bdev_aio_rescan", 00:04:25.502 "bdev_aio_create", 00:04:25.502 "bdev_ftl_set_property", 00:04:25.502 "bdev_ftl_get_properties", 00:04:25.502 "bdev_ftl_get_stats", 00:04:25.502 "bdev_ftl_unmap", 00:04:25.502 "bdev_ftl_unload", 00:04:25.502 "bdev_ftl_delete", 00:04:25.502 "bdev_ftl_load", 00:04:25.502 "bdev_ftl_create", 00:04:25.502 "bdev_virtio_attach_controller", 00:04:25.502 "bdev_virtio_scsi_get_devices", 00:04:25.502 "bdev_virtio_detach_controller", 00:04:25.502 "bdev_virtio_blk_set_hotplug", 00:04:25.502 "bdev_iscsi_delete", 00:04:25.502 "bdev_iscsi_create", 00:04:25.502 "bdev_iscsi_set_options", 00:04:25.502 "accel_error_inject_error", 00:04:25.502 "ioat_scan_accel_module", 00:04:25.502 "dsa_scan_accel_module", 00:04:25.502 "iaa_scan_accel_module", 00:04:25.502 "iscsi_set_options", 00:04:25.502 "iscsi_get_auth_groups", 00:04:25.502 "iscsi_auth_group_remove_secret", 00:04:25.502 "iscsi_auth_group_add_secret", 00:04:25.502 "iscsi_delete_auth_group", 00:04:25.502 "iscsi_create_auth_group", 00:04:25.502 "iscsi_set_discovery_auth", 00:04:25.502 "iscsi_get_options", 00:04:25.502 "iscsi_target_node_request_logout", 00:04:25.502 "iscsi_target_node_set_redirect", 00:04:25.502 "iscsi_target_node_set_auth", 00:04:25.502 "iscsi_target_node_add_lun", 00:04:25.502 "iscsi_get_connections", 00:04:25.502 "iscsi_portal_group_set_auth", 00:04:25.502 "iscsi_start_portal_group", 00:04:25.502 "iscsi_delete_portal_group", 00:04:25.502 "iscsi_create_portal_group", 00:04:25.502 "iscsi_get_portal_groups", 00:04:25.503 "iscsi_delete_target_node", 00:04:25.503 "iscsi_target_node_remove_pg_ig_maps", 00:04:25.503 "iscsi_target_node_add_pg_ig_maps", 00:04:25.503 "iscsi_create_target_node", 00:04:25.503 "iscsi_get_target_nodes", 00:04:25.503 "iscsi_delete_initiator_group", 00:04:25.503 "iscsi_initiator_group_remove_initiators", 00:04:25.503 "iscsi_initiator_group_add_initiators", 00:04:25.503 "iscsi_create_initiator_group", 00:04:25.503 "iscsi_get_initiator_groups", 00:04:25.503 "nvmf_set_crdt", 00:04:25.503 "nvmf_set_config", 00:04:25.503 "nvmf_set_max_subsystems", 00:04:25.503 "nvmf_subsystem_get_listeners", 00:04:25.503 "nvmf_subsystem_get_qpairs", 00:04:25.503 "nvmf_subsystem_get_controllers", 00:04:25.503 "nvmf_get_stats", 00:04:25.503 "nvmf_get_transports", 00:04:25.503 "nvmf_create_transport", 00:04:25.503 "nvmf_get_targets", 00:04:25.503 "nvmf_delete_target", 00:04:25.503 "nvmf_create_target", 00:04:25.503 "nvmf_subsystem_allow_any_host", 00:04:25.503 "nvmf_subsystem_remove_host", 00:04:25.503 "nvmf_subsystem_add_host", 00:04:25.503 "nvmf_subsystem_remove_ns", 00:04:25.503 "nvmf_subsystem_add_ns", 00:04:25.503 "nvmf_subsystem_listener_set_ana_state", 00:04:25.503 "nvmf_discovery_get_referrals", 00:04:25.503 "nvmf_discovery_remove_referral", 00:04:25.503 "nvmf_discovery_add_referral", 00:04:25.503 "nvmf_subsystem_remove_listener", 00:04:25.503 "nvmf_subsystem_add_listener", 00:04:25.503 "nvmf_delete_subsystem", 00:04:25.503 "nvmf_create_subsystem", 00:04:25.503 "nvmf_get_subsystems", 00:04:25.503 "env_dpdk_get_mem_stats", 00:04:25.503 "nbd_get_disks", 00:04:25.503 "nbd_stop_disk", 00:04:25.503 "nbd_start_disk", 00:04:25.503 "ublk_recover_disk", 00:04:25.503 "ublk_get_disks", 00:04:25.503 "ublk_stop_disk", 00:04:25.503 "ublk_start_disk", 00:04:25.503 "ublk_destroy_target", 00:04:25.503 "ublk_create_target", 00:04:25.503 "virtio_blk_create_transport", 00:04:25.503 "virtio_blk_get_transports", 00:04:25.503 "vhost_controller_set_coalescing", 00:04:25.503 "vhost_get_controllers", 00:04:25.503 "vhost_delete_controller", 00:04:25.503 "vhost_create_blk_controller", 00:04:25.503 "vhost_scsi_controller_remove_target", 00:04:25.503 "vhost_scsi_controller_add_target", 00:04:25.503 "vhost_start_scsi_controller", 00:04:25.503 "vhost_create_scsi_controller", 00:04:25.503 "thread_set_cpumask", 00:04:25.503 "framework_get_scheduler", 00:04:25.503 "framework_set_scheduler", 00:04:25.503 "framework_get_reactors", 00:04:25.503 "thread_get_io_channels", 00:04:25.503 "thread_get_pollers", 00:04:25.503 "thread_get_stats", 00:04:25.503 "framework_monitor_context_switch", 00:04:25.503 "spdk_kill_instance", 00:04:25.503 "log_enable_timestamps", 00:04:25.503 "log_get_flags", 00:04:25.503 "log_clear_flag", 00:04:25.503 "log_set_flag", 00:04:25.503 "log_get_level", 00:04:25.503 "log_set_level", 00:04:25.503 "log_get_print_level", 00:04:25.503 "log_set_print_level", 00:04:25.503 "framework_enable_cpumask_locks", 00:04:25.503 "framework_disable_cpumask_locks", 00:04:25.503 "framework_wait_init", 00:04:25.503 "framework_start_init", 00:04:25.503 "scsi_get_devices", 00:04:25.503 "bdev_get_histogram", 00:04:25.503 "bdev_enable_histogram", 00:04:25.503 "bdev_set_qos_limit", 00:04:25.503 "bdev_set_qd_sampling_period", 00:04:25.503 "bdev_get_bdevs", 00:04:25.503 "bdev_reset_iostat", 00:04:25.503 "bdev_get_iostat", 00:04:25.503 "bdev_examine", 00:04:25.503 "bdev_wait_for_examine", 00:04:25.503 "bdev_set_options", 00:04:25.503 "notify_get_notifications", 00:04:25.503 "notify_get_types", 00:04:25.503 "accel_get_stats", 00:04:25.503 "accel_set_options", 00:04:25.503 "accel_set_driver", 00:04:25.503 "accel_crypto_key_destroy", 00:04:25.503 "accel_crypto_keys_get", 00:04:25.503 "accel_crypto_key_create", 00:04:25.503 "accel_assign_opc", 00:04:25.503 "accel_get_module_info", 00:04:25.503 "accel_get_opc_assignments", 00:04:25.503 "vmd_rescan", 00:04:25.503 "vmd_remove_device", 00:04:25.503 "vmd_enable", 00:04:25.503 "sock_set_default_impl", 00:04:25.503 "sock_impl_set_options", 00:04:25.503 "sock_impl_get_options", 00:04:25.503 "iobuf_get_stats", 00:04:25.503 "iobuf_set_options", 00:04:25.503 "framework_get_pci_devices", 00:04:25.503 "framework_get_config", 00:04:25.503 "framework_get_subsystems", 00:04:25.503 "trace_get_info", 00:04:25.503 "trace_get_tpoint_group_mask", 00:04:25.503 "trace_disable_tpoint_group", 00:04:25.503 "trace_enable_tpoint_group", 00:04:25.503 "trace_clear_tpoint_mask", 00:04:25.503 "trace_set_tpoint_mask", 00:04:25.503 "spdk_get_version", 00:04:25.503 "rpc_get_methods" 00:04:25.503 ] 00:04:25.503 12:18:19 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:25.503 12:18:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:04:25.503 12:18:19 -- common/autotest_common.sh@10 -- # set +x 00:04:25.503 12:18:19 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:25.503 12:18:19 -- spdkcli/tcp.sh@38 -- # killprocess 1149023 00:04:25.503 12:18:19 -- common/autotest_common.sh@926 -- # '[' -z 1149023 ']' 00:04:25.503 12:18:19 -- common/autotest_common.sh@930 -- # kill -0 1149023 00:04:25.503 12:18:19 -- common/autotest_common.sh@931 -- # uname 00:04:25.503 12:18:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:25.503 12:18:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1149023 00:04:25.503 12:18:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:25.503 12:18:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:25.503 12:18:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1149023' 00:04:25.503 killing process with pid 1149023 00:04:25.503 12:18:19 -- common/autotest_common.sh@945 -- # kill 1149023 00:04:25.503 12:18:19 -- common/autotest_common.sh@950 -- # wait 1149023 00:04:26.068 00:04:26.068 real 0m1.757s 00:04:26.068 user 0m3.347s 00:04:26.068 sys 0m0.475s 00:04:26.068 12:18:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:26.068 12:18:19 -- common/autotest_common.sh@10 -- # set +x 00:04:26.068 ************************************ 00:04:26.068 END TEST spdkcli_tcp 00:04:26.068 ************************************ 00:04:26.068 12:18:19 -- spdk/autotest.sh@186 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:26.068 12:18:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:26.068 12:18:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:26.068 12:18:19 -- common/autotest_common.sh@10 -- # set +x 00:04:26.068 ************************************ 00:04:26.068 START TEST dpdk_mem_utility 00:04:26.068 ************************************ 00:04:26.068 12:18:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:26.068 * Looking for test storage... 00:04:26.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:26.068 12:18:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:26.068 12:18:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=1149281 00:04:26.068 12:18:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:26.068 12:18:19 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 1149281 00:04:26.068 12:18:19 -- common/autotest_common.sh@819 -- # '[' -z 1149281 ']' 00:04:26.068 12:18:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:26.068 12:18:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:26.068 12:18:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:26.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:26.068 12:18:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:26.068 12:18:19 -- common/autotest_common.sh@10 -- # set +x 00:04:26.068 [2024-07-12 12:18:19.966795] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:26.068 [2024-07-12 12:18:19.966893] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1149281 ] 00:04:26.326 EAL: No free 2048 kB hugepages reported on node 1 00:04:26.326 [2024-07-12 12:18:20.027755] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:26.326 [2024-07-12 12:18:20.135030] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:26.326 [2024-07-12 12:18:20.135200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:27.258 12:18:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:27.259 12:18:20 -- common/autotest_common.sh@852 -- # return 0 00:04:27.259 12:18:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:27.259 12:18:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:27.259 12:18:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:27.259 12:18:20 -- common/autotest_common.sh@10 -- # set +x 00:04:27.259 { 00:04:27.259 "filename": "/tmp/spdk_mem_dump.txt" 00:04:27.259 } 00:04:27.259 12:18:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:27.259 12:18:20 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:27.259 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:27.259 1 heaps totaling size 814.000000 MiB 00:04:27.259 size: 814.000000 MiB heap id: 0 00:04:27.259 end heaps---------- 00:04:27.259 8 mempools totaling size 598.116089 MiB 00:04:27.259 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:27.259 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:27.259 size: 84.521057 MiB name: bdev_io_1149281 00:04:27.259 size: 51.011292 MiB name: evtpool_1149281 00:04:27.259 size: 50.003479 MiB name: msgpool_1149281 00:04:27.259 size: 21.763794 MiB name: PDU_Pool 00:04:27.259 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:27.259 size: 0.026123 MiB name: Session_Pool 00:04:27.259 end mempools------- 00:04:27.259 6 memzones totaling size 4.142822 MiB 00:04:27.259 size: 1.000366 MiB name: RG_ring_0_1149281 00:04:27.259 size: 1.000366 MiB name: RG_ring_1_1149281 00:04:27.259 size: 1.000366 MiB name: RG_ring_4_1149281 00:04:27.259 size: 1.000366 MiB name: RG_ring_5_1149281 00:04:27.259 size: 0.125366 MiB name: RG_ring_2_1149281 00:04:27.259 size: 0.015991 MiB name: RG_ring_3_1149281 00:04:27.259 end memzones------- 00:04:27.259 12:18:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:27.259 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:27.259 list of free elements. size: 12.519348 MiB 00:04:27.259 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:27.259 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:27.259 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:27.259 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:27.259 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:27.259 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:27.259 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:27.259 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:27.259 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:27.259 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:27.259 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:27.259 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:27.259 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:27.259 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:27.259 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:27.259 list of standard malloc elements. size: 199.218079 MiB 00:04:27.259 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:27.259 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:27.259 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:27.259 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:27.259 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:27.259 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:27.259 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:27.259 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:27.259 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:27.259 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:27.259 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:27.259 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:27.259 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:27.259 list of memzone associated elements. size: 602.262573 MiB 00:04:27.259 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:27.259 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:27.259 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:27.259 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:27.259 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:27.259 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_1149281_0 00:04:27.259 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:27.259 associated memzone info: size: 48.002930 MiB name: MP_evtpool_1149281_0 00:04:27.259 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:27.259 associated memzone info: size: 48.002930 MiB name: MP_msgpool_1149281_0 00:04:27.259 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:27.259 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:27.259 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:27.259 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:27.259 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:27.259 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_1149281 00:04:27.259 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:27.259 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_1149281 00:04:27.259 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:27.259 associated memzone info: size: 1.007996 MiB name: MP_evtpool_1149281 00:04:27.259 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:27.259 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:27.259 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:27.259 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:27.259 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:27.259 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:27.259 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:27.259 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:27.259 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:27.259 associated memzone info: size: 1.000366 MiB name: RG_ring_0_1149281 00:04:27.259 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:27.259 associated memzone info: size: 1.000366 MiB name: RG_ring_1_1149281 00:04:27.259 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:27.259 associated memzone info: size: 1.000366 MiB name: RG_ring_4_1149281 00:04:27.259 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:27.259 associated memzone info: size: 1.000366 MiB name: RG_ring_5_1149281 00:04:27.259 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:27.259 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_1149281 00:04:27.259 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:27.259 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:27.259 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:27.259 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:27.259 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:27.259 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:27.259 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:27.259 associated memzone info: size: 0.125366 MiB name: RG_ring_2_1149281 00:04:27.259 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:27.259 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:27.259 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:27.259 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:27.259 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:27.259 associated memzone info: size: 0.015991 MiB name: RG_ring_3_1149281 00:04:27.259 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:27.259 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:27.259 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:27.259 associated memzone info: size: 0.000183 MiB name: MP_msgpool_1149281 00:04:27.259 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:27.259 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_1149281 00:04:27.259 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:27.259 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:27.259 12:18:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:27.259 12:18:21 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 1149281 00:04:27.259 12:18:21 -- common/autotest_common.sh@926 -- # '[' -z 1149281 ']' 00:04:27.259 12:18:21 -- common/autotest_common.sh@930 -- # kill -0 1149281 00:04:27.259 12:18:21 -- common/autotest_common.sh@931 -- # uname 00:04:27.259 12:18:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:27.259 12:18:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1149281 00:04:27.260 12:18:21 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:27.260 12:18:21 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:27.260 12:18:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1149281' 00:04:27.260 killing process with pid 1149281 00:04:27.260 12:18:21 -- common/autotest_common.sh@945 -- # kill 1149281 00:04:27.260 12:18:21 -- common/autotest_common.sh@950 -- # wait 1149281 00:04:27.824 00:04:27.824 real 0m1.671s 00:04:27.825 user 0m1.864s 00:04:27.825 sys 0m0.431s 00:04:27.825 12:18:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:27.825 12:18:21 -- common/autotest_common.sh@10 -- # set +x 00:04:27.825 ************************************ 00:04:27.825 END TEST dpdk_mem_utility 00:04:27.825 ************************************ 00:04:27.825 12:18:21 -- spdk/autotest.sh@187 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:27.825 12:18:21 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:27.825 12:18:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:27.825 12:18:21 -- common/autotest_common.sh@10 -- # set +x 00:04:27.825 ************************************ 00:04:27.825 START TEST event 00:04:27.825 ************************************ 00:04:27.825 12:18:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:27.825 * Looking for test storage... 00:04:27.825 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:27.825 12:18:21 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:27.825 12:18:21 -- bdev/nbd_common.sh@6 -- # set -e 00:04:27.825 12:18:21 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:27.825 12:18:21 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:04:27.825 12:18:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:27.825 12:18:21 -- common/autotest_common.sh@10 -- # set +x 00:04:27.825 ************************************ 00:04:27.825 START TEST event_perf 00:04:27.825 ************************************ 00:04:27.825 12:18:21 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:27.825 Running I/O for 1 seconds...[2024-07-12 12:18:21.625108] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:27.825 [2024-07-12 12:18:21.625204] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1149599 ] 00:04:27.825 EAL: No free 2048 kB hugepages reported on node 1 00:04:27.825 [2024-07-12 12:18:21.683111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:28.083 [2024-07-12 12:18:21.793697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:28.083 [2024-07-12 12:18:21.793750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:28.083 [2024-07-12 12:18:21.793819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:28.083 [2024-07-12 12:18:21.793821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.015 Running I/O for 1 seconds... 00:04:29.015 lcore 0: 230259 00:04:29.015 lcore 1: 230258 00:04:29.015 lcore 2: 230259 00:04:29.015 lcore 3: 230260 00:04:29.015 done. 00:04:29.015 00:04:29.015 real 0m1.305s 00:04:29.015 user 0m4.216s 00:04:29.015 sys 0m0.083s 00:04:29.015 12:18:22 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:29.015 12:18:22 -- common/autotest_common.sh@10 -- # set +x 00:04:29.015 ************************************ 00:04:29.015 END TEST event_perf 00:04:29.015 ************************************ 00:04:29.274 12:18:22 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:29.274 12:18:22 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:29.274 12:18:22 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:29.274 12:18:22 -- common/autotest_common.sh@10 -- # set +x 00:04:29.274 ************************************ 00:04:29.274 START TEST event_reactor 00:04:29.274 ************************************ 00:04:29.274 12:18:22 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:29.274 [2024-07-12 12:18:22.954809] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:29.274 [2024-07-12 12:18:22.954903] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1149764 ] 00:04:29.274 EAL: No free 2048 kB hugepages reported on node 1 00:04:29.274 [2024-07-12 12:18:23.017391] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:29.274 [2024-07-12 12:18:23.134161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.644 test_start 00:04:30.644 oneshot 00:04:30.644 tick 100 00:04:30.644 tick 100 00:04:30.644 tick 250 00:04:30.644 tick 100 00:04:30.644 tick 100 00:04:30.644 tick 250 00:04:30.644 tick 100 00:04:30.644 tick 500 00:04:30.644 tick 100 00:04:30.644 tick 100 00:04:30.644 tick 250 00:04:30.644 tick 100 00:04:30.644 tick 100 00:04:30.644 test_end 00:04:30.644 00:04:30.644 real 0m1.314s 00:04:30.644 user 0m1.221s 00:04:30.644 sys 0m0.088s 00:04:30.644 12:18:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:30.644 12:18:24 -- common/autotest_common.sh@10 -- # set +x 00:04:30.644 ************************************ 00:04:30.644 END TEST event_reactor 00:04:30.644 ************************************ 00:04:30.644 12:18:24 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:30.644 12:18:24 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:04:30.644 12:18:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:30.644 12:18:24 -- common/autotest_common.sh@10 -- # set +x 00:04:30.644 ************************************ 00:04:30.644 START TEST event_reactor_perf 00:04:30.644 ************************************ 00:04:30.644 12:18:24 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:30.644 [2024-07-12 12:18:24.290375] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:30.645 [2024-07-12 12:18:24.290458] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1149924 ] 00:04:30.645 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.645 [2024-07-12 12:18:24.349750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.645 [2024-07-12 12:18:24.467210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.016 test_start 00:04:32.016 test_end 00:04:32.016 Performance: 358115 events per second 00:04:32.016 00:04:32.016 real 0m1.311s 00:04:32.016 user 0m1.229s 00:04:32.016 sys 0m0.077s 00:04:32.016 12:18:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:32.016 12:18:25 -- common/autotest_common.sh@10 -- # set +x 00:04:32.016 ************************************ 00:04:32.016 END TEST event_reactor_perf 00:04:32.016 ************************************ 00:04:32.016 12:18:25 -- event/event.sh@49 -- # uname -s 00:04:32.016 12:18:25 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:32.016 12:18:25 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:32.016 12:18:25 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:32.016 12:18:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:32.016 12:18:25 -- common/autotest_common.sh@10 -- # set +x 00:04:32.016 ************************************ 00:04:32.016 START TEST event_scheduler 00:04:32.016 ************************************ 00:04:32.016 12:18:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:32.016 * Looking for test storage... 00:04:32.016 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:32.016 12:18:25 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:32.016 12:18:25 -- scheduler/scheduler.sh@35 -- # scheduler_pid=1150105 00:04:32.016 12:18:25 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:32.016 12:18:25 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:32.016 12:18:25 -- scheduler/scheduler.sh@37 -- # waitforlisten 1150105 00:04:32.016 12:18:25 -- common/autotest_common.sh@819 -- # '[' -z 1150105 ']' 00:04:32.016 12:18:25 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.016 12:18:25 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:32.016 12:18:25 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.016 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.016 12:18:25 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:32.016 12:18:25 -- common/autotest_common.sh@10 -- # set +x 00:04:32.016 [2024-07-12 12:18:25.705454] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:32.016 [2024-07-12 12:18:25.705533] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1150105 ] 00:04:32.016 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.016 [2024-07-12 12:18:25.762901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:32.016 [2024-07-12 12:18:25.869433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.016 [2024-07-12 12:18:25.869490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:32.016 [2024-07-12 12:18:25.869555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:32.016 [2024-07-12 12:18:25.869558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:32.016 12:18:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:32.016 12:18:25 -- common/autotest_common.sh@852 -- # return 0 00:04:32.016 12:18:25 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:32.016 12:18:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.016 12:18:25 -- common/autotest_common.sh@10 -- # set +x 00:04:32.016 POWER: Env isn't set yet! 00:04:32.016 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:32.016 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:32.016 POWER: Cannot get available frequencies of lcore 0 00:04:32.016 POWER: Attempting to initialise PSTAT power management... 00:04:32.016 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:32.016 POWER: Initialized successfully for lcore 0 power management 00:04:32.016 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:32.016 POWER: Initialized successfully for lcore 1 power management 00:04:32.016 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:32.016 POWER: Initialized successfully for lcore 2 power management 00:04:32.275 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:32.275 POWER: Initialized successfully for lcore 3 power management 00:04:32.275 [2024-07-12 12:18:25.936075] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:32.275 [2024-07-12 12:18:25.936093] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:32.275 [2024-07-12 12:18:25.936104] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:32.275 12:18:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.275 12:18:25 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:32.275 12:18:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.275 12:18:25 -- common/autotest_common.sh@10 -- # set +x 00:04:32.275 [2024-07-12 12:18:26.040519] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:32.275 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.275 12:18:26 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:32.275 12:18:26 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:32.275 12:18:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:32.275 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.275 ************************************ 00:04:32.275 START TEST scheduler_create_thread 00:04:32.275 ************************************ 00:04:32.275 12:18:26 -- common/autotest_common.sh@1104 -- # scheduler_create_thread 00:04:32.275 12:18:26 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:32.275 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.275 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.275 2 00:04:32.275 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.275 12:18:26 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:32.275 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.275 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.275 3 00:04:32.275 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.275 12:18:26 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 4 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 5 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 6 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 7 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 8 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 9 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 10 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:32.276 12:18:26 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:32.276 12:18:26 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:32.276 12:18:26 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:32.276 12:18:26 -- common/autotest_common.sh@10 -- # set +x 00:04:34.213 12:18:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:34.213 12:18:27 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:34.213 12:18:27 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:34.213 12:18:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:34.213 12:18:27 -- common/autotest_common.sh@10 -- # set +x 00:04:34.777 12:18:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:34.777 00:04:34.777 real 0m2.618s 00:04:34.777 user 0m0.012s 00:04:34.778 sys 0m0.001s 00:04:34.778 12:18:28 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:34.778 12:18:28 -- common/autotest_common.sh@10 -- # set +x 00:04:34.778 ************************************ 00:04:34.778 END TEST scheduler_create_thread 00:04:34.778 ************************************ 00:04:34.778 12:18:28 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:34.778 12:18:28 -- scheduler/scheduler.sh@46 -- # killprocess 1150105 00:04:34.778 12:18:28 -- common/autotest_common.sh@926 -- # '[' -z 1150105 ']' 00:04:34.778 12:18:28 -- common/autotest_common.sh@930 -- # kill -0 1150105 00:04:34.778 12:18:28 -- common/autotest_common.sh@931 -- # uname 00:04:34.778 12:18:28 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:34.778 12:18:28 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1150105 00:04:35.035 12:18:28 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:04:35.035 12:18:28 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:04:35.035 12:18:28 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1150105' 00:04:35.035 killing process with pid 1150105 00:04:35.035 12:18:28 -- common/autotest_common.sh@945 -- # kill 1150105 00:04:35.035 12:18:28 -- common/autotest_common.sh@950 -- # wait 1150105 00:04:35.292 [2024-07-12 12:18:29.143814] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:35.550 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:35.550 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:35.550 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:35.550 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:35.550 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:35.550 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:35.550 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:35.550 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:35.550 00:04:35.550 real 0m3.799s 00:04:35.550 user 0m5.659s 00:04:35.550 sys 0m0.322s 00:04:35.550 12:18:29 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:35.550 12:18:29 -- common/autotest_common.sh@10 -- # set +x 00:04:35.550 ************************************ 00:04:35.550 END TEST event_scheduler 00:04:35.550 ************************************ 00:04:35.550 12:18:29 -- event/event.sh@51 -- # modprobe -n nbd 00:04:35.550 12:18:29 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:35.550 12:18:29 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:35.550 12:18:29 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:35.550 12:18:29 -- common/autotest_common.sh@10 -- # set +x 00:04:35.550 ************************************ 00:04:35.550 START TEST app_repeat 00:04:35.550 ************************************ 00:04:35.550 12:18:29 -- common/autotest_common.sh@1104 -- # app_repeat_test 00:04:35.550 12:18:29 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:35.550 12:18:29 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:35.550 12:18:29 -- event/event.sh@13 -- # local nbd_list 00:04:35.551 12:18:29 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:35.551 12:18:29 -- event/event.sh@14 -- # local bdev_list 00:04:35.551 12:18:29 -- event/event.sh@15 -- # local repeat_times=4 00:04:35.551 12:18:29 -- event/event.sh@17 -- # modprobe nbd 00:04:35.551 12:18:29 -- event/event.sh@19 -- # repeat_pid=1150692 00:04:35.551 12:18:29 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:35.551 12:18:29 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:35.551 12:18:29 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 1150692' 00:04:35.551 Process app_repeat pid: 1150692 00:04:35.551 12:18:29 -- event/event.sh@23 -- # for i in {0..2} 00:04:35.551 12:18:29 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:35.551 spdk_app_start Round 0 00:04:35.551 12:18:29 -- event/event.sh@25 -- # waitforlisten 1150692 /var/tmp/spdk-nbd.sock 00:04:35.551 12:18:29 -- common/autotest_common.sh@819 -- # '[' -z 1150692 ']' 00:04:35.551 12:18:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:35.551 12:18:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:35.551 12:18:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:35.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:35.551 12:18:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:35.551 12:18:29 -- common/autotest_common.sh@10 -- # set +x 00:04:35.551 [2024-07-12 12:18:29.466250] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:35.551 [2024-07-12 12:18:29.466334] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1150692 ] 00:04:35.808 EAL: No free 2048 kB hugepages reported on node 1 00:04:35.808 [2024-07-12 12:18:29.526967] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:35.808 [2024-07-12 12:18:29.631816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:35.808 [2024-07-12 12:18:29.631819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:36.740 12:18:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:36.740 12:18:30 -- common/autotest_common.sh@852 -- # return 0 00:04:36.740 12:18:30 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:36.997 Malloc0 00:04:36.997 12:18:30 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:37.255 Malloc1 00:04:37.255 12:18:31 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@12 -- # local i 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:37.255 12:18:31 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:37.513 /dev/nbd0 00:04:37.513 12:18:31 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:37.513 12:18:31 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:37.513 12:18:31 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:37.513 12:18:31 -- common/autotest_common.sh@857 -- # local i 00:04:37.513 12:18:31 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:37.513 12:18:31 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:37.513 12:18:31 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:37.513 12:18:31 -- common/autotest_common.sh@861 -- # break 00:04:37.513 12:18:31 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:37.513 12:18:31 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:37.513 12:18:31 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:37.513 1+0 records in 00:04:37.513 1+0 records out 00:04:37.513 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000188395 s, 21.7 MB/s 00:04:37.513 12:18:31 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:37.513 12:18:31 -- common/autotest_common.sh@874 -- # size=4096 00:04:37.513 12:18:31 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:37.513 12:18:31 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:37.513 12:18:31 -- common/autotest_common.sh@877 -- # return 0 00:04:37.513 12:18:31 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:37.513 12:18:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:37.513 12:18:31 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:37.770 /dev/nbd1 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:37.770 12:18:31 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:37.770 12:18:31 -- common/autotest_common.sh@857 -- # local i 00:04:37.770 12:18:31 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:37.770 12:18:31 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:37.770 12:18:31 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:37.770 12:18:31 -- common/autotest_common.sh@861 -- # break 00:04:37.770 12:18:31 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:37.770 12:18:31 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:37.770 12:18:31 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:37.770 1+0 records in 00:04:37.770 1+0 records out 00:04:37.770 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000233968 s, 17.5 MB/s 00:04:37.770 12:18:31 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:37.770 12:18:31 -- common/autotest_common.sh@874 -- # size=4096 00:04:37.770 12:18:31 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:37.770 12:18:31 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:37.770 12:18:31 -- common/autotest_common.sh@877 -- # return 0 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:37.770 12:18:31 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:38.028 { 00:04:38.028 "nbd_device": "/dev/nbd0", 00:04:38.028 "bdev_name": "Malloc0" 00:04:38.028 }, 00:04:38.028 { 00:04:38.028 "nbd_device": "/dev/nbd1", 00:04:38.028 "bdev_name": "Malloc1" 00:04:38.028 } 00:04:38.028 ]' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:38.028 { 00:04:38.028 "nbd_device": "/dev/nbd0", 00:04:38.028 "bdev_name": "Malloc0" 00:04:38.028 }, 00:04:38.028 { 00:04:38.028 "nbd_device": "/dev/nbd1", 00:04:38.028 "bdev_name": "Malloc1" 00:04:38.028 } 00:04:38.028 ]' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:38.028 /dev/nbd1' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:38.028 /dev/nbd1' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@65 -- # count=2 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@95 -- # count=2 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:38.028 256+0 records in 00:04:38.028 256+0 records out 00:04:38.028 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00495507 s, 212 MB/s 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:38.028 256+0 records in 00:04:38.028 256+0 records out 00:04:38.028 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023638 s, 44.4 MB/s 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:38.028 256+0 records in 00:04:38.028 256+0 records out 00:04:38.028 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223811 s, 46.9 MB/s 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:38.028 12:18:31 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@51 -- # local i 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:38.029 12:18:31 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@41 -- # break 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@45 -- # return 0 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:38.286 12:18:32 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:38.543 12:18:32 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:38.543 12:18:32 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:38.543 12:18:32 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:38.543 12:18:32 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@41 -- # break 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@45 -- # return 0 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:38.544 12:18:32 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@65 -- # true 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@65 -- # count=0 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@104 -- # count=0 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:38.801 12:18:32 -- bdev/nbd_common.sh@109 -- # return 0 00:04:38.801 12:18:32 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:39.058 12:18:32 -- event/event.sh@35 -- # sleep 3 00:04:39.622 [2024-07-12 12:18:33.237433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:39.622 [2024-07-12 12:18:33.352149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.622 [2024-07-12 12:18:33.352150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:39.622 [2024-07-12 12:18:33.414070] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:39.622 [2024-07-12 12:18:33.414142] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:42.145 12:18:35 -- event/event.sh@23 -- # for i in {0..2} 00:04:42.145 12:18:35 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:42.145 spdk_app_start Round 1 00:04:42.145 12:18:35 -- event/event.sh@25 -- # waitforlisten 1150692 /var/tmp/spdk-nbd.sock 00:04:42.145 12:18:35 -- common/autotest_common.sh@819 -- # '[' -z 1150692 ']' 00:04:42.145 12:18:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:42.145 12:18:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:42.145 12:18:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:42.145 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:42.145 12:18:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:42.145 12:18:35 -- common/autotest_common.sh@10 -- # set +x 00:04:42.402 12:18:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:42.402 12:18:36 -- common/autotest_common.sh@852 -- # return 0 00:04:42.402 12:18:36 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:42.660 Malloc0 00:04:42.660 12:18:36 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:42.917 Malloc1 00:04:42.917 12:18:36 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@12 -- # local i 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:42.917 12:18:36 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:43.174 /dev/nbd0 00:04:43.174 12:18:36 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:43.174 12:18:36 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:43.174 12:18:36 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:43.174 12:18:36 -- common/autotest_common.sh@857 -- # local i 00:04:43.174 12:18:36 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:43.174 12:18:36 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:43.174 12:18:36 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:43.174 12:18:36 -- common/autotest_common.sh@861 -- # break 00:04:43.174 12:18:36 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:43.174 12:18:36 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:43.174 12:18:36 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:43.174 1+0 records in 00:04:43.174 1+0 records out 00:04:43.175 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000213608 s, 19.2 MB/s 00:04:43.175 12:18:36 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.175 12:18:37 -- common/autotest_common.sh@874 -- # size=4096 00:04:43.175 12:18:37 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.175 12:18:37 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:43.175 12:18:37 -- common/autotest_common.sh@877 -- # return 0 00:04:43.175 12:18:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:43.175 12:18:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.175 12:18:37 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:43.432 /dev/nbd1 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:43.432 12:18:37 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:43.432 12:18:37 -- common/autotest_common.sh@857 -- # local i 00:04:43.432 12:18:37 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:43.432 12:18:37 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:43.432 12:18:37 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:43.432 12:18:37 -- common/autotest_common.sh@861 -- # break 00:04:43.432 12:18:37 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:43.432 12:18:37 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:43.432 12:18:37 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:43.432 1+0 records in 00:04:43.432 1+0 records out 00:04:43.432 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000171708 s, 23.9 MB/s 00:04:43.432 12:18:37 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.432 12:18:37 -- common/autotest_common.sh@874 -- # size=4096 00:04:43.432 12:18:37 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:43.432 12:18:37 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:43.432 12:18:37 -- common/autotest_common.sh@877 -- # return 0 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.432 12:18:37 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:43.689 { 00:04:43.689 "nbd_device": "/dev/nbd0", 00:04:43.689 "bdev_name": "Malloc0" 00:04:43.689 }, 00:04:43.689 { 00:04:43.689 "nbd_device": "/dev/nbd1", 00:04:43.689 "bdev_name": "Malloc1" 00:04:43.689 } 00:04:43.689 ]' 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:43.689 { 00:04:43.689 "nbd_device": "/dev/nbd0", 00:04:43.689 "bdev_name": "Malloc0" 00:04:43.689 }, 00:04:43.689 { 00:04:43.689 "nbd_device": "/dev/nbd1", 00:04:43.689 "bdev_name": "Malloc1" 00:04:43.689 } 00:04:43.689 ]' 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:43.689 /dev/nbd1' 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:43.689 /dev/nbd1' 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@65 -- # count=2 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@95 -- # count=2 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:43.689 12:18:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.690 12:18:37 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:43.690 12:18:37 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:43.690 256+0 records in 00:04:43.690 256+0 records out 00:04:43.690 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00493638 s, 212 MB/s 00:04:43.690 12:18:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:43.690 12:18:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:43.690 256+0 records in 00:04:43.690 256+0 records out 00:04:43.690 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020444 s, 51.3 MB/s 00:04:43.690 12:18:37 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:43.690 12:18:37 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:43.690 256+0 records in 00:04:43.690 256+0 records out 00:04:43.690 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234254 s, 44.8 MB/s 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@51 -- # local i 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:43.948 12:18:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@41 -- # break 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@45 -- # return 0 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:44.206 12:18:37 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@41 -- # break 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@45 -- # return 0 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:44.464 12:18:38 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@65 -- # true 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@65 -- # count=0 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@104 -- # count=0 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:44.722 12:18:38 -- bdev/nbd_common.sh@109 -- # return 0 00:04:44.722 12:18:38 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:44.980 12:18:38 -- event/event.sh@35 -- # sleep 3 00:04:45.238 [2024-07-12 12:18:38.963090] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:45.238 [2024-07-12 12:18:39.076364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:45.238 [2024-07-12 12:18:39.076368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.238 [2024-07-12 12:18:39.137823] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:45.238 [2024-07-12 12:18:39.137925] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:48.516 12:18:41 -- event/event.sh@23 -- # for i in {0..2} 00:04:48.516 12:18:41 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:48.516 spdk_app_start Round 2 00:04:48.516 12:18:41 -- event/event.sh@25 -- # waitforlisten 1150692 /var/tmp/spdk-nbd.sock 00:04:48.516 12:18:41 -- common/autotest_common.sh@819 -- # '[' -z 1150692 ']' 00:04:48.516 12:18:41 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:48.516 12:18:41 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:48.516 12:18:41 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:48.516 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:48.516 12:18:41 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:48.516 12:18:41 -- common/autotest_common.sh@10 -- # set +x 00:04:48.516 12:18:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:48.516 12:18:41 -- common/autotest_common.sh@852 -- # return 0 00:04:48.516 12:18:41 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:48.516 Malloc0 00:04:48.516 12:18:42 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:48.516 Malloc1 00:04:48.773 12:18:42 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@12 -- # local i 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:48.773 12:18:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:48.773 /dev/nbd0 00:04:49.030 12:18:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:49.030 12:18:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:49.030 12:18:42 -- common/autotest_common.sh@856 -- # local nbd_name=nbd0 00:04:49.030 12:18:42 -- common/autotest_common.sh@857 -- # local i 00:04:49.030 12:18:42 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:49.030 12:18:42 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:49.030 12:18:42 -- common/autotest_common.sh@860 -- # grep -q -w nbd0 /proc/partitions 00:04:49.030 12:18:42 -- common/autotest_common.sh@861 -- # break 00:04:49.030 12:18:42 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:49.030 12:18:42 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:49.030 12:18:42 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:49.030 1+0 records in 00:04:49.030 1+0 records out 00:04:49.030 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000214506 s, 19.1 MB/s 00:04:49.030 12:18:42 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.030 12:18:42 -- common/autotest_common.sh@874 -- # size=4096 00:04:49.030 12:18:42 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.030 12:18:42 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:49.030 12:18:42 -- common/autotest_common.sh@877 -- # return 0 00:04:49.030 12:18:42 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:49.030 12:18:42 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:49.030 12:18:42 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:49.287 /dev/nbd1 00:04:49.287 12:18:42 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:49.287 12:18:42 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:49.287 12:18:42 -- common/autotest_common.sh@856 -- # local nbd_name=nbd1 00:04:49.287 12:18:42 -- common/autotest_common.sh@857 -- # local i 00:04:49.287 12:18:42 -- common/autotest_common.sh@859 -- # (( i = 1 )) 00:04:49.287 12:18:42 -- common/autotest_common.sh@859 -- # (( i <= 20 )) 00:04:49.287 12:18:42 -- common/autotest_common.sh@860 -- # grep -q -w nbd1 /proc/partitions 00:04:49.287 12:18:42 -- common/autotest_common.sh@861 -- # break 00:04:49.287 12:18:42 -- common/autotest_common.sh@872 -- # (( i = 1 )) 00:04:49.287 12:18:42 -- common/autotest_common.sh@872 -- # (( i <= 20 )) 00:04:49.287 12:18:42 -- common/autotest_common.sh@873 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:49.287 1+0 records in 00:04:49.287 1+0 records out 00:04:49.287 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209928 s, 19.5 MB/s 00:04:49.287 12:18:43 -- common/autotest_common.sh@874 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.287 12:18:43 -- common/autotest_common.sh@874 -- # size=4096 00:04:49.287 12:18:43 -- common/autotest_common.sh@875 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:49.287 12:18:43 -- common/autotest_common.sh@876 -- # '[' 4096 '!=' 0 ']' 00:04:49.287 12:18:43 -- common/autotest_common.sh@877 -- # return 0 00:04:49.287 12:18:43 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:49.287 12:18:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:49.287 12:18:43 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:49.287 12:18:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:49.287 12:18:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:49.545 { 00:04:49.545 "nbd_device": "/dev/nbd0", 00:04:49.545 "bdev_name": "Malloc0" 00:04:49.545 }, 00:04:49.545 { 00:04:49.545 "nbd_device": "/dev/nbd1", 00:04:49.545 "bdev_name": "Malloc1" 00:04:49.545 } 00:04:49.545 ]' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:49.545 { 00:04:49.545 "nbd_device": "/dev/nbd0", 00:04:49.545 "bdev_name": "Malloc0" 00:04:49.545 }, 00:04:49.545 { 00:04:49.545 "nbd_device": "/dev/nbd1", 00:04:49.545 "bdev_name": "Malloc1" 00:04:49.545 } 00:04:49.545 ]' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:49.545 /dev/nbd1' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:49.545 /dev/nbd1' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@65 -- # count=2 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@95 -- # count=2 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:49.545 256+0 records in 00:04:49.545 256+0 records out 00:04:49.545 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00383176 s, 274 MB/s 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:49.545 256+0 records in 00:04:49.545 256+0 records out 00:04:49.545 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208302 s, 50.3 MB/s 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:49.545 256+0 records in 00:04:49.545 256+0 records out 00:04:49.545 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241869 s, 43.4 MB/s 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@51 -- # local i 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:49.545 12:18:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@41 -- # break 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@45 -- # return 0 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:49.802 12:18:43 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@41 -- # break 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@45 -- # return 0 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:50.060 12:18:43 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@65 -- # true 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@65 -- # count=0 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@104 -- # count=0 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:50.318 12:18:44 -- bdev/nbd_common.sh@109 -- # return 0 00:04:50.318 12:18:44 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:50.577 12:18:44 -- event/event.sh@35 -- # sleep 3 00:04:50.835 [2024-07-12 12:18:44.695530] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:51.091 [2024-07-12 12:18:44.809404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:51.091 [2024-07-12 12:18:44.809408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.091 [2024-07-12 12:18:44.871025] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:51.091 [2024-07-12 12:18:44.871089] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:53.640 12:18:47 -- event/event.sh@38 -- # waitforlisten 1150692 /var/tmp/spdk-nbd.sock 00:04:53.640 12:18:47 -- common/autotest_common.sh@819 -- # '[' -z 1150692 ']' 00:04:53.640 12:18:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:53.640 12:18:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:53.640 12:18:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:53.640 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:53.640 12:18:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:53.640 12:18:47 -- common/autotest_common.sh@10 -- # set +x 00:04:53.897 12:18:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:53.897 12:18:47 -- common/autotest_common.sh@852 -- # return 0 00:04:53.897 12:18:47 -- event/event.sh@39 -- # killprocess 1150692 00:04:53.897 12:18:47 -- common/autotest_common.sh@926 -- # '[' -z 1150692 ']' 00:04:53.897 12:18:47 -- common/autotest_common.sh@930 -- # kill -0 1150692 00:04:53.897 12:18:47 -- common/autotest_common.sh@931 -- # uname 00:04:53.897 12:18:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:53.897 12:18:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1150692 00:04:53.897 12:18:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:53.897 12:18:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:53.897 12:18:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1150692' 00:04:53.897 killing process with pid 1150692 00:04:53.897 12:18:47 -- common/autotest_common.sh@945 -- # kill 1150692 00:04:53.897 12:18:47 -- common/autotest_common.sh@950 -- # wait 1150692 00:04:54.155 spdk_app_start is called in Round 0. 00:04:54.155 Shutdown signal received, stop current app iteration 00:04:54.155 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 reinitialization... 00:04:54.155 spdk_app_start is called in Round 1. 00:04:54.155 Shutdown signal received, stop current app iteration 00:04:54.155 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 reinitialization... 00:04:54.155 spdk_app_start is called in Round 2. 00:04:54.155 Shutdown signal received, stop current app iteration 00:04:54.155 Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 reinitialization... 00:04:54.155 spdk_app_start is called in Round 3. 00:04:54.155 Shutdown signal received, stop current app iteration 00:04:54.155 12:18:47 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:04:54.155 12:18:47 -- event/event.sh@42 -- # return 0 00:04:54.155 00:04:54.155 real 0m18.495s 00:04:54.155 user 0m40.015s 00:04:54.155 sys 0m3.154s 00:04:54.155 12:18:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:54.155 12:18:47 -- common/autotest_common.sh@10 -- # set +x 00:04:54.155 ************************************ 00:04:54.155 END TEST app_repeat 00:04:54.155 ************************************ 00:04:54.155 12:18:47 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:04:54.155 12:18:47 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:54.155 12:18:47 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:54.155 12:18:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:54.155 12:18:47 -- common/autotest_common.sh@10 -- # set +x 00:04:54.155 ************************************ 00:04:54.155 START TEST cpu_locks 00:04:54.155 ************************************ 00:04:54.155 12:18:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:04:54.155 * Looking for test storage... 00:04:54.155 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:54.155 12:18:48 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:04:54.155 12:18:48 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:04:54.155 12:18:48 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:04:54.155 12:18:48 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:04:54.155 12:18:48 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:54.155 12:18:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:54.155 12:18:48 -- common/autotest_common.sh@10 -- # set +x 00:04:54.155 ************************************ 00:04:54.155 START TEST default_locks 00:04:54.155 ************************************ 00:04:54.155 12:18:48 -- common/autotest_common.sh@1104 -- # default_locks 00:04:54.155 12:18:48 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=1153108 00:04:54.155 12:18:48 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:54.155 12:18:48 -- event/cpu_locks.sh@47 -- # waitforlisten 1153108 00:04:54.155 12:18:48 -- common/autotest_common.sh@819 -- # '[' -z 1153108 ']' 00:04:54.155 12:18:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.155 12:18:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:54.155 12:18:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.155 12:18:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:54.155 12:18:48 -- common/autotest_common.sh@10 -- # set +x 00:04:54.155 [2024-07-12 12:18:48.065095] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:54.155 [2024-07-12 12:18:48.065203] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1153108 ] 00:04:54.413 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.413 [2024-07-12 12:18:48.127218] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.413 [2024-07-12 12:18:48.241951] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:54.413 [2024-07-12 12:18:48.242126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.345 12:18:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:55.345 12:18:49 -- common/autotest_common.sh@852 -- # return 0 00:04:55.345 12:18:49 -- event/cpu_locks.sh@49 -- # locks_exist 1153108 00:04:55.345 12:18:49 -- event/cpu_locks.sh@22 -- # lslocks -p 1153108 00:04:55.345 12:18:49 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:55.602 lslocks: write error 00:04:55.602 12:18:49 -- event/cpu_locks.sh@50 -- # killprocess 1153108 00:04:55.602 12:18:49 -- common/autotest_common.sh@926 -- # '[' -z 1153108 ']' 00:04:55.602 12:18:49 -- common/autotest_common.sh@930 -- # kill -0 1153108 00:04:55.602 12:18:49 -- common/autotest_common.sh@931 -- # uname 00:04:55.602 12:18:49 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:55.602 12:18:49 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1153108 00:04:55.602 12:18:49 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:55.602 12:18:49 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:55.602 12:18:49 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1153108' 00:04:55.602 killing process with pid 1153108 00:04:55.602 12:18:49 -- common/autotest_common.sh@945 -- # kill 1153108 00:04:55.602 12:18:49 -- common/autotest_common.sh@950 -- # wait 1153108 00:04:55.860 12:18:49 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 1153108 00:04:55.860 12:18:49 -- common/autotest_common.sh@640 -- # local es=0 00:04:55.860 12:18:49 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1153108 00:04:55.860 12:18:49 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:04:55.860 12:18:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:55.860 12:18:49 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:04:55.860 12:18:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:04:55.860 12:18:49 -- common/autotest_common.sh@643 -- # waitforlisten 1153108 00:04:55.860 12:18:49 -- common/autotest_common.sh@819 -- # '[' -z 1153108 ']' 00:04:55.860 12:18:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:55.860 12:18:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:55.860 12:18:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:55.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:55.860 12:18:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:55.860 12:18:49 -- common/autotest_common.sh@10 -- # set +x 00:04:55.860 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1153108) - No such process 00:04:55.860 ERROR: process (pid: 1153108) is no longer running 00:04:55.860 12:18:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:55.860 12:18:49 -- common/autotest_common.sh@852 -- # return 1 00:04:55.860 12:18:49 -- common/autotest_common.sh@643 -- # es=1 00:04:55.860 12:18:49 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:04:55.860 12:18:49 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:04:55.860 12:18:49 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:04:55.860 12:18:49 -- event/cpu_locks.sh@54 -- # no_locks 00:04:55.860 12:18:49 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:55.860 12:18:49 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:55.860 12:18:49 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:55.860 00:04:55.860 real 0m1.757s 00:04:55.860 user 0m1.891s 00:04:55.860 sys 0m0.561s 00:04:55.860 12:18:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:55.860 12:18:49 -- common/autotest_common.sh@10 -- # set +x 00:04:55.860 ************************************ 00:04:55.860 END TEST default_locks 00:04:55.860 ************************************ 00:04:56.118 12:18:49 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:04:56.118 12:18:49 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:56.118 12:18:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:56.118 12:18:49 -- common/autotest_common.sh@10 -- # set +x 00:04:56.118 ************************************ 00:04:56.118 START TEST default_locks_via_rpc 00:04:56.118 ************************************ 00:04:56.118 12:18:49 -- common/autotest_common.sh@1104 -- # default_locks_via_rpc 00:04:56.118 12:18:49 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=1153408 00:04:56.118 12:18:49 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:56.118 12:18:49 -- event/cpu_locks.sh@63 -- # waitforlisten 1153408 00:04:56.118 12:18:49 -- common/autotest_common.sh@819 -- # '[' -z 1153408 ']' 00:04:56.118 12:18:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.118 12:18:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:56.118 12:18:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.118 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.118 12:18:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:56.118 12:18:49 -- common/autotest_common.sh@10 -- # set +x 00:04:56.118 [2024-07-12 12:18:49.846012] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:56.118 [2024-07-12 12:18:49.846111] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1153408 ] 00:04:56.118 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.118 [2024-07-12 12:18:49.902821] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:56.118 [2024-07-12 12:18:50.015438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:56.118 [2024-07-12 12:18:50.015619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.049 12:18:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:57.049 12:18:50 -- common/autotest_common.sh@852 -- # return 0 00:04:57.049 12:18:50 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:04:57.049 12:18:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:57.049 12:18:50 -- common/autotest_common.sh@10 -- # set +x 00:04:57.050 12:18:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:57.050 12:18:50 -- event/cpu_locks.sh@67 -- # no_locks 00:04:57.050 12:18:50 -- event/cpu_locks.sh@26 -- # lock_files=() 00:04:57.050 12:18:50 -- event/cpu_locks.sh@26 -- # local lock_files 00:04:57.050 12:18:50 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:04:57.050 12:18:50 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:04:57.050 12:18:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:04:57.050 12:18:50 -- common/autotest_common.sh@10 -- # set +x 00:04:57.050 12:18:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:04:57.050 12:18:50 -- event/cpu_locks.sh@71 -- # locks_exist 1153408 00:04:57.050 12:18:50 -- event/cpu_locks.sh@22 -- # lslocks -p 1153408 00:04:57.050 12:18:50 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:04:57.307 12:18:51 -- event/cpu_locks.sh@73 -- # killprocess 1153408 00:04:57.307 12:18:51 -- common/autotest_common.sh@926 -- # '[' -z 1153408 ']' 00:04:57.307 12:18:51 -- common/autotest_common.sh@930 -- # kill -0 1153408 00:04:57.307 12:18:51 -- common/autotest_common.sh@931 -- # uname 00:04:57.307 12:18:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:04:57.307 12:18:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1153408 00:04:57.307 12:18:51 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:04:57.307 12:18:51 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:04:57.307 12:18:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1153408' 00:04:57.307 killing process with pid 1153408 00:04:57.307 12:18:51 -- common/autotest_common.sh@945 -- # kill 1153408 00:04:57.307 12:18:51 -- common/autotest_common.sh@950 -- # wait 1153408 00:04:57.870 00:04:57.870 real 0m1.839s 00:04:57.870 user 0m2.001s 00:04:57.870 sys 0m0.566s 00:04:57.870 12:18:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:04:57.870 12:18:51 -- common/autotest_common.sh@10 -- # set +x 00:04:57.870 ************************************ 00:04:57.870 END TEST default_locks_via_rpc 00:04:57.870 ************************************ 00:04:57.870 12:18:51 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:04:57.870 12:18:51 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:04:57.870 12:18:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:04:57.870 12:18:51 -- common/autotest_common.sh@10 -- # set +x 00:04:57.870 ************************************ 00:04:57.870 START TEST non_locking_app_on_locked_coremask 00:04:57.870 ************************************ 00:04:57.870 12:18:51 -- common/autotest_common.sh@1104 -- # non_locking_app_on_locked_coremask 00:04:57.870 12:18:51 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=1153583 00:04:57.870 12:18:51 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:04:57.870 12:18:51 -- event/cpu_locks.sh@81 -- # waitforlisten 1153583 /var/tmp/spdk.sock 00:04:57.870 12:18:51 -- common/autotest_common.sh@819 -- # '[' -z 1153583 ']' 00:04:57.870 12:18:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:57.870 12:18:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:57.870 12:18:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:57.870 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:57.870 12:18:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:57.870 12:18:51 -- common/autotest_common.sh@10 -- # set +x 00:04:57.870 [2024-07-12 12:18:51.710626] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:57.870 [2024-07-12 12:18:51.710708] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1153583 ] 00:04:57.870 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.870 [2024-07-12 12:18:51.767553] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:58.127 [2024-07-12 12:18:51.877326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:58.127 [2024-07-12 12:18:51.877499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.058 12:18:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:59.058 12:18:52 -- common/autotest_common.sh@852 -- # return 0 00:04:59.058 12:18:52 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=1153722 00:04:59.058 12:18:52 -- event/cpu_locks.sh@85 -- # waitforlisten 1153722 /var/tmp/spdk2.sock 00:04:59.058 12:18:52 -- common/autotest_common.sh@819 -- # '[' -z 1153722 ']' 00:04:59.058 12:18:52 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:04:59.058 12:18:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:04:59.058 12:18:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:04:59.058 12:18:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:04:59.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:04:59.058 12:18:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:04:59.058 12:18:52 -- common/autotest_common.sh@10 -- # set +x 00:04:59.058 [2024-07-12 12:18:52.701382] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:04:59.058 [2024-07-12 12:18:52.701464] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1153722 ] 00:04:59.058 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.058 [2024-07-12 12:18:52.798109] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:04:59.058 [2024-07-12 12:18:52.798146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.317 [2024-07-12 12:18:53.030201] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:59.317 [2024-07-12 12:18:53.030365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.883 12:18:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:04:59.883 12:18:53 -- common/autotest_common.sh@852 -- # return 0 00:04:59.883 12:18:53 -- event/cpu_locks.sh@87 -- # locks_exist 1153583 00:04:59.883 12:18:53 -- event/cpu_locks.sh@22 -- # lslocks -p 1153583 00:04:59.883 12:18:53 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:00.140 lslocks: write error 00:05:00.140 12:18:54 -- event/cpu_locks.sh@89 -- # killprocess 1153583 00:05:00.140 12:18:54 -- common/autotest_common.sh@926 -- # '[' -z 1153583 ']' 00:05:00.140 12:18:54 -- common/autotest_common.sh@930 -- # kill -0 1153583 00:05:00.140 12:18:54 -- common/autotest_common.sh@931 -- # uname 00:05:00.140 12:18:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:00.140 12:18:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1153583 00:05:00.399 12:18:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:00.399 12:18:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:00.399 12:18:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1153583' 00:05:00.399 killing process with pid 1153583 00:05:00.399 12:18:54 -- common/autotest_common.sh@945 -- # kill 1153583 00:05:00.399 12:18:54 -- common/autotest_common.sh@950 -- # wait 1153583 00:05:01.335 12:18:54 -- event/cpu_locks.sh@90 -- # killprocess 1153722 00:05:01.335 12:18:54 -- common/autotest_common.sh@926 -- # '[' -z 1153722 ']' 00:05:01.335 12:18:54 -- common/autotest_common.sh@930 -- # kill -0 1153722 00:05:01.335 12:18:54 -- common/autotest_common.sh@931 -- # uname 00:05:01.335 12:18:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:01.335 12:18:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1153722 00:05:01.335 12:18:55 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:01.335 12:18:55 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:01.335 12:18:55 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1153722' 00:05:01.335 killing process with pid 1153722 00:05:01.335 12:18:55 -- common/autotest_common.sh@945 -- # kill 1153722 00:05:01.335 12:18:55 -- common/autotest_common.sh@950 -- # wait 1153722 00:05:01.593 00:05:01.593 real 0m3.801s 00:05:01.593 user 0m4.140s 00:05:01.593 sys 0m1.037s 00:05:01.593 12:18:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:01.593 12:18:55 -- common/autotest_common.sh@10 -- # set +x 00:05:01.593 ************************************ 00:05:01.593 END TEST non_locking_app_on_locked_coremask 00:05:01.593 ************************************ 00:05:01.593 12:18:55 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:01.593 12:18:55 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:01.593 12:18:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:01.593 12:18:55 -- common/autotest_common.sh@10 -- # set +x 00:05:01.593 ************************************ 00:05:01.593 START TEST locking_app_on_unlocked_coremask 00:05:01.593 ************************************ 00:05:01.593 12:18:55 -- common/autotest_common.sh@1104 -- # locking_app_on_unlocked_coremask 00:05:01.593 12:18:55 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=1154158 00:05:01.593 12:18:55 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:01.593 12:18:55 -- event/cpu_locks.sh@99 -- # waitforlisten 1154158 /var/tmp/spdk.sock 00:05:01.593 12:18:55 -- common/autotest_common.sh@819 -- # '[' -z 1154158 ']' 00:05:01.593 12:18:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:01.593 12:18:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:01.593 12:18:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:01.593 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:01.593 12:18:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:01.593 12:18:55 -- common/autotest_common.sh@10 -- # set +x 00:05:01.852 [2024-07-12 12:18:55.539728] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:01.852 [2024-07-12 12:18:55.539822] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154158 ] 00:05:01.852 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.852 [2024-07-12 12:18:55.601377] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:01.852 [2024-07-12 12:18:55.601416] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:01.852 [2024-07-12 12:18:55.713515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:01.852 [2024-07-12 12:18:55.713697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.786 12:18:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:02.786 12:18:56 -- common/autotest_common.sh@852 -- # return 0 00:05:02.786 12:18:56 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=1154297 00:05:02.786 12:18:56 -- event/cpu_locks.sh@103 -- # waitforlisten 1154297 /var/tmp/spdk2.sock 00:05:02.786 12:18:56 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:02.786 12:18:56 -- common/autotest_common.sh@819 -- # '[' -z 1154297 ']' 00:05:02.786 12:18:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:02.786 12:18:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:02.786 12:18:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:02.786 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:02.786 12:18:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:02.786 12:18:56 -- common/autotest_common.sh@10 -- # set +x 00:05:02.786 [2024-07-12 12:18:56.510764] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:02.786 [2024-07-12 12:18:56.510840] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154297 ] 00:05:02.786 EAL: No free 2048 kB hugepages reported on node 1 00:05:02.786 [2024-07-12 12:18:56.605193] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.046 [2024-07-12 12:18:56.840847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:03.046 [2024-07-12 12:18:56.841040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.610 12:18:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:03.610 12:18:57 -- common/autotest_common.sh@852 -- # return 0 00:05:03.610 12:18:57 -- event/cpu_locks.sh@105 -- # locks_exist 1154297 00:05:03.610 12:18:57 -- event/cpu_locks.sh@22 -- # lslocks -p 1154297 00:05:03.610 12:18:57 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:04.175 lslocks: write error 00:05:04.175 12:18:57 -- event/cpu_locks.sh@107 -- # killprocess 1154158 00:05:04.176 12:18:57 -- common/autotest_common.sh@926 -- # '[' -z 1154158 ']' 00:05:04.176 12:18:57 -- common/autotest_common.sh@930 -- # kill -0 1154158 00:05:04.176 12:18:57 -- common/autotest_common.sh@931 -- # uname 00:05:04.176 12:18:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:04.176 12:18:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1154158 00:05:04.176 12:18:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:04.176 12:18:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:04.176 12:18:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1154158' 00:05:04.176 killing process with pid 1154158 00:05:04.176 12:18:57 -- common/autotest_common.sh@945 -- # kill 1154158 00:05:04.176 12:18:57 -- common/autotest_common.sh@950 -- # wait 1154158 00:05:05.110 12:18:58 -- event/cpu_locks.sh@108 -- # killprocess 1154297 00:05:05.110 12:18:58 -- common/autotest_common.sh@926 -- # '[' -z 1154297 ']' 00:05:05.110 12:18:58 -- common/autotest_common.sh@930 -- # kill -0 1154297 00:05:05.110 12:18:58 -- common/autotest_common.sh@931 -- # uname 00:05:05.110 12:18:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:05.110 12:18:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1154297 00:05:05.110 12:18:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:05.110 12:18:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:05.110 12:18:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1154297' 00:05:05.110 killing process with pid 1154297 00:05:05.110 12:18:58 -- common/autotest_common.sh@945 -- # kill 1154297 00:05:05.110 12:18:58 -- common/autotest_common.sh@950 -- # wait 1154297 00:05:05.368 00:05:05.368 real 0m3.753s 00:05:05.368 user 0m4.033s 00:05:05.368 sys 0m1.074s 00:05:05.368 12:18:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:05.369 12:18:59 -- common/autotest_common.sh@10 -- # set +x 00:05:05.369 ************************************ 00:05:05.369 END TEST locking_app_on_unlocked_coremask 00:05:05.369 ************************************ 00:05:05.369 12:18:59 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:05.369 12:18:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:05.369 12:18:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:05.369 12:18:59 -- common/autotest_common.sh@10 -- # set +x 00:05:05.369 ************************************ 00:05:05.369 START TEST locking_app_on_locked_coremask 00:05:05.369 ************************************ 00:05:05.369 12:18:59 -- common/autotest_common.sh@1104 -- # locking_app_on_locked_coremask 00:05:05.369 12:18:59 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=1154610 00:05:05.369 12:18:59 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:05.369 12:18:59 -- event/cpu_locks.sh@116 -- # waitforlisten 1154610 /var/tmp/spdk.sock 00:05:05.369 12:18:59 -- common/autotest_common.sh@819 -- # '[' -z 1154610 ']' 00:05:05.369 12:18:59 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.369 12:18:59 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:05.369 12:18:59 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.369 12:18:59 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:05.369 12:18:59 -- common/autotest_common.sh@10 -- # set +x 00:05:05.627 [2024-07-12 12:18:59.320842] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:05.627 [2024-07-12 12:18:59.320948] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154610 ] 00:05:05.627 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.627 [2024-07-12 12:18:59.383084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.627 [2024-07-12 12:18:59.494671] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.627 [2024-07-12 12:18:59.494850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.563 12:19:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:06.563 12:19:00 -- common/autotest_common.sh@852 -- # return 0 00:05:06.563 12:19:00 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=1154750 00:05:06.563 12:19:00 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:06.563 12:19:00 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 1154750 /var/tmp/spdk2.sock 00:05:06.563 12:19:00 -- common/autotest_common.sh@640 -- # local es=0 00:05:06.563 12:19:00 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1154750 /var/tmp/spdk2.sock 00:05:06.563 12:19:00 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:06.563 12:19:00 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:06.563 12:19:00 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:06.563 12:19:00 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:06.563 12:19:00 -- common/autotest_common.sh@643 -- # waitforlisten 1154750 /var/tmp/spdk2.sock 00:05:06.563 12:19:00 -- common/autotest_common.sh@819 -- # '[' -z 1154750 ']' 00:05:06.563 12:19:00 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:06.563 12:19:00 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:06.563 12:19:00 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:06.563 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:06.563 12:19:00 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:06.563 12:19:00 -- common/autotest_common.sh@10 -- # set +x 00:05:06.563 [2024-07-12 12:19:00.276682] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:06.563 [2024-07-12 12:19:00.276768] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154750 ] 00:05:06.563 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.563 [2024-07-12 12:19:00.372437] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 1154610 has claimed it. 00:05:06.563 [2024-07-12 12:19:00.372501] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:07.129 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1154750) - No such process 00:05:07.129 ERROR: process (pid: 1154750) is no longer running 00:05:07.129 12:19:00 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:07.129 12:19:00 -- common/autotest_common.sh@852 -- # return 1 00:05:07.129 12:19:00 -- common/autotest_common.sh@643 -- # es=1 00:05:07.130 12:19:00 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:07.130 12:19:00 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:07.130 12:19:00 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:07.130 12:19:00 -- event/cpu_locks.sh@122 -- # locks_exist 1154610 00:05:07.130 12:19:00 -- event/cpu_locks.sh@22 -- # lslocks -p 1154610 00:05:07.130 12:19:00 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:07.695 lslocks: write error 00:05:07.695 12:19:01 -- event/cpu_locks.sh@124 -- # killprocess 1154610 00:05:07.695 12:19:01 -- common/autotest_common.sh@926 -- # '[' -z 1154610 ']' 00:05:07.695 12:19:01 -- common/autotest_common.sh@930 -- # kill -0 1154610 00:05:07.695 12:19:01 -- common/autotest_common.sh@931 -- # uname 00:05:07.695 12:19:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:07.695 12:19:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1154610 00:05:07.695 12:19:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:07.695 12:19:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:07.695 12:19:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1154610' 00:05:07.695 killing process with pid 1154610 00:05:07.695 12:19:01 -- common/autotest_common.sh@945 -- # kill 1154610 00:05:07.695 12:19:01 -- common/autotest_common.sh@950 -- # wait 1154610 00:05:07.953 00:05:07.953 real 0m2.587s 00:05:07.953 user 0m2.883s 00:05:07.953 sys 0m0.672s 00:05:07.953 12:19:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:07.953 12:19:01 -- common/autotest_common.sh@10 -- # set +x 00:05:07.953 ************************************ 00:05:07.953 END TEST locking_app_on_locked_coremask 00:05:07.953 ************************************ 00:05:08.212 12:19:01 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:08.212 12:19:01 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:08.212 12:19:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:08.212 12:19:01 -- common/autotest_common.sh@10 -- # set +x 00:05:08.212 ************************************ 00:05:08.212 START TEST locking_overlapped_coremask 00:05:08.212 ************************************ 00:05:08.212 12:19:01 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask 00:05:08.212 12:19:01 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=1154932 00:05:08.212 12:19:01 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:08.212 12:19:01 -- event/cpu_locks.sh@133 -- # waitforlisten 1154932 /var/tmp/spdk.sock 00:05:08.212 12:19:01 -- common/autotest_common.sh@819 -- # '[' -z 1154932 ']' 00:05:08.212 12:19:01 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:08.212 12:19:01 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:08.212 12:19:01 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:08.212 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:08.212 12:19:01 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:08.212 12:19:01 -- common/autotest_common.sh@10 -- # set +x 00:05:08.212 [2024-07-12 12:19:01.931465] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:08.212 [2024-07-12 12:19:01.931551] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154932 ] 00:05:08.212 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.212 [2024-07-12 12:19:01.995069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:08.212 [2024-07-12 12:19:02.111182] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:08.212 [2024-07-12 12:19:02.111394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:08.212 [2024-07-12 12:19:02.111511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:08.212 [2024-07-12 12:19:02.111514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:09.177 12:19:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:09.177 12:19:02 -- common/autotest_common.sh@852 -- # return 0 00:05:09.177 12:19:02 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=1155064 00:05:09.177 12:19:02 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 1155064 /var/tmp/spdk2.sock 00:05:09.177 12:19:02 -- common/autotest_common.sh@640 -- # local es=0 00:05:09.177 12:19:02 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:09.177 12:19:02 -- common/autotest_common.sh@642 -- # valid_exec_arg waitforlisten 1155064 /var/tmp/spdk2.sock 00:05:09.177 12:19:02 -- common/autotest_common.sh@628 -- # local arg=waitforlisten 00:05:09.177 12:19:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:09.177 12:19:02 -- common/autotest_common.sh@632 -- # type -t waitforlisten 00:05:09.177 12:19:02 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:09.177 12:19:02 -- common/autotest_common.sh@643 -- # waitforlisten 1155064 /var/tmp/spdk2.sock 00:05:09.177 12:19:02 -- common/autotest_common.sh@819 -- # '[' -z 1155064 ']' 00:05:09.177 12:19:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:09.177 12:19:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:09.177 12:19:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:09.177 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:09.177 12:19:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:09.177 12:19:02 -- common/autotest_common.sh@10 -- # set +x 00:05:09.177 [2024-07-12 12:19:02.893303] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:09.177 [2024-07-12 12:19:02.893382] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1155064 ] 00:05:09.177 EAL: No free 2048 kB hugepages reported on node 1 00:05:09.177 [2024-07-12 12:19:02.981994] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1154932 has claimed it. 00:05:09.177 [2024-07-12 12:19:02.982057] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:09.741 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 834: kill: (1155064) - No such process 00:05:09.741 ERROR: process (pid: 1155064) is no longer running 00:05:09.741 12:19:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:09.741 12:19:03 -- common/autotest_common.sh@852 -- # return 1 00:05:09.741 12:19:03 -- common/autotest_common.sh@643 -- # es=1 00:05:09.741 12:19:03 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:09.741 12:19:03 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:09.741 12:19:03 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:09.741 12:19:03 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:09.741 12:19:03 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:09.741 12:19:03 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:09.741 12:19:03 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:09.741 12:19:03 -- event/cpu_locks.sh@141 -- # killprocess 1154932 00:05:09.741 12:19:03 -- common/autotest_common.sh@926 -- # '[' -z 1154932 ']' 00:05:09.741 12:19:03 -- common/autotest_common.sh@930 -- # kill -0 1154932 00:05:09.741 12:19:03 -- common/autotest_common.sh@931 -- # uname 00:05:09.741 12:19:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:09.741 12:19:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1154932 00:05:09.741 12:19:03 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:09.741 12:19:03 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:09.741 12:19:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1154932' 00:05:09.741 killing process with pid 1154932 00:05:09.741 12:19:03 -- common/autotest_common.sh@945 -- # kill 1154932 00:05:09.741 12:19:03 -- common/autotest_common.sh@950 -- # wait 1154932 00:05:10.306 00:05:10.306 real 0m2.202s 00:05:10.306 user 0m6.138s 00:05:10.306 sys 0m0.498s 00:05:10.306 12:19:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:10.306 12:19:04 -- common/autotest_common.sh@10 -- # set +x 00:05:10.306 ************************************ 00:05:10.306 END TEST locking_overlapped_coremask 00:05:10.306 ************************************ 00:05:10.306 12:19:04 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:10.306 12:19:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:10.306 12:19:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:10.306 12:19:04 -- common/autotest_common.sh@10 -- # set +x 00:05:10.306 ************************************ 00:05:10.306 START TEST locking_overlapped_coremask_via_rpc 00:05:10.306 ************************************ 00:05:10.306 12:19:04 -- common/autotest_common.sh@1104 -- # locking_overlapped_coremask_via_rpc 00:05:10.306 12:19:04 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=1155248 00:05:10.306 12:19:04 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:10.306 12:19:04 -- event/cpu_locks.sh@149 -- # waitforlisten 1155248 /var/tmp/spdk.sock 00:05:10.306 12:19:04 -- common/autotest_common.sh@819 -- # '[' -z 1155248 ']' 00:05:10.306 12:19:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.306 12:19:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:10.306 12:19:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.306 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.306 12:19:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:10.306 12:19:04 -- common/autotest_common.sh@10 -- # set +x 00:05:10.306 [2024-07-12 12:19:04.162508] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:10.306 [2024-07-12 12:19:04.162603] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1155248 ] 00:05:10.306 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.564 [2024-07-12 12:19:04.232403] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:10.564 [2024-07-12 12:19:04.232448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:10.564 [2024-07-12 12:19:04.351538] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:10.564 [2024-07-12 12:19:04.351737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:10.564 [2024-07-12 12:19:04.351790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:10.564 [2024-07-12 12:19:04.351794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.496 12:19:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:11.496 12:19:05 -- common/autotest_common.sh@852 -- # return 0 00:05:11.496 12:19:05 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=1155374 00:05:11.496 12:19:05 -- event/cpu_locks.sh@153 -- # waitforlisten 1155374 /var/tmp/spdk2.sock 00:05:11.496 12:19:05 -- common/autotest_common.sh@819 -- # '[' -z 1155374 ']' 00:05:11.496 12:19:05 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:11.496 12:19:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:11.496 12:19:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:11.496 12:19:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:11.496 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:11.496 12:19:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:11.496 12:19:05 -- common/autotest_common.sh@10 -- # set +x 00:05:11.496 [2024-07-12 12:19:05.163359] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:11.496 [2024-07-12 12:19:05.163437] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1155374 ] 00:05:11.496 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.496 [2024-07-12 12:19:05.252140] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:11.496 [2024-07-12 12:19:05.252198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:11.754 [2024-07-12 12:19:05.475737] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.754 [2024-07-12 12:19:05.476003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:11.754 [2024-07-12 12:19:05.476074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:11.754 [2024-07-12 12:19:05.476076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:12.319 12:19:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:12.319 12:19:06 -- common/autotest_common.sh@852 -- # return 0 00:05:12.319 12:19:06 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:12.319 12:19:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:12.319 12:19:06 -- common/autotest_common.sh@10 -- # set +x 00:05:12.319 12:19:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:12.319 12:19:06 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:12.319 12:19:06 -- common/autotest_common.sh@640 -- # local es=0 00:05:12.319 12:19:06 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:12.319 12:19:06 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:05:12.319 12:19:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:12.319 12:19:06 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:05:12.319 12:19:06 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:12.319 12:19:06 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:12.319 12:19:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:12.319 12:19:06 -- common/autotest_common.sh@10 -- # set +x 00:05:12.319 [2024-07-12 12:19:06.111974] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 1155248 has claimed it. 00:05:12.319 request: 00:05:12.319 { 00:05:12.319 "method": "framework_enable_cpumask_locks", 00:05:12.319 "req_id": 1 00:05:12.319 } 00:05:12.319 Got JSON-RPC error response 00:05:12.319 response: 00:05:12.319 { 00:05:12.319 "code": -32603, 00:05:12.319 "message": "Failed to claim CPU core: 2" 00:05:12.319 } 00:05:12.319 12:19:06 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:05:12.319 12:19:06 -- common/autotest_common.sh@643 -- # es=1 00:05:12.319 12:19:06 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:12.319 12:19:06 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:12.319 12:19:06 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:12.319 12:19:06 -- event/cpu_locks.sh@158 -- # waitforlisten 1155248 /var/tmp/spdk.sock 00:05:12.319 12:19:06 -- common/autotest_common.sh@819 -- # '[' -z 1155248 ']' 00:05:12.319 12:19:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.319 12:19:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:12.319 12:19:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.319 12:19:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:12.319 12:19:06 -- common/autotest_common.sh@10 -- # set +x 00:05:12.576 12:19:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:12.576 12:19:06 -- common/autotest_common.sh@852 -- # return 0 00:05:12.576 12:19:06 -- event/cpu_locks.sh@159 -- # waitforlisten 1155374 /var/tmp/spdk2.sock 00:05:12.576 12:19:06 -- common/autotest_common.sh@819 -- # '[' -z 1155374 ']' 00:05:12.576 12:19:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:12.576 12:19:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:12.576 12:19:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:12.576 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:12.576 12:19:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:12.576 12:19:06 -- common/autotest_common.sh@10 -- # set +x 00:05:12.834 12:19:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:12.834 12:19:06 -- common/autotest_common.sh@852 -- # return 0 00:05:12.834 12:19:06 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:12.834 12:19:06 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:12.834 12:19:06 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:12.834 12:19:06 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:12.834 00:05:12.834 real 0m2.489s 00:05:12.834 user 0m1.201s 00:05:12.834 sys 0m0.208s 00:05:12.834 12:19:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:12.834 12:19:06 -- common/autotest_common.sh@10 -- # set +x 00:05:12.834 ************************************ 00:05:12.834 END TEST locking_overlapped_coremask_via_rpc 00:05:12.834 ************************************ 00:05:12.834 12:19:06 -- event/cpu_locks.sh@174 -- # cleanup 00:05:12.834 12:19:06 -- event/cpu_locks.sh@15 -- # [[ -z 1155248 ]] 00:05:12.834 12:19:06 -- event/cpu_locks.sh@15 -- # killprocess 1155248 00:05:12.834 12:19:06 -- common/autotest_common.sh@926 -- # '[' -z 1155248 ']' 00:05:12.834 12:19:06 -- common/autotest_common.sh@930 -- # kill -0 1155248 00:05:12.834 12:19:06 -- common/autotest_common.sh@931 -- # uname 00:05:12.834 12:19:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:12.834 12:19:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1155248 00:05:12.834 12:19:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:12.834 12:19:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:12.834 12:19:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1155248' 00:05:12.834 killing process with pid 1155248 00:05:12.834 12:19:06 -- common/autotest_common.sh@945 -- # kill 1155248 00:05:12.834 12:19:06 -- common/autotest_common.sh@950 -- # wait 1155248 00:05:13.398 12:19:07 -- event/cpu_locks.sh@16 -- # [[ -z 1155374 ]] 00:05:13.398 12:19:07 -- event/cpu_locks.sh@16 -- # killprocess 1155374 00:05:13.398 12:19:07 -- common/autotest_common.sh@926 -- # '[' -z 1155374 ']' 00:05:13.398 12:19:07 -- common/autotest_common.sh@930 -- # kill -0 1155374 00:05:13.398 12:19:07 -- common/autotest_common.sh@931 -- # uname 00:05:13.398 12:19:07 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:13.398 12:19:07 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1155374 00:05:13.398 12:19:07 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:05:13.398 12:19:07 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:05:13.398 12:19:07 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1155374' 00:05:13.398 killing process with pid 1155374 00:05:13.398 12:19:07 -- common/autotest_common.sh@945 -- # kill 1155374 00:05:13.398 12:19:07 -- common/autotest_common.sh@950 -- # wait 1155374 00:05:13.965 12:19:07 -- event/cpu_locks.sh@18 -- # rm -f 00:05:13.965 12:19:07 -- event/cpu_locks.sh@1 -- # cleanup 00:05:13.965 12:19:07 -- event/cpu_locks.sh@15 -- # [[ -z 1155248 ]] 00:05:13.965 12:19:07 -- event/cpu_locks.sh@15 -- # killprocess 1155248 00:05:13.965 12:19:07 -- common/autotest_common.sh@926 -- # '[' -z 1155248 ']' 00:05:13.965 12:19:07 -- common/autotest_common.sh@930 -- # kill -0 1155248 00:05:13.965 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1155248) - No such process 00:05:13.965 12:19:07 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1155248 is not found' 00:05:13.965 Process with pid 1155248 is not found 00:05:13.965 12:19:07 -- event/cpu_locks.sh@16 -- # [[ -z 1155374 ]] 00:05:13.965 12:19:07 -- event/cpu_locks.sh@16 -- # killprocess 1155374 00:05:13.965 12:19:07 -- common/autotest_common.sh@926 -- # '[' -z 1155374 ']' 00:05:13.965 12:19:07 -- common/autotest_common.sh@930 -- # kill -0 1155374 00:05:13.965 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1155374) - No such process 00:05:13.965 12:19:07 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1155374 is not found' 00:05:13.965 Process with pid 1155374 is not found 00:05:13.965 12:19:07 -- event/cpu_locks.sh@18 -- # rm -f 00:05:13.965 00:05:13.965 real 0m19.620s 00:05:13.965 user 0m34.606s 00:05:13.965 sys 0m5.411s 00:05:13.965 12:19:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:13.965 12:19:07 -- common/autotest_common.sh@10 -- # set +x 00:05:13.965 ************************************ 00:05:13.965 END TEST cpu_locks 00:05:13.965 ************************************ 00:05:13.965 00:05:13.965 real 0m46.046s 00:05:13.965 user 1m27.025s 00:05:13.965 sys 0m9.290s 00:05:13.965 12:19:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:13.965 12:19:07 -- common/autotest_common.sh@10 -- # set +x 00:05:13.965 ************************************ 00:05:13.965 END TEST event 00:05:13.965 ************************************ 00:05:13.965 12:19:07 -- spdk/autotest.sh@188 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:13.965 12:19:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:13.965 12:19:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:13.965 12:19:07 -- common/autotest_common.sh@10 -- # set +x 00:05:13.965 ************************************ 00:05:13.965 START TEST thread 00:05:13.965 ************************************ 00:05:13.965 12:19:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:13.965 * Looking for test storage... 00:05:13.965 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:13.965 12:19:07 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:13.965 12:19:07 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:13.965 12:19:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:13.965 12:19:07 -- common/autotest_common.sh@10 -- # set +x 00:05:13.965 ************************************ 00:05:13.965 START TEST thread_poller_perf 00:05:13.965 ************************************ 00:05:13.965 12:19:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:13.965 [2024-07-12 12:19:07.694643] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:13.965 [2024-07-12 12:19:07.694737] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1155874 ] 00:05:13.965 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.965 [2024-07-12 12:19:07.761052] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.965 [2024-07-12 12:19:07.871550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.965 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:15.338 ====================================== 00:05:15.338 busy:2709858914 (cyc) 00:05:15.338 total_run_count: 277000 00:05:15.338 tsc_hz: 2700000000 (cyc) 00:05:15.338 ====================================== 00:05:15.338 poller_cost: 9782 (cyc), 3622 (nsec) 00:05:15.338 00:05:15.338 real 0m1.320s 00:05:15.338 user 0m1.222s 00:05:15.338 sys 0m0.092s 00:05:15.338 12:19:08 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:15.339 12:19:08 -- common/autotest_common.sh@10 -- # set +x 00:05:15.339 ************************************ 00:05:15.339 END TEST thread_poller_perf 00:05:15.339 ************************************ 00:05:15.339 12:19:09 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:15.339 12:19:09 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:15.339 12:19:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:15.339 12:19:09 -- common/autotest_common.sh@10 -- # set +x 00:05:15.339 ************************************ 00:05:15.339 START TEST thread_poller_perf 00:05:15.339 ************************************ 00:05:15.339 12:19:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:15.339 [2024-07-12 12:19:09.036843] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:15.339 [2024-07-12 12:19:09.036946] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156029 ] 00:05:15.339 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.339 [2024-07-12 12:19:09.098499] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.339 [2024-07-12 12:19:09.215264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.339 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:16.711 ====================================== 00:05:16.711 busy:2703903142 (cyc) 00:05:16.711 total_run_count: 3826000 00:05:16.711 tsc_hz: 2700000000 (cyc) 00:05:16.711 ====================================== 00:05:16.711 poller_cost: 706 (cyc), 261 (nsec) 00:05:16.711 00:05:16.711 real 0m1.316s 00:05:16.711 user 0m1.220s 00:05:16.711 sys 0m0.089s 00:05:16.711 12:19:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.711 12:19:10 -- common/autotest_common.sh@10 -- # set +x 00:05:16.711 ************************************ 00:05:16.711 END TEST thread_poller_perf 00:05:16.711 ************************************ 00:05:16.711 12:19:10 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:16.711 00:05:16.711 real 0m2.729s 00:05:16.711 user 0m2.476s 00:05:16.711 sys 0m0.253s 00:05:16.711 12:19:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:16.711 12:19:10 -- common/autotest_common.sh@10 -- # set +x 00:05:16.711 ************************************ 00:05:16.711 END TEST thread 00:05:16.711 ************************************ 00:05:16.711 12:19:10 -- spdk/autotest.sh@189 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:16.711 12:19:10 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:05:16.712 12:19:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:16.712 12:19:10 -- common/autotest_common.sh@10 -- # set +x 00:05:16.712 ************************************ 00:05:16.712 START TEST accel 00:05:16.712 ************************************ 00:05:16.712 12:19:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:16.712 * Looking for test storage... 00:05:16.712 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:16.712 12:19:10 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:16.712 12:19:10 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:16.712 12:19:10 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:16.712 12:19:10 -- accel/accel.sh@59 -- # spdk_tgt_pid=1156223 00:05:16.712 12:19:10 -- accel/accel.sh@60 -- # waitforlisten 1156223 00:05:16.712 12:19:10 -- common/autotest_common.sh@819 -- # '[' -z 1156223 ']' 00:05:16.712 12:19:10 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:16.712 12:19:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.712 12:19:10 -- accel/accel.sh@58 -- # build_accel_config 00:05:16.712 12:19:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:05:16.712 12:19:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:16.712 12:19:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.712 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.712 12:19:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:16.712 12:19:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:05:16.712 12:19:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:16.712 12:19:10 -- common/autotest_common.sh@10 -- # set +x 00:05:16.712 12:19:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:16.712 12:19:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:16.712 12:19:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:16.712 12:19:10 -- accel/accel.sh@42 -- # jq -r . 00:05:16.712 [2024-07-12 12:19:10.486732] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:16.712 [2024-07-12 12:19:10.486817] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156223 ] 00:05:16.712 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.712 [2024-07-12 12:19:10.546505] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.970 [2024-07-12 12:19:10.660571] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.970 [2024-07-12 12:19:10.660741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.536 12:19:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:05:17.536 12:19:11 -- common/autotest_common.sh@852 -- # return 0 00:05:17.536 12:19:11 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:17.536 12:19:11 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:17.536 12:19:11 -- common/autotest_common.sh@551 -- # xtrace_disable 00:05:17.536 12:19:11 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:17.536 12:19:11 -- common/autotest_common.sh@10 -- # set +x 00:05:17.536 12:19:11 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # IFS== 00:05:17.536 12:19:11 -- accel/accel.sh@64 -- # read -r opc module 00:05:17.536 12:19:11 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:17.536 12:19:11 -- accel/accel.sh@67 -- # killprocess 1156223 00:05:17.536 12:19:11 -- common/autotest_common.sh@926 -- # '[' -z 1156223 ']' 00:05:17.536 12:19:11 -- common/autotest_common.sh@930 -- # kill -0 1156223 00:05:17.536 12:19:11 -- common/autotest_common.sh@931 -- # uname 00:05:17.536 12:19:11 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:05:17.536 12:19:11 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1156223 00:05:17.794 12:19:11 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:05:17.794 12:19:11 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:05:17.794 12:19:11 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1156223' 00:05:17.794 killing process with pid 1156223 00:05:17.794 12:19:11 -- common/autotest_common.sh@945 -- # kill 1156223 00:05:17.794 12:19:11 -- common/autotest_common.sh@950 -- # wait 1156223 00:05:18.052 12:19:11 -- accel/accel.sh@68 -- # trap - ERR 00:05:18.052 12:19:11 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:18.052 12:19:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:05:18.052 12:19:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:18.052 12:19:11 -- common/autotest_common.sh@10 -- # set +x 00:05:18.052 12:19:11 -- common/autotest_common.sh@1104 -- # accel_perf -h 00:05:18.052 12:19:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:18.052 12:19:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.052 12:19:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.052 12:19:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.052 12:19:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.052 12:19:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.052 12:19:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.052 12:19:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.052 12:19:11 -- accel/accel.sh@42 -- # jq -r . 00:05:18.052 12:19:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:18.052 12:19:11 -- common/autotest_common.sh@10 -- # set +x 00:05:18.310 12:19:11 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:18.311 12:19:11 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:18.311 12:19:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:18.311 12:19:11 -- common/autotest_common.sh@10 -- # set +x 00:05:18.311 ************************************ 00:05:18.311 START TEST accel_missing_filename 00:05:18.311 ************************************ 00:05:18.311 12:19:11 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress 00:05:18.311 12:19:11 -- common/autotest_common.sh@640 -- # local es=0 00:05:18.311 12:19:11 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:18.311 12:19:11 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:18.311 12:19:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:18.311 12:19:11 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:18.311 12:19:11 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:18.311 12:19:11 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress 00:05:18.311 12:19:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:18.311 12:19:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.311 12:19:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.311 12:19:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.311 12:19:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.311 12:19:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.311 12:19:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.311 12:19:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.311 12:19:11 -- accel/accel.sh@42 -- # jq -r . 00:05:18.311 [2024-07-12 12:19:11.998592] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:18.311 [2024-07-12 12:19:11.998668] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156417 ] 00:05:18.311 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.311 [2024-07-12 12:19:12.061414] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.311 [2024-07-12 12:19:12.178163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.570 [2024-07-12 12:19:12.238623] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:18.570 [2024-07-12 12:19:12.312385] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:18.570 A filename is required. 00:05:18.570 12:19:12 -- common/autotest_common.sh@643 -- # es=234 00:05:18.570 12:19:12 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:18.570 12:19:12 -- common/autotest_common.sh@652 -- # es=106 00:05:18.570 12:19:12 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:18.570 12:19:12 -- common/autotest_common.sh@660 -- # es=1 00:05:18.570 12:19:12 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:18.570 00:05:18.570 real 0m0.452s 00:05:18.570 user 0m0.340s 00:05:18.570 sys 0m0.145s 00:05:18.570 12:19:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:18.570 12:19:12 -- common/autotest_common.sh@10 -- # set +x 00:05:18.570 ************************************ 00:05:18.570 END TEST accel_missing_filename 00:05:18.570 ************************************ 00:05:18.570 12:19:12 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:18.570 12:19:12 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:18.570 12:19:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:18.570 12:19:12 -- common/autotest_common.sh@10 -- # set +x 00:05:18.570 ************************************ 00:05:18.570 START TEST accel_compress_verify 00:05:18.570 ************************************ 00:05:18.570 12:19:12 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:18.570 12:19:12 -- common/autotest_common.sh@640 -- # local es=0 00:05:18.570 12:19:12 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:18.570 12:19:12 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:18.571 12:19:12 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:18.571 12:19:12 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:18.571 12:19:12 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:18.571 12:19:12 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:18.571 12:19:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:18.571 12:19:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:18.571 12:19:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:18.571 12:19:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:18.571 12:19:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:18.571 12:19:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:18.571 12:19:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:18.571 12:19:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:18.571 12:19:12 -- accel/accel.sh@42 -- # jq -r . 00:05:18.571 [2024-07-12 12:19:12.481316] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:18.571 [2024-07-12 12:19:12.481406] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156547 ] 00:05:18.829 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.829 [2024-07-12 12:19:12.545839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.829 [2024-07-12 12:19:12.659637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:18.829 [2024-07-12 12:19:12.721540] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:19.087 [2024-07-12 12:19:12.805095] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:19.087 00:05:19.087 Compression does not support the verify option, aborting. 00:05:19.087 12:19:12 -- common/autotest_common.sh@643 -- # es=161 00:05:19.087 12:19:12 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:19.087 12:19:12 -- common/autotest_common.sh@652 -- # es=33 00:05:19.087 12:19:12 -- common/autotest_common.sh@653 -- # case "$es" in 00:05:19.087 12:19:12 -- common/autotest_common.sh@660 -- # es=1 00:05:19.087 12:19:12 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:19.087 00:05:19.087 real 0m0.467s 00:05:19.087 user 0m0.362s 00:05:19.087 sys 0m0.139s 00:05:19.087 12:19:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.087 12:19:12 -- common/autotest_common.sh@10 -- # set +x 00:05:19.087 ************************************ 00:05:19.087 END TEST accel_compress_verify 00:05:19.087 ************************************ 00:05:19.087 12:19:12 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:19.087 12:19:12 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:19.087 12:19:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.087 12:19:12 -- common/autotest_common.sh@10 -- # set +x 00:05:19.087 ************************************ 00:05:19.087 START TEST accel_wrong_workload 00:05:19.087 ************************************ 00:05:19.087 12:19:12 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w foobar 00:05:19.087 12:19:12 -- common/autotest_common.sh@640 -- # local es=0 00:05:19.087 12:19:12 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:19.087 12:19:12 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:19.087 12:19:12 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:19.087 12:19:12 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:19.087 12:19:12 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:19.087 12:19:12 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w foobar 00:05:19.087 12:19:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:19.087 12:19:12 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.087 12:19:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.087 12:19:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.087 12:19:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.087 12:19:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.087 12:19:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.087 12:19:12 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.087 12:19:12 -- accel/accel.sh@42 -- # jq -r . 00:05:19.087 Unsupported workload type: foobar 00:05:19.087 [2024-07-12 12:19:12.973740] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:19.087 accel_perf options: 00:05:19.087 [-h help message] 00:05:19.087 [-q queue depth per core] 00:05:19.087 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:19.087 [-T number of threads per core 00:05:19.087 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:19.087 [-t time in seconds] 00:05:19.087 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:19.087 [ dif_verify, , dif_generate, dif_generate_copy 00:05:19.087 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:19.087 [-l for compress/decompress workloads, name of uncompressed input file 00:05:19.087 [-S for crc32c workload, use this seed value (default 0) 00:05:19.087 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:19.087 [-f for fill workload, use this BYTE value (default 255) 00:05:19.087 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:19.087 [-y verify result if this switch is on] 00:05:19.087 [-a tasks to allocate per core (default: same value as -q)] 00:05:19.087 Can be used to spread operations across a wider range of memory. 00:05:19.087 12:19:12 -- common/autotest_common.sh@643 -- # es=1 00:05:19.087 12:19:12 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:19.087 12:19:12 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:19.087 12:19:12 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:19.087 00:05:19.087 real 0m0.024s 00:05:19.087 user 0m0.014s 00:05:19.087 sys 0m0.009s 00:05:19.087 12:19:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.087 12:19:12 -- common/autotest_common.sh@10 -- # set +x 00:05:19.087 ************************************ 00:05:19.087 END TEST accel_wrong_workload 00:05:19.087 ************************************ 00:05:19.087 Error: writing output failed: Broken pipe 00:05:19.087 12:19:12 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:19.087 12:19:12 -- common/autotest_common.sh@1077 -- # '[' 10 -le 1 ']' 00:05:19.087 12:19:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.087 12:19:12 -- common/autotest_common.sh@10 -- # set +x 00:05:19.087 ************************************ 00:05:19.087 START TEST accel_negative_buffers 00:05:19.087 ************************************ 00:05:19.087 12:19:13 -- common/autotest_common.sh@1104 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:19.087 12:19:13 -- common/autotest_common.sh@640 -- # local es=0 00:05:19.087 12:19:13 -- common/autotest_common.sh@642 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:19.087 12:19:13 -- common/autotest_common.sh@628 -- # local arg=accel_perf 00:05:19.087 12:19:13 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:19.087 12:19:13 -- common/autotest_common.sh@632 -- # type -t accel_perf 00:05:19.087 12:19:13 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:05:19.088 12:19:13 -- common/autotest_common.sh@643 -- # accel_perf -t 1 -w xor -y -x -1 00:05:19.088 12:19:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:19.088 12:19:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.088 12:19:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.088 12:19:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.088 12:19:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.088 12:19:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.088 12:19:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.088 12:19:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.088 12:19:13 -- accel/accel.sh@42 -- # jq -r . 00:05:19.346 -x option must be non-negative. 00:05:19.346 [2024-07-12 12:19:13.018387] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:19.346 accel_perf options: 00:05:19.346 [-h help message] 00:05:19.346 [-q queue depth per core] 00:05:19.346 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:19.346 [-T number of threads per core 00:05:19.346 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:19.346 [-t time in seconds] 00:05:19.346 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:19.346 [ dif_verify, , dif_generate, dif_generate_copy 00:05:19.346 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:19.346 [-l for compress/decompress workloads, name of uncompressed input file 00:05:19.346 [-S for crc32c workload, use this seed value (default 0) 00:05:19.346 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:19.346 [-f for fill workload, use this BYTE value (default 255) 00:05:19.346 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:19.346 [-y verify result if this switch is on] 00:05:19.346 [-a tasks to allocate per core (default: same value as -q)] 00:05:19.346 Can be used to spread operations across a wider range of memory. 00:05:19.346 12:19:13 -- common/autotest_common.sh@643 -- # es=1 00:05:19.346 12:19:13 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:05:19.346 12:19:13 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:05:19.346 12:19:13 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:05:19.346 00:05:19.346 real 0m0.022s 00:05:19.346 user 0m0.013s 00:05:19.346 sys 0m0.009s 00:05:19.346 12:19:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:19.346 12:19:13 -- common/autotest_common.sh@10 -- # set +x 00:05:19.346 ************************************ 00:05:19.346 END TEST accel_negative_buffers 00:05:19.346 ************************************ 00:05:19.346 Error: writing output failed: Broken pipe 00:05:19.346 12:19:13 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:19.346 12:19:13 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:19.346 12:19:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:19.346 12:19:13 -- common/autotest_common.sh@10 -- # set +x 00:05:19.346 ************************************ 00:05:19.346 START TEST accel_crc32c 00:05:19.346 ************************************ 00:05:19.346 12:19:13 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:19.346 12:19:13 -- accel/accel.sh@16 -- # local accel_opc 00:05:19.346 12:19:13 -- accel/accel.sh@17 -- # local accel_module 00:05:19.346 12:19:13 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:19.346 12:19:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:19.346 12:19:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:19.346 12:19:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:19.346 12:19:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:19.346 12:19:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:19.346 12:19:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:19.346 12:19:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:19.346 12:19:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:19.346 12:19:13 -- accel/accel.sh@42 -- # jq -r . 00:05:19.346 [2024-07-12 12:19:13.065718] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:19.346 [2024-07-12 12:19:13.065783] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156608 ] 00:05:19.346 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.346 [2024-07-12 12:19:13.130658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.346 [2024-07-12 12:19:13.247354] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.717 12:19:14 -- accel/accel.sh@18 -- # out=' 00:05:20.717 SPDK Configuration: 00:05:20.717 Core mask: 0x1 00:05:20.717 00:05:20.717 Accel Perf Configuration: 00:05:20.717 Workload Type: crc32c 00:05:20.717 CRC-32C seed: 32 00:05:20.717 Transfer size: 4096 bytes 00:05:20.717 Vector count 1 00:05:20.717 Module: software 00:05:20.717 Queue depth: 32 00:05:20.717 Allocate depth: 32 00:05:20.717 # threads/core: 1 00:05:20.717 Run time: 1 seconds 00:05:20.717 Verify: Yes 00:05:20.717 00:05:20.717 Running for 1 seconds... 00:05:20.717 00:05:20.717 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:20.717 ------------------------------------------------------------------------------------ 00:05:20.717 0,0 406272/s 1587 MiB/s 0 0 00:05:20.717 ==================================================================================== 00:05:20.717 Total 406272/s 1587 MiB/s 0 0' 00:05:20.717 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.717 12:19:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:20.717 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.717 12:19:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:20.717 12:19:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:20.717 12:19:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:20.717 12:19:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:20.717 12:19:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:20.717 12:19:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:20.717 12:19:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:20.717 12:19:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:20.717 12:19:14 -- accel/accel.sh@42 -- # jq -r . 00:05:20.717 [2024-07-12 12:19:14.533430] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:20.717 [2024-07-12 12:19:14.533506] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1156873 ] 00:05:20.717 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.717 [2024-07-12 12:19:14.597076] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.974 [2024-07-12 12:19:14.713247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=0x1 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=crc32c 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=32 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=software 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@23 -- # accel_module=software 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=32 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=32 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=1 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val=Yes 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:20.974 12:19:14 -- accel/accel.sh@21 -- # val= 00:05:20.974 12:19:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # IFS=: 00:05:20.974 12:19:14 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@21 -- # val= 00:05:22.345 12:19:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # IFS=: 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@21 -- # val= 00:05:22.345 12:19:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # IFS=: 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@21 -- # val= 00:05:22.345 12:19:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # IFS=: 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@21 -- # val= 00:05:22.345 12:19:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # IFS=: 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@21 -- # val= 00:05:22.345 12:19:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # IFS=: 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@21 -- # val= 00:05:22.345 12:19:15 -- accel/accel.sh@22 -- # case "$var" in 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # IFS=: 00:05:22.345 12:19:15 -- accel/accel.sh@20 -- # read -r var val 00:05:22.345 12:19:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:22.346 12:19:15 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:22.346 12:19:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:22.346 00:05:22.346 real 0m2.939s 00:05:22.346 user 0m2.646s 00:05:22.346 sys 0m0.285s 00:05:22.346 12:19:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:22.346 12:19:15 -- common/autotest_common.sh@10 -- # set +x 00:05:22.346 ************************************ 00:05:22.346 END TEST accel_crc32c 00:05:22.346 ************************************ 00:05:22.346 12:19:16 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:22.346 12:19:16 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:22.346 12:19:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:22.346 12:19:16 -- common/autotest_common.sh@10 -- # set +x 00:05:22.346 ************************************ 00:05:22.346 START TEST accel_crc32c_C2 00:05:22.346 ************************************ 00:05:22.346 12:19:16 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:22.346 12:19:16 -- accel/accel.sh@16 -- # local accel_opc 00:05:22.346 12:19:16 -- accel/accel.sh@17 -- # local accel_module 00:05:22.346 12:19:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:22.346 12:19:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:22.346 12:19:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:22.346 12:19:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:22.346 12:19:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:22.346 12:19:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:22.346 12:19:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:22.346 12:19:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:22.346 12:19:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:22.346 12:19:16 -- accel/accel.sh@42 -- # jq -r . 00:05:22.346 [2024-07-12 12:19:16.033034] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:22.346 [2024-07-12 12:19:16.033116] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1157036 ] 00:05:22.346 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.346 [2024-07-12 12:19:16.096862] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.346 [2024-07-12 12:19:16.211449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.718 12:19:17 -- accel/accel.sh@18 -- # out=' 00:05:23.718 SPDK Configuration: 00:05:23.718 Core mask: 0x1 00:05:23.718 00:05:23.718 Accel Perf Configuration: 00:05:23.718 Workload Type: crc32c 00:05:23.718 CRC-32C seed: 0 00:05:23.718 Transfer size: 4096 bytes 00:05:23.718 Vector count 2 00:05:23.718 Module: software 00:05:23.718 Queue depth: 32 00:05:23.718 Allocate depth: 32 00:05:23.718 # threads/core: 1 00:05:23.718 Run time: 1 seconds 00:05:23.718 Verify: Yes 00:05:23.718 00:05:23.718 Running for 1 seconds... 00:05:23.718 00:05:23.718 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:23.718 ------------------------------------------------------------------------------------ 00:05:23.718 0,0 318720/s 2490 MiB/s 0 0 00:05:23.718 ==================================================================================== 00:05:23.718 Total 318720/s 1245 MiB/s 0 0' 00:05:23.718 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.718 12:19:17 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:23.718 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.718 12:19:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:23.718 12:19:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:23.718 12:19:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:23.718 12:19:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:23.718 12:19:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:23.718 12:19:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:23.718 12:19:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:23.718 12:19:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:23.718 12:19:17 -- accel/accel.sh@42 -- # jq -r . 00:05:23.718 [2024-07-12 12:19:17.504895] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:23.718 [2024-07-12 12:19:17.505003] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1157174 ] 00:05:23.718 EAL: No free 2048 kB hugepages reported on node 1 00:05:23.718 [2024-07-12 12:19:17.567574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:23.975 [2024-07-12 12:19:17.684136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val=0x1 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val=crc32c 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val=0 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.975 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.975 12:19:17 -- accel/accel.sh@21 -- # val=software 00:05:23.975 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@23 -- # accel_module=software 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val=32 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val=32 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val=1 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val=Yes 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:23.976 12:19:17 -- accel/accel.sh@21 -- # val= 00:05:23.976 12:19:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # IFS=: 00:05:23.976 12:19:17 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@21 -- # val= 00:05:25.348 12:19:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # IFS=: 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@21 -- # val= 00:05:25.348 12:19:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # IFS=: 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@21 -- # val= 00:05:25.348 12:19:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # IFS=: 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@21 -- # val= 00:05:25.348 12:19:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # IFS=: 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@21 -- # val= 00:05:25.348 12:19:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # IFS=: 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@21 -- # val= 00:05:25.348 12:19:18 -- accel/accel.sh@22 -- # case "$var" in 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # IFS=: 00:05:25.348 12:19:18 -- accel/accel.sh@20 -- # read -r var val 00:05:25.348 12:19:18 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:25.348 12:19:18 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:25.348 12:19:18 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:25.348 00:05:25.348 real 0m2.935s 00:05:25.348 user 0m2.643s 00:05:25.348 sys 0m0.283s 00:05:25.348 12:19:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:25.348 12:19:18 -- common/autotest_common.sh@10 -- # set +x 00:05:25.348 ************************************ 00:05:25.348 END TEST accel_crc32c_C2 00:05:25.348 ************************************ 00:05:25.348 12:19:18 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:25.348 12:19:18 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:25.348 12:19:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:25.348 12:19:18 -- common/autotest_common.sh@10 -- # set +x 00:05:25.348 ************************************ 00:05:25.348 START TEST accel_copy 00:05:25.348 ************************************ 00:05:25.348 12:19:18 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy -y 00:05:25.348 12:19:18 -- accel/accel.sh@16 -- # local accel_opc 00:05:25.348 12:19:18 -- accel/accel.sh@17 -- # local accel_module 00:05:25.348 12:19:18 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:25.348 12:19:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:25.348 12:19:18 -- accel/accel.sh@12 -- # build_accel_config 00:05:25.348 12:19:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:25.348 12:19:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:25.348 12:19:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:25.348 12:19:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:25.348 12:19:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:25.348 12:19:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:25.348 12:19:18 -- accel/accel.sh@42 -- # jq -r . 00:05:25.348 [2024-07-12 12:19:18.988119] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:25.348 [2024-07-12 12:19:18.988205] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1157454 ] 00:05:25.348 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.348 [2024-07-12 12:19:19.050529] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.348 [2024-07-12 12:19:19.169467] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.732 12:19:20 -- accel/accel.sh@18 -- # out=' 00:05:26.732 SPDK Configuration: 00:05:26.732 Core mask: 0x1 00:05:26.732 00:05:26.732 Accel Perf Configuration: 00:05:26.732 Workload Type: copy 00:05:26.732 Transfer size: 4096 bytes 00:05:26.732 Vector count 1 00:05:26.732 Module: software 00:05:26.732 Queue depth: 32 00:05:26.732 Allocate depth: 32 00:05:26.732 # threads/core: 1 00:05:26.732 Run time: 1 seconds 00:05:26.732 Verify: Yes 00:05:26.732 00:05:26.732 Running for 1 seconds... 00:05:26.732 00:05:26.732 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:26.732 ------------------------------------------------------------------------------------ 00:05:26.732 0,0 279104/s 1090 MiB/s 0 0 00:05:26.732 ==================================================================================== 00:05:26.732 Total 279104/s 1090 MiB/s 0 0' 00:05:26.732 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:26.732 12:19:20 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:26.732 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:26.732 12:19:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:26.732 12:19:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:26.732 12:19:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:26.732 12:19:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:26.732 12:19:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:26.732 12:19:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:26.732 12:19:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:26.732 12:19:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:26.732 12:19:20 -- accel/accel.sh@42 -- # jq -r . 00:05:26.732 [2024-07-12 12:19:20.448401] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:26.733 [2024-07-12 12:19:20.448479] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1157602 ] 00:05:26.733 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.733 [2024-07-12 12:19:20.510635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.733 [2024-07-12 12:19:20.627605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=0x1 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=copy 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=software 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@23 -- # accel_module=software 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=32 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=32 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=1 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val=Yes 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:27.029 12:19:20 -- accel/accel.sh@21 -- # val= 00:05:27.029 12:19:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # IFS=: 00:05:27.029 12:19:20 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@21 -- # val= 00:05:28.403 12:19:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # IFS=: 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@21 -- # val= 00:05:28.403 12:19:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # IFS=: 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@21 -- # val= 00:05:28.403 12:19:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # IFS=: 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@21 -- # val= 00:05:28.403 12:19:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # IFS=: 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@21 -- # val= 00:05:28.403 12:19:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # IFS=: 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@21 -- # val= 00:05:28.403 12:19:21 -- accel/accel.sh@22 -- # case "$var" in 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # IFS=: 00:05:28.403 12:19:21 -- accel/accel.sh@20 -- # read -r var val 00:05:28.403 12:19:21 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:28.403 12:19:21 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:28.403 12:19:21 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:28.403 00:05:28.403 real 0m2.934s 00:05:28.403 user 0m2.642s 00:05:28.403 sys 0m0.282s 00:05:28.403 12:19:21 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:28.403 12:19:21 -- common/autotest_common.sh@10 -- # set +x 00:05:28.403 ************************************ 00:05:28.403 END TEST accel_copy 00:05:28.403 ************************************ 00:05:28.403 12:19:21 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:28.403 12:19:21 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:05:28.403 12:19:21 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:28.403 12:19:21 -- common/autotest_common.sh@10 -- # set +x 00:05:28.403 ************************************ 00:05:28.403 START TEST accel_fill 00:05:28.403 ************************************ 00:05:28.403 12:19:21 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:28.403 12:19:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:28.403 12:19:21 -- accel/accel.sh@17 -- # local accel_module 00:05:28.403 12:19:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:28.403 12:19:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:28.403 12:19:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:28.403 12:19:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:28.403 12:19:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:28.403 12:19:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:28.403 12:19:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:28.403 12:19:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:28.403 12:19:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:28.403 12:19:21 -- accel/accel.sh@42 -- # jq -r . 00:05:28.403 [2024-07-12 12:19:21.942094] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:28.403 [2024-07-12 12:19:21.942188] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1157765 ] 00:05:28.403 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.403 [2024-07-12 12:19:22.005225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.403 [2024-07-12 12:19:22.121689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.778 12:19:23 -- accel/accel.sh@18 -- # out=' 00:05:29.778 SPDK Configuration: 00:05:29.778 Core mask: 0x1 00:05:29.778 00:05:29.778 Accel Perf Configuration: 00:05:29.778 Workload Type: fill 00:05:29.778 Fill pattern: 0x80 00:05:29.778 Transfer size: 4096 bytes 00:05:29.778 Vector count 1 00:05:29.778 Module: software 00:05:29.778 Queue depth: 64 00:05:29.778 Allocate depth: 64 00:05:29.778 # threads/core: 1 00:05:29.778 Run time: 1 seconds 00:05:29.778 Verify: Yes 00:05:29.778 00:05:29.778 Running for 1 seconds... 00:05:29.778 00:05:29.778 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:29.778 ------------------------------------------------------------------------------------ 00:05:29.778 0,0 405952/s 1585 MiB/s 0 0 00:05:29.778 ==================================================================================== 00:05:29.778 Total 405952/s 1585 MiB/s 0 0' 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:29.778 12:19:23 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.778 12:19:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.778 12:19:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.778 12:19:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.778 12:19:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.778 12:19:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.778 12:19:23 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.778 12:19:23 -- accel/accel.sh@42 -- # jq -r . 00:05:29.778 [2024-07-12 12:19:23.409284] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:29.778 [2024-07-12 12:19:23.409362] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1157971 ] 00:05:29.778 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.778 [2024-07-12 12:19:23.472937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.778 [2024-07-12 12:19:23.589214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val=0x1 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val=fill 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val=0x80 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.778 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.778 12:19:23 -- accel/accel.sh@21 -- # val=software 00:05:29.778 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@23 -- # accel_module=software 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val=64 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val=64 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val=1 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val=Yes 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:29.779 12:19:23 -- accel/accel.sh@21 -- # val= 00:05:29.779 12:19:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # IFS=: 00:05:29.779 12:19:23 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@21 -- # val= 00:05:31.154 12:19:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # IFS=: 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@21 -- # val= 00:05:31.154 12:19:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # IFS=: 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@21 -- # val= 00:05:31.154 12:19:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # IFS=: 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@21 -- # val= 00:05:31.154 12:19:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # IFS=: 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@21 -- # val= 00:05:31.154 12:19:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # IFS=: 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@21 -- # val= 00:05:31.154 12:19:24 -- accel/accel.sh@22 -- # case "$var" in 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # IFS=: 00:05:31.154 12:19:24 -- accel/accel.sh@20 -- # read -r var val 00:05:31.154 12:19:24 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:31.154 12:19:24 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:31.154 12:19:24 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:31.154 00:05:31.154 real 0m2.934s 00:05:31.154 user 0m2.636s 00:05:31.154 sys 0m0.288s 00:05:31.154 12:19:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:31.154 12:19:24 -- common/autotest_common.sh@10 -- # set +x 00:05:31.154 ************************************ 00:05:31.154 END TEST accel_fill 00:05:31.154 ************************************ 00:05:31.154 12:19:24 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:31.154 12:19:24 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:31.154 12:19:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:31.154 12:19:24 -- common/autotest_common.sh@10 -- # set +x 00:05:31.154 ************************************ 00:05:31.154 START TEST accel_copy_crc32c 00:05:31.154 ************************************ 00:05:31.154 12:19:24 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y 00:05:31.154 12:19:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:31.154 12:19:24 -- accel/accel.sh@17 -- # local accel_module 00:05:31.154 12:19:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:31.154 12:19:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:31.154 12:19:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:31.154 12:19:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:31.154 12:19:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:31.154 12:19:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:31.154 12:19:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:31.154 12:19:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:31.154 12:19:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:31.154 12:19:24 -- accel/accel.sh@42 -- # jq -r . 00:05:31.154 [2024-07-12 12:19:24.898775] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:31.154 [2024-07-12 12:19:24.898859] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1158189 ] 00:05:31.154 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.154 [2024-07-12 12:19:24.960765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.412 [2024-07-12 12:19:25.078517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.787 12:19:26 -- accel/accel.sh@18 -- # out=' 00:05:32.788 SPDK Configuration: 00:05:32.788 Core mask: 0x1 00:05:32.788 00:05:32.788 Accel Perf Configuration: 00:05:32.788 Workload Type: copy_crc32c 00:05:32.788 CRC-32C seed: 0 00:05:32.788 Vector size: 4096 bytes 00:05:32.788 Transfer size: 4096 bytes 00:05:32.788 Vector count 1 00:05:32.788 Module: software 00:05:32.788 Queue depth: 32 00:05:32.788 Allocate depth: 32 00:05:32.788 # threads/core: 1 00:05:32.788 Run time: 1 seconds 00:05:32.788 Verify: Yes 00:05:32.788 00:05:32.788 Running for 1 seconds... 00:05:32.788 00:05:32.788 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:32.788 ------------------------------------------------------------------------------------ 00:05:32.788 0,0 218304/s 852 MiB/s 0 0 00:05:32.788 ==================================================================================== 00:05:32.788 Total 218304/s 852 MiB/s 0 0' 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:32.788 12:19:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.788 12:19:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.788 12:19:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.788 12:19:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.788 12:19:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.788 12:19:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.788 12:19:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.788 12:19:26 -- accel/accel.sh@42 -- # jq -r . 00:05:32.788 [2024-07-12 12:19:26.372449] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:32.788 [2024-07-12 12:19:26.372528] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1158331 ] 00:05:32.788 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.788 [2024-07-12 12:19:26.435524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.788 [2024-07-12 12:19:26.551850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=0x1 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=0 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=software 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@23 -- # accel_module=software 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=32 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=32 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=1 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val=Yes 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:32.788 12:19:26 -- accel/accel.sh@21 -- # val= 00:05:32.788 12:19:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # IFS=: 00:05:32.788 12:19:26 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@21 -- # val= 00:05:34.161 12:19:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # IFS=: 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@21 -- # val= 00:05:34.161 12:19:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # IFS=: 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@21 -- # val= 00:05:34.161 12:19:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # IFS=: 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@21 -- # val= 00:05:34.161 12:19:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # IFS=: 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@21 -- # val= 00:05:34.161 12:19:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # IFS=: 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@21 -- # val= 00:05:34.161 12:19:27 -- accel/accel.sh@22 -- # case "$var" in 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # IFS=: 00:05:34.161 12:19:27 -- accel/accel.sh@20 -- # read -r var val 00:05:34.161 12:19:27 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:34.161 12:19:27 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:34.161 12:19:27 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:34.161 00:05:34.161 real 0m2.947s 00:05:34.161 user 0m2.643s 00:05:34.161 sys 0m0.295s 00:05:34.161 12:19:27 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:34.161 12:19:27 -- common/autotest_common.sh@10 -- # set +x 00:05:34.161 ************************************ 00:05:34.161 END TEST accel_copy_crc32c 00:05:34.161 ************************************ 00:05:34.161 12:19:27 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:34.161 12:19:27 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:34.161 12:19:27 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:34.161 12:19:27 -- common/autotest_common.sh@10 -- # set +x 00:05:34.161 ************************************ 00:05:34.161 START TEST accel_copy_crc32c_C2 00:05:34.161 ************************************ 00:05:34.161 12:19:27 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:34.161 12:19:27 -- accel/accel.sh@16 -- # local accel_opc 00:05:34.161 12:19:27 -- accel/accel.sh@17 -- # local accel_module 00:05:34.161 12:19:27 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:34.161 12:19:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:34.161 12:19:27 -- accel/accel.sh@12 -- # build_accel_config 00:05:34.161 12:19:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:34.161 12:19:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:34.161 12:19:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:34.161 12:19:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:34.161 12:19:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:34.161 12:19:27 -- accel/accel.sh@41 -- # local IFS=, 00:05:34.161 12:19:27 -- accel/accel.sh@42 -- # jq -r . 00:05:34.161 [2024-07-12 12:19:27.870481] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:34.161 [2024-07-12 12:19:27.870557] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1158484 ] 00:05:34.161 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.161 [2024-07-12 12:19:27.933319] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:34.161 [2024-07-12 12:19:28.050441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.539 12:19:29 -- accel/accel.sh@18 -- # out=' 00:05:35.539 SPDK Configuration: 00:05:35.539 Core mask: 0x1 00:05:35.539 00:05:35.539 Accel Perf Configuration: 00:05:35.539 Workload Type: copy_crc32c 00:05:35.539 CRC-32C seed: 0 00:05:35.539 Vector size: 4096 bytes 00:05:35.539 Transfer size: 8192 bytes 00:05:35.539 Vector count 2 00:05:35.539 Module: software 00:05:35.539 Queue depth: 32 00:05:35.539 Allocate depth: 32 00:05:35.539 # threads/core: 1 00:05:35.539 Run time: 1 seconds 00:05:35.539 Verify: Yes 00:05:35.539 00:05:35.539 Running for 1 seconds... 00:05:35.539 00:05:35.539 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:35.539 ------------------------------------------------------------------------------------ 00:05:35.539 0,0 154944/s 1210 MiB/s 0 0 00:05:35.539 ==================================================================================== 00:05:35.539 Total 154944/s 605 MiB/s 0 0' 00:05:35.539 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.539 12:19:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:35.539 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.539 12:19:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:35.539 12:19:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.539 12:19:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.539 12:19:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.539 12:19:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.539 12:19:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.539 12:19:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.539 12:19:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.539 12:19:29 -- accel/accel.sh@42 -- # jq -r . 00:05:35.539 [2024-07-12 12:19:29.342454] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:35.539 [2024-07-12 12:19:29.342537] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1158753 ] 00:05:35.539 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.539 [2024-07-12 12:19:29.406055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.796 [2024-07-12 12:19:29.521735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=0x1 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=0 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=software 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@23 -- # accel_module=software 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=32 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=32 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=1 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val=Yes 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:35.796 12:19:29 -- accel/accel.sh@21 -- # val= 00:05:35.796 12:19:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # IFS=: 00:05:35.796 12:19:29 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@21 -- # val= 00:05:37.168 12:19:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # IFS=: 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@21 -- # val= 00:05:37.168 12:19:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # IFS=: 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@21 -- # val= 00:05:37.168 12:19:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # IFS=: 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@21 -- # val= 00:05:37.168 12:19:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # IFS=: 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@21 -- # val= 00:05:37.168 12:19:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # IFS=: 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@21 -- # val= 00:05:37.168 12:19:30 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # IFS=: 00:05:37.168 12:19:30 -- accel/accel.sh@20 -- # read -r var val 00:05:37.168 12:19:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:37.168 12:19:30 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:37.168 12:19:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:37.168 00:05:37.168 real 0m2.950s 00:05:37.168 user 0m2.667s 00:05:37.168 sys 0m0.274s 00:05:37.168 12:19:30 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:37.168 12:19:30 -- common/autotest_common.sh@10 -- # set +x 00:05:37.168 ************************************ 00:05:37.168 END TEST accel_copy_crc32c_C2 00:05:37.168 ************************************ 00:05:37.168 12:19:30 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:37.168 12:19:30 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:37.168 12:19:30 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:37.168 12:19:30 -- common/autotest_common.sh@10 -- # set +x 00:05:37.168 ************************************ 00:05:37.168 START TEST accel_dualcast 00:05:37.168 ************************************ 00:05:37.168 12:19:30 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dualcast -y 00:05:37.168 12:19:30 -- accel/accel.sh@16 -- # local accel_opc 00:05:37.168 12:19:30 -- accel/accel.sh@17 -- # local accel_module 00:05:37.168 12:19:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:37.168 12:19:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:37.168 12:19:30 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.168 12:19:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.168 12:19:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.168 12:19:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.168 12:19:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.168 12:19:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.168 12:19:30 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.168 12:19:30 -- accel/accel.sh@42 -- # jq -r . 00:05:37.168 [2024-07-12 12:19:30.850276] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:37.168 [2024-07-12 12:19:30.850368] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1158912 ] 00:05:37.168 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.168 [2024-07-12 12:19:30.914382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.168 [2024-07-12 12:19:31.033840] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.539 12:19:32 -- accel/accel.sh@18 -- # out=' 00:05:38.539 SPDK Configuration: 00:05:38.539 Core mask: 0x1 00:05:38.539 00:05:38.539 Accel Perf Configuration: 00:05:38.539 Workload Type: dualcast 00:05:38.539 Transfer size: 4096 bytes 00:05:38.539 Vector count 1 00:05:38.539 Module: software 00:05:38.539 Queue depth: 32 00:05:38.539 Allocate depth: 32 00:05:38.539 # threads/core: 1 00:05:38.539 Run time: 1 seconds 00:05:38.539 Verify: Yes 00:05:38.539 00:05:38.539 Running for 1 seconds... 00:05:38.539 00:05:38.539 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.539 ------------------------------------------------------------------------------------ 00:05:38.539 0,0 297216/s 1161 MiB/s 0 0 00:05:38.539 ==================================================================================== 00:05:38.539 Total 297216/s 1161 MiB/s 0 0' 00:05:38.539 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.539 12:19:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:38.539 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.539 12:19:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:38.539 12:19:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.540 12:19:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.540 12:19:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.540 12:19:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.540 12:19:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.540 12:19:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.540 12:19:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.540 12:19:32 -- accel/accel.sh@42 -- # jq -r . 00:05:38.540 [2024-07-12 12:19:32.335569] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:38.540 [2024-07-12 12:19:32.335652] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1159058 ] 00:05:38.540 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.540 [2024-07-12 12:19:32.399965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.797 [2024-07-12 12:19:32.519542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.797 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.797 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.797 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.797 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.797 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.797 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.797 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.797 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=0x1 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=dualcast 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=software 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=32 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=32 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=1 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val=Yes 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:38.798 12:19:32 -- accel/accel.sh@21 -- # val= 00:05:38.798 12:19:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # IFS=: 00:05:38.798 12:19:32 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@21 -- # val= 00:05:40.167 12:19:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # IFS=: 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@21 -- # val= 00:05:40.167 12:19:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # IFS=: 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@21 -- # val= 00:05:40.167 12:19:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # IFS=: 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@21 -- # val= 00:05:40.167 12:19:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # IFS=: 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@21 -- # val= 00:05:40.167 12:19:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # IFS=: 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@21 -- # val= 00:05:40.167 12:19:33 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # IFS=: 00:05:40.167 12:19:33 -- accel/accel.sh@20 -- # read -r var val 00:05:40.167 12:19:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:40.167 12:19:33 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:40.167 12:19:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:40.167 00:05:40.167 real 0m2.965s 00:05:40.167 user 0m2.673s 00:05:40.167 sys 0m0.283s 00:05:40.167 12:19:33 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:40.167 12:19:33 -- common/autotest_common.sh@10 -- # set +x 00:05:40.167 ************************************ 00:05:40.167 END TEST accel_dualcast 00:05:40.167 ************************************ 00:05:40.167 12:19:33 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:40.167 12:19:33 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:40.167 12:19:33 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:40.167 12:19:33 -- common/autotest_common.sh@10 -- # set +x 00:05:40.167 ************************************ 00:05:40.167 START TEST accel_compare 00:05:40.167 ************************************ 00:05:40.167 12:19:33 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compare -y 00:05:40.167 12:19:33 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.167 12:19:33 -- accel/accel.sh@17 -- # local accel_module 00:05:40.167 12:19:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:40.167 12:19:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:40.167 12:19:33 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.167 12:19:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.167 12:19:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.167 12:19:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.167 12:19:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.167 12:19:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.167 12:19:33 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.167 12:19:33 -- accel/accel.sh@42 -- # jq -r . 00:05:40.167 [2024-07-12 12:19:33.841267] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:40.167 [2024-07-12 12:19:33.841357] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1159330 ] 00:05:40.167 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.167 [2024-07-12 12:19:33.905372] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.167 [2024-07-12 12:19:34.028978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.556 12:19:35 -- accel/accel.sh@18 -- # out=' 00:05:41.556 SPDK Configuration: 00:05:41.556 Core mask: 0x1 00:05:41.556 00:05:41.556 Accel Perf Configuration: 00:05:41.556 Workload Type: compare 00:05:41.556 Transfer size: 4096 bytes 00:05:41.556 Vector count 1 00:05:41.556 Module: software 00:05:41.556 Queue depth: 32 00:05:41.556 Allocate depth: 32 00:05:41.556 # threads/core: 1 00:05:41.556 Run time: 1 seconds 00:05:41.556 Verify: Yes 00:05:41.556 00:05:41.556 Running for 1 seconds... 00:05:41.556 00:05:41.556 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.556 ------------------------------------------------------------------------------------ 00:05:41.556 0,0 399584/s 1560 MiB/s 0 0 00:05:41.556 ==================================================================================== 00:05:41.556 Total 399584/s 1560 MiB/s 0 0' 00:05:41.556 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.556 12:19:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:41.556 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.556 12:19:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:41.556 12:19:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.556 12:19:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.556 12:19:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.556 12:19:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.556 12:19:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.556 12:19:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.556 12:19:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.556 12:19:35 -- accel/accel.sh@42 -- # jq -r . 00:05:41.556 [2024-07-12 12:19:35.319665] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:41.556 [2024-07-12 12:19:35.319756] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1159486 ] 00:05:41.556 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.556 [2024-07-12 12:19:35.381955] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.814 [2024-07-12 12:19:35.503725] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=0x1 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=compare 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=software 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=32 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=32 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=1 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val=Yes 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.814 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.814 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.814 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.815 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:41.815 12:19:35 -- accel/accel.sh@21 -- # val= 00:05:41.815 12:19:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.815 12:19:35 -- accel/accel.sh@20 -- # IFS=: 00:05:41.815 12:19:35 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@21 -- # val= 00:05:43.189 12:19:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # IFS=: 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@21 -- # val= 00:05:43.189 12:19:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # IFS=: 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@21 -- # val= 00:05:43.189 12:19:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # IFS=: 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@21 -- # val= 00:05:43.189 12:19:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # IFS=: 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@21 -- # val= 00:05:43.189 12:19:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # IFS=: 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@21 -- # val= 00:05:43.189 12:19:36 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # IFS=: 00:05:43.189 12:19:36 -- accel/accel.sh@20 -- # read -r var val 00:05:43.189 12:19:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.189 12:19:36 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:43.189 12:19:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.189 00:05:43.189 real 0m2.967s 00:05:43.189 user 0m2.679s 00:05:43.189 sys 0m0.280s 00:05:43.189 12:19:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:43.189 12:19:36 -- common/autotest_common.sh@10 -- # set +x 00:05:43.189 ************************************ 00:05:43.189 END TEST accel_compare 00:05:43.189 ************************************ 00:05:43.189 12:19:36 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:43.189 12:19:36 -- common/autotest_common.sh@1077 -- # '[' 7 -le 1 ']' 00:05:43.189 12:19:36 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:43.189 12:19:36 -- common/autotest_common.sh@10 -- # set +x 00:05:43.189 ************************************ 00:05:43.189 START TEST accel_xor 00:05:43.189 ************************************ 00:05:43.189 12:19:36 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y 00:05:43.189 12:19:36 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.189 12:19:36 -- accel/accel.sh@17 -- # local accel_module 00:05:43.189 12:19:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:43.190 12:19:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:43.190 12:19:36 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.190 12:19:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.190 12:19:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.190 12:19:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.190 12:19:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.190 12:19:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.190 12:19:36 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.190 12:19:36 -- accel/accel.sh@42 -- # jq -r . 00:05:43.190 [2024-07-12 12:19:36.830486] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:43.190 [2024-07-12 12:19:36.830566] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1159639 ] 00:05:43.190 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.190 [2024-07-12 12:19:36.891858] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.190 [2024-07-12 12:19:37.016724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.563 12:19:38 -- accel/accel.sh@18 -- # out=' 00:05:44.563 SPDK Configuration: 00:05:44.563 Core mask: 0x1 00:05:44.563 00:05:44.563 Accel Perf Configuration: 00:05:44.563 Workload Type: xor 00:05:44.563 Source buffers: 2 00:05:44.563 Transfer size: 4096 bytes 00:05:44.563 Vector count 1 00:05:44.563 Module: software 00:05:44.563 Queue depth: 32 00:05:44.563 Allocate depth: 32 00:05:44.563 # threads/core: 1 00:05:44.563 Run time: 1 seconds 00:05:44.563 Verify: Yes 00:05:44.563 00:05:44.563 Running for 1 seconds... 00:05:44.563 00:05:44.563 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:44.563 ------------------------------------------------------------------------------------ 00:05:44.563 0,0 192448/s 751 MiB/s 0 0 00:05:44.563 ==================================================================================== 00:05:44.563 Total 192448/s 751 MiB/s 0 0' 00:05:44.563 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.563 12:19:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:44.563 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.563 12:19:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:44.563 12:19:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:44.563 12:19:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:44.563 12:19:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:44.563 12:19:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:44.563 12:19:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:44.563 12:19:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:44.563 12:19:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:44.563 12:19:38 -- accel/accel.sh@42 -- # jq -r . 00:05:44.563 [2024-07-12 12:19:38.309401] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:44.563 [2024-07-12 12:19:38.309484] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1159904 ] 00:05:44.563 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.563 [2024-07-12 12:19:38.373921] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.821 [2024-07-12 12:19:38.496216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.821 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.821 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.821 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.821 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.821 12:19:38 -- accel/accel.sh@21 -- # val=0x1 00:05:44.821 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.821 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.821 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.821 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.821 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.821 12:19:38 -- accel/accel.sh@21 -- # val=xor 00:05:44.821 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.821 12:19:38 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.821 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val=2 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val=software 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val=32 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val=32 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val=1 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val=Yes 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:44.822 12:19:38 -- accel/accel.sh@21 -- # val= 00:05:44.822 12:19:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # IFS=: 00:05:44.822 12:19:38 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@21 -- # val= 00:05:46.194 12:19:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # IFS=: 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@21 -- # val= 00:05:46.194 12:19:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # IFS=: 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@21 -- # val= 00:05:46.194 12:19:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # IFS=: 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@21 -- # val= 00:05:46.194 12:19:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # IFS=: 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@21 -- # val= 00:05:46.194 12:19:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # IFS=: 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@21 -- # val= 00:05:46.194 12:19:39 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # IFS=: 00:05:46.194 12:19:39 -- accel/accel.sh@20 -- # read -r var val 00:05:46.194 12:19:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.194 12:19:39 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:46.194 12:19:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.194 00:05:46.194 real 0m2.955s 00:05:46.194 user 0m2.666s 00:05:46.194 sys 0m0.280s 00:05:46.194 12:19:39 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:46.194 12:19:39 -- common/autotest_common.sh@10 -- # set +x 00:05:46.194 ************************************ 00:05:46.194 END TEST accel_xor 00:05:46.194 ************************************ 00:05:46.194 12:19:39 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:46.194 12:19:39 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:05:46.194 12:19:39 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:46.194 12:19:39 -- common/autotest_common.sh@10 -- # set +x 00:05:46.194 ************************************ 00:05:46.194 START TEST accel_xor 00:05:46.194 ************************************ 00:05:46.194 12:19:39 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w xor -y -x 3 00:05:46.194 12:19:39 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.194 12:19:39 -- accel/accel.sh@17 -- # local accel_module 00:05:46.194 12:19:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:46.194 12:19:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:46.194 12:19:39 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.194 12:19:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.194 12:19:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.194 12:19:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.194 12:19:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.194 12:19:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.194 12:19:39 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.194 12:19:39 -- accel/accel.sh@42 -- # jq -r . 00:05:46.194 [2024-07-12 12:19:39.811229] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:46.194 [2024-07-12 12:19:39.811321] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1160066 ] 00:05:46.194 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.194 [2024-07-12 12:19:39.873994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.194 [2024-07-12 12:19:39.992193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.583 12:19:41 -- accel/accel.sh@18 -- # out=' 00:05:47.583 SPDK Configuration: 00:05:47.583 Core mask: 0x1 00:05:47.583 00:05:47.583 Accel Perf Configuration: 00:05:47.583 Workload Type: xor 00:05:47.583 Source buffers: 3 00:05:47.583 Transfer size: 4096 bytes 00:05:47.583 Vector count 1 00:05:47.583 Module: software 00:05:47.583 Queue depth: 32 00:05:47.583 Allocate depth: 32 00:05:47.583 # threads/core: 1 00:05:47.583 Run time: 1 seconds 00:05:47.583 Verify: Yes 00:05:47.583 00:05:47.583 Running for 1 seconds... 00:05:47.583 00:05:47.583 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.583 ------------------------------------------------------------------------------------ 00:05:47.583 0,0 183168/s 715 MiB/s 0 0 00:05:47.583 ==================================================================================== 00:05:47.583 Total 183168/s 715 MiB/s 0 0' 00:05:47.583 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.583 12:19:41 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:47.583 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.583 12:19:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:47.583 12:19:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.583 12:19:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.583 12:19:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.583 12:19:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.583 12:19:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.583 12:19:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.583 12:19:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.583 12:19:41 -- accel/accel.sh@42 -- # jq -r . 00:05:47.583 [2024-07-12 12:19:41.295531] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:47.583 [2024-07-12 12:19:41.295616] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1160215 ] 00:05:47.583 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.583 [2024-07-12 12:19:41.359105] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.583 [2024-07-12 12:19:41.479808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=0x1 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=xor 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=3 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=software 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=32 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=32 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=1 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val=Yes 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:47.841 12:19:41 -- accel/accel.sh@21 -- # val= 00:05:47.841 12:19:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # IFS=: 00:05:47.841 12:19:41 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@21 -- # val= 00:05:49.212 12:19:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # IFS=: 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@21 -- # val= 00:05:49.212 12:19:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # IFS=: 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@21 -- # val= 00:05:49.212 12:19:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # IFS=: 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@21 -- # val= 00:05:49.212 12:19:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # IFS=: 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@21 -- # val= 00:05:49.212 12:19:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # IFS=: 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@21 -- # val= 00:05:49.212 12:19:42 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # IFS=: 00:05:49.212 12:19:42 -- accel/accel.sh@20 -- # read -r var val 00:05:49.212 12:19:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.212 12:19:42 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:49.212 12:19:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.212 00:05:49.212 real 0m2.964s 00:05:49.212 user 0m2.663s 00:05:49.212 sys 0m0.292s 00:05:49.212 12:19:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:49.212 12:19:42 -- common/autotest_common.sh@10 -- # set +x 00:05:49.212 ************************************ 00:05:49.212 END TEST accel_xor 00:05:49.212 ************************************ 00:05:49.212 12:19:42 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:05:49.212 12:19:42 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:49.212 12:19:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:49.212 12:19:42 -- common/autotest_common.sh@10 -- # set +x 00:05:49.212 ************************************ 00:05:49.212 START TEST accel_dif_verify 00:05:49.212 ************************************ 00:05:49.212 12:19:42 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_verify 00:05:49.212 12:19:42 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.212 12:19:42 -- accel/accel.sh@17 -- # local accel_module 00:05:49.212 12:19:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:05:49.212 12:19:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:49.212 12:19:42 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.212 12:19:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.212 12:19:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.212 12:19:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.212 12:19:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.212 12:19:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.212 12:19:42 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.212 12:19:42 -- accel/accel.sh@42 -- # jq -r . 00:05:49.212 [2024-07-12 12:19:42.802995] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:49.212 [2024-07-12 12:19:42.803094] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1160487 ] 00:05:49.212 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.212 [2024-07-12 12:19:42.868172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.212 [2024-07-12 12:19:42.987644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.591 12:19:44 -- accel/accel.sh@18 -- # out=' 00:05:50.591 SPDK Configuration: 00:05:50.591 Core mask: 0x1 00:05:50.591 00:05:50.591 Accel Perf Configuration: 00:05:50.591 Workload Type: dif_verify 00:05:50.591 Vector size: 4096 bytes 00:05:50.591 Transfer size: 4096 bytes 00:05:50.591 Block size: 512 bytes 00:05:50.591 Metadata size: 8 bytes 00:05:50.591 Vector count 1 00:05:50.591 Module: software 00:05:50.591 Queue depth: 32 00:05:50.591 Allocate depth: 32 00:05:50.591 # threads/core: 1 00:05:50.591 Run time: 1 seconds 00:05:50.591 Verify: No 00:05:50.591 00:05:50.591 Running for 1 seconds... 00:05:50.591 00:05:50.591 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.591 ------------------------------------------------------------------------------------ 00:05:50.591 0,0 81984/s 325 MiB/s 0 0 00:05:50.591 ==================================================================================== 00:05:50.591 Total 81984/s 320 MiB/s 0 0' 00:05:50.591 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.591 12:19:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:05:50.591 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.591 12:19:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:05:50.591 12:19:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.591 12:19:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.591 12:19:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.591 12:19:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.591 12:19:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.591 12:19:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.591 12:19:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.591 12:19:44 -- accel/accel.sh@42 -- # jq -r . 00:05:50.591 [2024-07-12 12:19:44.287291] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:50.591 [2024-07-12 12:19:44.287384] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1160639 ] 00:05:50.591 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.591 [2024-07-12 12:19:44.346992] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.591 [2024-07-12 12:19:44.462089] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=0x1 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=dif_verify 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=software 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=32 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=32 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=1 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val=No 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:50.850 12:19:44 -- accel/accel.sh@21 -- # val= 00:05:50.850 12:19:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # IFS=: 00:05:50.850 12:19:44 -- accel/accel.sh@20 -- # read -r var val 00:05:52.228 12:19:45 -- accel/accel.sh@21 -- # val= 00:05:52.228 12:19:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.228 12:19:45 -- accel/accel.sh@20 -- # IFS=: 00:05:52.228 12:19:45 -- accel/accel.sh@20 -- # read -r var val 00:05:52.228 12:19:45 -- accel/accel.sh@21 -- # val= 00:05:52.228 12:19:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.228 12:19:45 -- accel/accel.sh@20 -- # IFS=: 00:05:52.228 12:19:45 -- accel/accel.sh@20 -- # read -r var val 00:05:52.228 12:19:45 -- accel/accel.sh@21 -- # val= 00:05:52.228 12:19:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.228 12:19:45 -- accel/accel.sh@20 -- # IFS=: 00:05:52.228 12:19:45 -- accel/accel.sh@20 -- # read -r var val 00:05:52.229 12:19:45 -- accel/accel.sh@21 -- # val= 00:05:52.229 12:19:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.229 12:19:45 -- accel/accel.sh@20 -- # IFS=: 00:05:52.229 12:19:45 -- accel/accel.sh@20 -- # read -r var val 00:05:52.229 12:19:45 -- accel/accel.sh@21 -- # val= 00:05:52.229 12:19:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.229 12:19:45 -- accel/accel.sh@20 -- # IFS=: 00:05:52.229 12:19:45 -- accel/accel.sh@20 -- # read -r var val 00:05:52.229 12:19:45 -- accel/accel.sh@21 -- # val= 00:05:52.229 12:19:45 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.229 12:19:45 -- accel/accel.sh@20 -- # IFS=: 00:05:52.229 12:19:45 -- accel/accel.sh@20 -- # read -r var val 00:05:52.229 12:19:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.229 12:19:45 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:05:52.229 12:19:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.229 00:05:52.229 real 0m2.960s 00:05:52.229 user 0m2.668s 00:05:52.229 sys 0m0.287s 00:05:52.229 12:19:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:52.229 12:19:45 -- common/autotest_common.sh@10 -- # set +x 00:05:52.229 ************************************ 00:05:52.229 END TEST accel_dif_verify 00:05:52.229 ************************************ 00:05:52.229 12:19:45 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:05:52.229 12:19:45 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:52.229 12:19:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:52.229 12:19:45 -- common/autotest_common.sh@10 -- # set +x 00:05:52.229 ************************************ 00:05:52.229 START TEST accel_dif_generate 00:05:52.229 ************************************ 00:05:52.229 12:19:45 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate 00:05:52.229 12:19:45 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.229 12:19:45 -- accel/accel.sh@17 -- # local accel_module 00:05:52.229 12:19:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:05:52.229 12:19:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:52.229 12:19:45 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.229 12:19:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.229 12:19:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.229 12:19:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.229 12:19:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.229 12:19:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.229 12:19:45 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.229 12:19:45 -- accel/accel.sh@42 -- # jq -r . 00:05:52.229 [2024-07-12 12:19:45.784046] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:52.229 [2024-07-12 12:19:45.784126] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1160796 ] 00:05:52.229 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.229 [2024-07-12 12:19:45.848574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.229 [2024-07-12 12:19:45.968974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.606 12:19:47 -- accel/accel.sh@18 -- # out=' 00:05:53.606 SPDK Configuration: 00:05:53.606 Core mask: 0x1 00:05:53.606 00:05:53.606 Accel Perf Configuration: 00:05:53.606 Workload Type: dif_generate 00:05:53.606 Vector size: 4096 bytes 00:05:53.606 Transfer size: 4096 bytes 00:05:53.606 Block size: 512 bytes 00:05:53.606 Metadata size: 8 bytes 00:05:53.606 Vector count 1 00:05:53.606 Module: software 00:05:53.606 Queue depth: 32 00:05:53.606 Allocate depth: 32 00:05:53.606 # threads/core: 1 00:05:53.606 Run time: 1 seconds 00:05:53.606 Verify: No 00:05:53.606 00:05:53.606 Running for 1 seconds... 00:05:53.606 00:05:53.606 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.606 ------------------------------------------------------------------------------------ 00:05:53.606 0,0 96256/s 381 MiB/s 0 0 00:05:53.606 ==================================================================================== 00:05:53.606 Total 96256/s 376 MiB/s 0 0' 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:05:53.606 12:19:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.606 12:19:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.606 12:19:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.606 12:19:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.606 12:19:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.606 12:19:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.606 12:19:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.606 12:19:47 -- accel/accel.sh@42 -- # jq -r . 00:05:53.606 [2024-07-12 12:19:47.267374] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:53.606 [2024-07-12 12:19:47.267459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161033 ] 00:05:53.606 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.606 [2024-07-12 12:19:47.333229] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.606 [2024-07-12 12:19:47.453464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val=0x1 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val=dif_generate 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val='512 bytes' 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val='8 bytes' 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.606 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.606 12:19:47 -- accel/accel.sh@21 -- # val=software 00:05:53.606 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.606 12:19:47 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val=32 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val=32 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val=1 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val=No 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:53.607 12:19:47 -- accel/accel.sh@21 -- # val= 00:05:53.607 12:19:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # IFS=: 00:05:53.607 12:19:47 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@21 -- # val= 00:05:54.982 12:19:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # IFS=: 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@21 -- # val= 00:05:54.982 12:19:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # IFS=: 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@21 -- # val= 00:05:54.982 12:19:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # IFS=: 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@21 -- # val= 00:05:54.982 12:19:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # IFS=: 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@21 -- # val= 00:05:54.982 12:19:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # IFS=: 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@21 -- # val= 00:05:54.982 12:19:48 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # IFS=: 00:05:54.982 12:19:48 -- accel/accel.sh@20 -- # read -r var val 00:05:54.982 12:19:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.982 12:19:48 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:05:54.982 12:19:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.982 00:05:54.982 real 0m2.972s 00:05:54.982 user 0m2.668s 00:05:54.982 sys 0m0.298s 00:05:54.982 12:19:48 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:54.982 12:19:48 -- common/autotest_common.sh@10 -- # set +x 00:05:54.982 ************************************ 00:05:54.982 END TEST accel_dif_generate 00:05:54.982 ************************************ 00:05:54.982 12:19:48 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:05:54.982 12:19:48 -- common/autotest_common.sh@1077 -- # '[' 6 -le 1 ']' 00:05:54.982 12:19:48 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:54.982 12:19:48 -- common/autotest_common.sh@10 -- # set +x 00:05:54.982 ************************************ 00:05:54.982 START TEST accel_dif_generate_copy 00:05:54.982 ************************************ 00:05:54.982 12:19:48 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w dif_generate_copy 00:05:54.982 12:19:48 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.982 12:19:48 -- accel/accel.sh@17 -- # local accel_module 00:05:54.982 12:19:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:05:54.982 12:19:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:54.982 12:19:48 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.982 12:19:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.982 12:19:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.982 12:19:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.982 12:19:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.982 12:19:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.982 12:19:48 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.982 12:19:48 -- accel/accel.sh@42 -- # jq -r . 00:05:54.982 [2024-07-12 12:19:48.786703] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:54.982 [2024-07-12 12:19:48.786794] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161214 ] 00:05:54.982 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.982 [2024-07-12 12:19:48.851558] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.241 [2024-07-12 12:19:48.970974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.620 12:19:50 -- accel/accel.sh@18 -- # out=' 00:05:56.620 SPDK Configuration: 00:05:56.620 Core mask: 0x1 00:05:56.620 00:05:56.620 Accel Perf Configuration: 00:05:56.620 Workload Type: dif_generate_copy 00:05:56.620 Vector size: 4096 bytes 00:05:56.620 Transfer size: 4096 bytes 00:05:56.620 Vector count 1 00:05:56.620 Module: software 00:05:56.620 Queue depth: 32 00:05:56.620 Allocate depth: 32 00:05:56.620 # threads/core: 1 00:05:56.620 Run time: 1 seconds 00:05:56.620 Verify: No 00:05:56.620 00:05:56.620 Running for 1 seconds... 00:05:56.620 00:05:56.620 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.620 ------------------------------------------------------------------------------------ 00:05:56.620 0,0 75136/s 298 MiB/s 0 0 00:05:56.620 ==================================================================================== 00:05:56.620 Total 75136/s 293 MiB/s 0 0' 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:05:56.620 12:19:50 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.620 12:19:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.620 12:19:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.620 12:19:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.620 12:19:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.620 12:19:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.620 12:19:50 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.620 12:19:50 -- accel/accel.sh@42 -- # jq -r . 00:05:56.620 [2024-07-12 12:19:50.255357] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:56.620 [2024-07-12 12:19:50.255441] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161370 ] 00:05:56.620 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.620 [2024-07-12 12:19:50.317876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.620 [2024-07-12 12:19:50.437534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=0x1 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=software 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=32 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=32 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=1 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val=No 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:56.620 12:19:50 -- accel/accel.sh@21 -- # val= 00:05:56.620 12:19:50 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # IFS=: 00:05:56.620 12:19:50 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@21 -- # val= 00:05:58.001 12:19:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # IFS=: 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@21 -- # val= 00:05:58.001 12:19:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # IFS=: 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@21 -- # val= 00:05:58.001 12:19:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # IFS=: 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@21 -- # val= 00:05:58.001 12:19:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # IFS=: 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@21 -- # val= 00:05:58.001 12:19:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # IFS=: 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@21 -- # val= 00:05:58.001 12:19:51 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # IFS=: 00:05:58.001 12:19:51 -- accel/accel.sh@20 -- # read -r var val 00:05:58.001 12:19:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:58.001 12:19:51 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:05:58.001 12:19:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:58.001 00:05:58.001 real 0m2.955s 00:05:58.001 user 0m2.661s 00:05:58.001 sys 0m0.285s 00:05:58.001 12:19:51 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:05:58.001 12:19:51 -- common/autotest_common.sh@10 -- # set +x 00:05:58.001 ************************************ 00:05:58.001 END TEST accel_dif_generate_copy 00:05:58.001 ************************************ 00:05:58.001 12:19:51 -- accel/accel.sh@107 -- # [[ y == y ]] 00:05:58.001 12:19:51 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:58.001 12:19:51 -- common/autotest_common.sh@1077 -- # '[' 8 -le 1 ']' 00:05:58.001 12:19:51 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:05:58.001 12:19:51 -- common/autotest_common.sh@10 -- # set +x 00:05:58.001 ************************************ 00:05:58.001 START TEST accel_comp 00:05:58.001 ************************************ 00:05:58.001 12:19:51 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:58.001 12:19:51 -- accel/accel.sh@16 -- # local accel_opc 00:05:58.001 12:19:51 -- accel/accel.sh@17 -- # local accel_module 00:05:58.001 12:19:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:58.001 12:19:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:58.001 12:19:51 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.001 12:19:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.001 12:19:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.001 12:19:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.001 12:19:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.001 12:19:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.001 12:19:51 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.001 12:19:51 -- accel/accel.sh@42 -- # jq -r . 00:05:58.001 [2024-07-12 12:19:51.763445] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:58.001 [2024-07-12 12:19:51.763526] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161551 ] 00:05:58.001 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.001 [2024-07-12 12:19:51.826502] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.260 [2024-07-12 12:19:51.947053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.638 12:19:53 -- accel/accel.sh@18 -- # out='Preparing input file... 00:05:59.638 00:05:59.638 SPDK Configuration: 00:05:59.638 Core mask: 0x1 00:05:59.638 00:05:59.638 Accel Perf Configuration: 00:05:59.638 Workload Type: compress 00:05:59.638 Transfer size: 4096 bytes 00:05:59.638 Vector count 1 00:05:59.638 Module: software 00:05:59.638 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.638 Queue depth: 32 00:05:59.638 Allocate depth: 32 00:05:59.638 # threads/core: 1 00:05:59.638 Run time: 1 seconds 00:05:59.638 Verify: No 00:05:59.638 00:05:59.638 Running for 1 seconds... 00:05:59.638 00:05:59.638 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.638 ------------------------------------------------------------------------------------ 00:05:59.638 0,0 32128/s 133 MiB/s 0 0 00:05:59.638 ==================================================================================== 00:05:59.638 Total 32128/s 125 MiB/s 0 0' 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.638 12:19:53 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.638 12:19:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.638 12:19:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.638 12:19:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.638 12:19:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.638 12:19:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.638 12:19:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.638 12:19:53 -- accel/accel.sh@42 -- # jq -r . 00:05:59.638 [2024-07-12 12:19:53.252022] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:05:59.638 [2024-07-12 12:19:53.252105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161788 ] 00:05:59.638 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.638 [2024-07-12 12:19:53.314963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.638 [2024-07-12 12:19:53.436166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val=0x1 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val=compress 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@24 -- # accel_opc=compress 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.638 12:19:53 -- accel/accel.sh@21 -- # val=software 00:05:59.638 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.638 12:19:53 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.638 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val=32 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val=32 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val=1 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val=No 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:05:59.639 12:19:53 -- accel/accel.sh@21 -- # val= 00:05:59.639 12:19:53 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # IFS=: 00:05:59.639 12:19:53 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@21 -- # val= 00:06:01.015 12:19:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # IFS=: 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@21 -- # val= 00:06:01.015 12:19:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # IFS=: 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@21 -- # val= 00:06:01.015 12:19:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # IFS=: 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@21 -- # val= 00:06:01.015 12:19:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # IFS=: 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@21 -- # val= 00:06:01.015 12:19:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # IFS=: 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@21 -- # val= 00:06:01.015 12:19:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # IFS=: 00:06:01.015 12:19:54 -- accel/accel.sh@20 -- # read -r var val 00:06:01.015 12:19:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:01.015 12:19:54 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:01.015 12:19:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:01.015 00:06:01.015 real 0m2.972s 00:06:01.015 user 0m2.682s 00:06:01.015 sys 0m0.282s 00:06:01.015 12:19:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:01.015 12:19:54 -- common/autotest_common.sh@10 -- # set +x 00:06:01.015 ************************************ 00:06:01.015 END TEST accel_comp 00:06:01.015 ************************************ 00:06:01.015 12:19:54 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:01.015 12:19:54 -- common/autotest_common.sh@1077 -- # '[' 9 -le 1 ']' 00:06:01.015 12:19:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:01.015 12:19:54 -- common/autotest_common.sh@10 -- # set +x 00:06:01.015 ************************************ 00:06:01.015 START TEST accel_decomp 00:06:01.015 ************************************ 00:06:01.015 12:19:54 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:01.015 12:19:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:01.015 12:19:54 -- accel/accel.sh@17 -- # local accel_module 00:06:01.015 12:19:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:01.015 12:19:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:01.015 12:19:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.015 12:19:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.015 12:19:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.015 12:19:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.015 12:19:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.015 12:19:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.015 12:19:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.015 12:19:54 -- accel/accel.sh@42 -- # jq -r . 00:06:01.015 [2024-07-12 12:19:54.758259] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:01.015 [2024-07-12 12:19:54.758343] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161945 ] 00:06:01.015 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.015 [2024-07-12 12:19:54.823608] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.273 [2024-07-12 12:19:54.942118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.651 12:19:56 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:02.651 00:06:02.651 SPDK Configuration: 00:06:02.651 Core mask: 0x1 00:06:02.651 00:06:02.651 Accel Perf Configuration: 00:06:02.651 Workload Type: decompress 00:06:02.651 Transfer size: 4096 bytes 00:06:02.651 Vector count 1 00:06:02.651 Module: software 00:06:02.651 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.651 Queue depth: 32 00:06:02.651 Allocate depth: 32 00:06:02.651 # threads/core: 1 00:06:02.651 Run time: 1 seconds 00:06:02.651 Verify: Yes 00:06:02.651 00:06:02.651 Running for 1 seconds... 00:06:02.651 00:06:02.651 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.651 ------------------------------------------------------------------------------------ 00:06:02.651 0,0 55456/s 102 MiB/s 0 0 00:06:02.651 ==================================================================================== 00:06:02.651 Total 55456/s 216 MiB/s 0 0' 00:06:02.651 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.651 12:19:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:02.651 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.651 12:19:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:02.651 12:19:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.651 12:19:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.651 12:19:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.651 12:19:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.651 12:19:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.651 12:19:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.651 12:19:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.651 12:19:56 -- accel/accel.sh@42 -- # jq -r . 00:06:02.651 [2024-07-12 12:19:56.231129] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:02.652 [2024-07-12 12:19:56.231212] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162091 ] 00:06:02.652 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.652 [2024-07-12 12:19:56.295003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.652 [2024-07-12 12:19:56.414084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=0x1 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=decompress 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=software 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=32 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=32 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=1 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val=Yes 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:02.652 12:19:56 -- accel/accel.sh@21 -- # val= 00:06:02.652 12:19:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # IFS=: 00:06:02.652 12:19:56 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@21 -- # val= 00:06:04.031 12:19:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # IFS=: 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@21 -- # val= 00:06:04.031 12:19:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # IFS=: 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@21 -- # val= 00:06:04.031 12:19:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # IFS=: 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@21 -- # val= 00:06:04.031 12:19:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # IFS=: 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@21 -- # val= 00:06:04.031 12:19:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # IFS=: 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@21 -- # val= 00:06:04.031 12:19:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # IFS=: 00:06:04.031 12:19:57 -- accel/accel.sh@20 -- # read -r var val 00:06:04.031 12:19:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:04.031 12:19:57 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:04.031 12:19:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:04.031 00:06:04.031 real 0m2.958s 00:06:04.031 user 0m2.660s 00:06:04.031 sys 0m0.290s 00:06:04.031 12:19:57 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:04.031 12:19:57 -- common/autotest_common.sh@10 -- # set +x 00:06:04.031 ************************************ 00:06:04.031 END TEST accel_decomp 00:06:04.031 ************************************ 00:06:04.031 12:19:57 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:04.031 12:19:57 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:04.031 12:19:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:04.031 12:19:57 -- common/autotest_common.sh@10 -- # set +x 00:06:04.031 ************************************ 00:06:04.031 START TEST accel_decmop_full 00:06:04.031 ************************************ 00:06:04.031 12:19:57 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:04.031 12:19:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:04.031 12:19:57 -- accel/accel.sh@17 -- # local accel_module 00:06:04.031 12:19:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:04.031 12:19:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:04.031 12:19:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.031 12:19:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.031 12:19:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.031 12:19:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.031 12:19:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.031 12:19:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.031 12:19:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.031 12:19:57 -- accel/accel.sh@42 -- # jq -r . 00:06:04.031 [2024-07-12 12:19:57.741849] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:04.031 [2024-07-12 12:19:57.741941] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162369 ] 00:06:04.031 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.031 [2024-07-12 12:19:57.804129] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.031 [2024-07-12 12:19:57.924493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.409 12:19:59 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:05.409 00:06:05.409 SPDK Configuration: 00:06:05.409 Core mask: 0x1 00:06:05.409 00:06:05.409 Accel Perf Configuration: 00:06:05.409 Workload Type: decompress 00:06:05.409 Transfer size: 111250 bytes 00:06:05.409 Vector count 1 00:06:05.409 Module: software 00:06:05.409 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.409 Queue depth: 32 00:06:05.409 Allocate depth: 32 00:06:05.409 # threads/core: 1 00:06:05.409 Run time: 1 seconds 00:06:05.409 Verify: Yes 00:06:05.409 00:06:05.409 Running for 1 seconds... 00:06:05.409 00:06:05.409 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:05.409 ------------------------------------------------------------------------------------ 00:06:05.409 0,0 3808/s 157 MiB/s 0 0 00:06:05.409 ==================================================================================== 00:06:05.409 Total 3808/s 404 MiB/s 0 0' 00:06:05.409 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.409 12:19:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:05.409 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.409 12:19:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:05.409 12:19:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.409 12:19:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.409 12:19:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.409 12:19:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.409 12:19:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.409 12:19:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.409 12:19:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.409 12:19:59 -- accel/accel.sh@42 -- # jq -r . 00:06:05.409 [2024-07-12 12:19:59.244306] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:05.409 [2024-07-12 12:19:59.244389] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162509 ] 00:06:05.409 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.409 [2024-07-12 12:19:59.309055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.667 [2024-07-12 12:19:59.429930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=0x1 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=decompress 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=software 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=32 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=32 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=1 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val=Yes 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:05.667 12:19:59 -- accel/accel.sh@21 -- # val= 00:06:05.667 12:19:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # IFS=: 00:06:05.667 12:19:59 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@21 -- # val= 00:06:07.084 12:20:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # IFS=: 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@21 -- # val= 00:06:07.084 12:20:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # IFS=: 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@21 -- # val= 00:06:07.084 12:20:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # IFS=: 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@21 -- # val= 00:06:07.084 12:20:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # IFS=: 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@21 -- # val= 00:06:07.084 12:20:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # IFS=: 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@21 -- # val= 00:06:07.084 12:20:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # IFS=: 00:06:07.084 12:20:00 -- accel/accel.sh@20 -- # read -r var val 00:06:07.084 12:20:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:07.084 12:20:00 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:07.084 12:20:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:07.084 00:06:07.084 real 0m2.997s 00:06:07.084 user 0m2.693s 00:06:07.084 sys 0m0.296s 00:06:07.084 12:20:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:07.084 12:20:00 -- common/autotest_common.sh@10 -- # set +x 00:06:07.084 ************************************ 00:06:07.084 END TEST accel_decmop_full 00:06:07.084 ************************************ 00:06:07.084 12:20:00 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:07.084 12:20:00 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:07.084 12:20:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:07.084 12:20:00 -- common/autotest_common.sh@10 -- # set +x 00:06:07.084 ************************************ 00:06:07.084 START TEST accel_decomp_mcore 00:06:07.084 ************************************ 00:06:07.084 12:20:00 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:07.084 12:20:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:07.084 12:20:00 -- accel/accel.sh@17 -- # local accel_module 00:06:07.084 12:20:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:07.084 12:20:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:07.084 12:20:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.084 12:20:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.084 12:20:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.084 12:20:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.084 12:20:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.084 12:20:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.084 12:20:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.084 12:20:00 -- accel/accel.sh@42 -- # jq -r . 00:06:07.084 [2024-07-12 12:20:00.763186] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:07.084 [2024-07-12 12:20:00.763265] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162679 ] 00:06:07.084 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.084 [2024-07-12 12:20:00.824479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:07.084 [2024-07-12 12:20:00.944905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:07.084 [2024-07-12 12:20:00.944985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:07.084 [2024-07-12 12:20:00.945035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:07.084 [2024-07-12 12:20:00.945039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.464 12:20:02 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:08.464 00:06:08.464 SPDK Configuration: 00:06:08.464 Core mask: 0xf 00:06:08.464 00:06:08.464 Accel Perf Configuration: 00:06:08.464 Workload Type: decompress 00:06:08.464 Transfer size: 4096 bytes 00:06:08.464 Vector count 1 00:06:08.464 Module: software 00:06:08.464 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.464 Queue depth: 32 00:06:08.464 Allocate depth: 32 00:06:08.464 # threads/core: 1 00:06:08.464 Run time: 1 seconds 00:06:08.464 Verify: Yes 00:06:08.464 00:06:08.464 Running for 1 seconds... 00:06:08.464 00:06:08.464 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:08.464 ------------------------------------------------------------------------------------ 00:06:08.464 0,0 50336/s 92 MiB/s 0 0 00:06:08.464 3,0 50720/s 93 MiB/s 0 0 00:06:08.464 2,0 50752/s 93 MiB/s 0 0 00:06:08.464 1,0 50720/s 93 MiB/s 0 0 00:06:08.464 ==================================================================================== 00:06:08.464 Total 202528/s 791 MiB/s 0 0' 00:06:08.464 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.464 12:20:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:08.464 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.464 12:20:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:08.464 12:20:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.464 12:20:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.464 12:20:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.464 12:20:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.464 12:20:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.464 12:20:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.464 12:20:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.464 12:20:02 -- accel/accel.sh@42 -- # jq -r . 00:06:08.464 [2024-07-12 12:20:02.254480] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:08.464 [2024-07-12 12:20:02.254563] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162942 ] 00:06:08.464 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.464 [2024-07-12 12:20:02.316854] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:08.724 [2024-07-12 12:20:02.440524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:08.724 [2024-07-12 12:20:02.440578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:08.724 [2024-07-12 12:20:02.440630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:08.724 [2024-07-12 12:20:02.440634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=0xf 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=decompress 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=software 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=32 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=32 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=1 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val=Yes 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:08.724 12:20:02 -- accel/accel.sh@21 -- # val= 00:06:08.724 12:20:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # IFS=: 00:06:08.724 12:20:02 -- accel/accel.sh@20 -- # read -r var val 00:06:10.102 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.102 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.102 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.102 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.102 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.102 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.102 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.102 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.102 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.102 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.102 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.102 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.103 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.103 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.103 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.103 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.103 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.103 12:20:03 -- accel/accel.sh@21 -- # val= 00:06:10.103 12:20:03 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # IFS=: 00:06:10.103 12:20:03 -- accel/accel.sh@20 -- # read -r var val 00:06:10.103 12:20:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.103 12:20:03 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:10.103 12:20:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.103 00:06:10.103 real 0m2.993s 00:06:10.103 user 0m9.613s 00:06:10.103 sys 0m0.314s 00:06:10.103 12:20:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:10.103 12:20:03 -- common/autotest_common.sh@10 -- # set +x 00:06:10.103 ************************************ 00:06:10.103 END TEST accel_decomp_mcore 00:06:10.103 ************************************ 00:06:10.103 12:20:03 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:10.103 12:20:03 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:10.103 12:20:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:10.103 12:20:03 -- common/autotest_common.sh@10 -- # set +x 00:06:10.103 ************************************ 00:06:10.103 START TEST accel_decomp_full_mcore 00:06:10.103 ************************************ 00:06:10.103 12:20:03 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:10.103 12:20:03 -- accel/accel.sh@16 -- # local accel_opc 00:06:10.103 12:20:03 -- accel/accel.sh@17 -- # local accel_module 00:06:10.103 12:20:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:10.103 12:20:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:10.103 12:20:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.103 12:20:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.103 12:20:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.103 12:20:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.103 12:20:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.103 12:20:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.103 12:20:03 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.103 12:20:03 -- accel/accel.sh@42 -- # jq -r . 00:06:10.103 [2024-07-12 12:20:03.781375] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:10.103 [2024-07-12 12:20:03.781455] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163104 ] 00:06:10.103 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.103 [2024-07-12 12:20:03.848534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:10.103 [2024-07-12 12:20:03.972356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.103 [2024-07-12 12:20:03.972400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:10.103 [2024-07-12 12:20:03.972454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:10.103 [2024-07-12 12:20:03.972457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.481 12:20:05 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:11.481 00:06:11.481 SPDK Configuration: 00:06:11.481 Core mask: 0xf 00:06:11.481 00:06:11.481 Accel Perf Configuration: 00:06:11.481 Workload Type: decompress 00:06:11.481 Transfer size: 111250 bytes 00:06:11.481 Vector count 1 00:06:11.481 Module: software 00:06:11.481 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.481 Queue depth: 32 00:06:11.481 Allocate depth: 32 00:06:11.481 # threads/core: 1 00:06:11.481 Run time: 1 seconds 00:06:11.481 Verify: Yes 00:06:11.481 00:06:11.481 Running for 1 seconds... 00:06:11.481 00:06:11.481 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:11.481 ------------------------------------------------------------------------------------ 00:06:11.481 0,0 3776/s 155 MiB/s 0 0 00:06:11.481 3,0 3808/s 157 MiB/s 0 0 00:06:11.481 2,0 3776/s 155 MiB/s 0 0 00:06:11.481 1,0 3776/s 155 MiB/s 0 0 00:06:11.481 ==================================================================================== 00:06:11.481 Total 15136/s 1605 MiB/s 0 0' 00:06:11.481 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.481 12:20:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:11.481 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.481 12:20:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:11.481 12:20:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.481 12:20:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.481 12:20:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.481 12:20:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.481 12:20:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.481 12:20:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.481 12:20:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.481 12:20:05 -- accel/accel.sh@42 -- # jq -r . 00:06:11.481 [2024-07-12 12:20:05.293582] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:11.481 [2024-07-12 12:20:05.293671] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163252 ] 00:06:11.481 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.481 [2024-07-12 12:20:05.356104] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:11.740 [2024-07-12 12:20:05.479791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.740 [2024-07-12 12:20:05.479857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:11.740 [2024-07-12 12:20:05.479919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:11.740 [2024-07-12 12:20:05.479923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.740 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.740 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.740 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.740 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.740 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.740 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.740 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.740 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.740 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.740 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.740 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.740 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=0xf 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=decompress 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=software 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=32 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=32 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=1 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val=Yes 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:11.741 12:20:05 -- accel/accel.sh@21 -- # val= 00:06:11.741 12:20:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # IFS=: 00:06:11.741 12:20:05 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@21 -- # val= 00:06:13.117 12:20:06 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # IFS=: 00:06:13.117 12:20:06 -- accel/accel.sh@20 -- # read -r var val 00:06:13.117 12:20:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.117 12:20:06 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:13.117 12:20:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.117 00:06:13.117 real 0m3.003s 00:06:13.117 user 0m9.650s 00:06:13.117 sys 0m0.302s 00:06:13.117 12:20:06 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:13.117 12:20:06 -- common/autotest_common.sh@10 -- # set +x 00:06:13.117 ************************************ 00:06:13.117 END TEST accel_decomp_full_mcore 00:06:13.117 ************************************ 00:06:13.117 12:20:06 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:13.117 12:20:06 -- common/autotest_common.sh@1077 -- # '[' 11 -le 1 ']' 00:06:13.117 12:20:06 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:13.117 12:20:06 -- common/autotest_common.sh@10 -- # set +x 00:06:13.117 ************************************ 00:06:13.117 START TEST accel_decomp_mthread 00:06:13.117 ************************************ 00:06:13.117 12:20:06 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:13.117 12:20:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.117 12:20:06 -- accel/accel.sh@17 -- # local accel_module 00:06:13.117 12:20:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:13.117 12:20:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:13.117 12:20:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.117 12:20:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.117 12:20:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.117 12:20:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.117 12:20:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.117 12:20:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.117 12:20:06 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.117 12:20:06 -- accel/accel.sh@42 -- # jq -r . 00:06:13.117 [2024-07-12 12:20:06.816629] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:13.117 [2024-07-12 12:20:06.816710] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163538 ] 00:06:13.117 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.117 [2024-07-12 12:20:06.884719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.117 [2024-07-12 12:20:07.005544] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.495 12:20:08 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:14.495 00:06:14.495 SPDK Configuration: 00:06:14.495 Core mask: 0x1 00:06:14.495 00:06:14.495 Accel Perf Configuration: 00:06:14.495 Workload Type: decompress 00:06:14.495 Transfer size: 4096 bytes 00:06:14.495 Vector count 1 00:06:14.495 Module: software 00:06:14.495 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.495 Queue depth: 32 00:06:14.495 Allocate depth: 32 00:06:14.495 # threads/core: 2 00:06:14.495 Run time: 1 seconds 00:06:14.495 Verify: Yes 00:06:14.495 00:06:14.495 Running for 1 seconds... 00:06:14.495 00:06:14.495 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:14.495 ------------------------------------------------------------------------------------ 00:06:14.495 0,1 28128/s 51 MiB/s 0 0 00:06:14.495 0,0 28000/s 51 MiB/s 0 0 00:06:14.495 ==================================================================================== 00:06:14.495 Total 56128/s 219 MiB/s 0 0' 00:06:14.495 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.495 12:20:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:14.495 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.495 12:20:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:14.495 12:20:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.495 12:20:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.495 12:20:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.495 12:20:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.495 12:20:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.495 12:20:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.495 12:20:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.495 12:20:08 -- accel/accel.sh@42 -- # jq -r . 00:06:14.495 [2024-07-12 12:20:08.316510] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:14.495 [2024-07-12 12:20:08.316599] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163678 ] 00:06:14.495 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.495 [2024-07-12 12:20:08.380952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.755 [2024-07-12 12:20:08.501977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=0x1 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=decompress 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=software 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=32 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=32 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=2 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val=Yes 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:14.755 12:20:08 -- accel/accel.sh@21 -- # val= 00:06:14.755 12:20:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # IFS=: 00:06:14.755 12:20:08 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@21 -- # val= 00:06:16.132 12:20:09 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # IFS=: 00:06:16.132 12:20:09 -- accel/accel.sh@20 -- # read -r var val 00:06:16.132 12:20:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.132 12:20:09 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:16.132 12:20:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.132 00:06:16.132 real 0m2.990s 00:06:16.132 user 0m2.693s 00:06:16.132 sys 0m0.290s 00:06:16.132 12:20:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:16.132 12:20:09 -- common/autotest_common.sh@10 -- # set +x 00:06:16.132 ************************************ 00:06:16.132 END TEST accel_decomp_mthread 00:06:16.132 ************************************ 00:06:16.132 12:20:09 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:16.132 12:20:09 -- common/autotest_common.sh@1077 -- # '[' 13 -le 1 ']' 00:06:16.132 12:20:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:16.132 12:20:09 -- common/autotest_common.sh@10 -- # set +x 00:06:16.132 ************************************ 00:06:16.132 START TEST accel_deomp_full_mthread 00:06:16.132 ************************************ 00:06:16.132 12:20:09 -- common/autotest_common.sh@1104 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:16.132 12:20:09 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.132 12:20:09 -- accel/accel.sh@17 -- # local accel_module 00:06:16.132 12:20:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:16.132 12:20:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:16.132 12:20:09 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.132 12:20:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.132 12:20:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.132 12:20:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.132 12:20:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.132 12:20:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.132 12:20:09 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.132 12:20:09 -- accel/accel.sh@42 -- # jq -r . 00:06:16.132 [2024-07-12 12:20:09.833543] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:16.132 [2024-07-12 12:20:09.833625] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163841 ] 00:06:16.132 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.132 [2024-07-12 12:20:09.900221] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.132 [2024-07-12 12:20:10.025274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.510 12:20:11 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:17.510 00:06:17.510 SPDK Configuration: 00:06:17.510 Core mask: 0x1 00:06:17.510 00:06:17.510 Accel Perf Configuration: 00:06:17.510 Workload Type: decompress 00:06:17.510 Transfer size: 111250 bytes 00:06:17.510 Vector count 1 00:06:17.510 Module: software 00:06:17.510 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.510 Queue depth: 32 00:06:17.510 Allocate depth: 32 00:06:17.510 # threads/core: 2 00:06:17.510 Run time: 1 seconds 00:06:17.510 Verify: Yes 00:06:17.510 00:06:17.510 Running for 1 seconds... 00:06:17.510 00:06:17.510 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.510 ------------------------------------------------------------------------------------ 00:06:17.510 0,1 1952/s 80 MiB/s 0 0 00:06:17.510 0,0 1920/s 79 MiB/s 0 0 00:06:17.510 ==================================================================================== 00:06:17.510 Total 3872/s 410 MiB/s 0 0' 00:06:17.510 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.510 12:20:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:17.510 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.510 12:20:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:17.510 12:20:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.510 12:20:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.510 12:20:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.510 12:20:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.510 12:20:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.510 12:20:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.510 12:20:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.510 12:20:11 -- accel/accel.sh@42 -- # jq -r . 00:06:17.510 [2024-07-12 12:20:11.360067] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:17.510 [2024-07-12 12:20:11.360149] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164105 ] 00:06:17.510 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.510 [2024-07-12 12:20:11.422424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.769 [2024-07-12 12:20:11.541698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=0x1 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=decompress 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=software 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=32 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=32 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=2 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val=Yes 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:17.769 12:20:11 -- accel/accel.sh@21 -- # val= 00:06:17.769 12:20:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # IFS=: 00:06:17.769 12:20:11 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@21 -- # val= 00:06:19.147 12:20:12 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # IFS=: 00:06:19.147 12:20:12 -- accel/accel.sh@20 -- # read -r var val 00:06:19.147 12:20:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.147 12:20:12 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:19.147 12:20:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.147 00:06:19.147 real 0m3.051s 00:06:19.147 user 0m2.752s 00:06:19.147 sys 0m0.292s 00:06:19.147 12:20:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.147 12:20:12 -- common/autotest_common.sh@10 -- # set +x 00:06:19.147 ************************************ 00:06:19.147 END TEST accel_deomp_full_mthread 00:06:19.147 ************************************ 00:06:19.147 12:20:12 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:19.147 12:20:12 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:19.147 12:20:12 -- accel/accel.sh@129 -- # build_accel_config 00:06:19.147 12:20:12 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:19.147 12:20:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.147 12:20:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.147 12:20:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.147 12:20:12 -- common/autotest_common.sh@10 -- # set +x 00:06:19.147 12:20:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.147 12:20:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.147 12:20:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.147 12:20:12 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.147 12:20:12 -- accel/accel.sh@42 -- # jq -r . 00:06:19.147 ************************************ 00:06:19.147 START TEST accel_dif_functional_tests 00:06:19.147 ************************************ 00:06:19.147 12:20:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:19.147 [2024-07-12 12:20:12.930712] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:19.147 [2024-07-12 12:20:12.930791] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164266 ] 00:06:19.147 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.147 [2024-07-12 12:20:12.993950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:19.405 [2024-07-12 12:20:13.117208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:19.405 [2024-07-12 12:20:13.117258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:19.405 [2024-07-12 12:20:13.117261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.405 00:06:19.405 00:06:19.405 CUnit - A unit testing framework for C - Version 2.1-3 00:06:19.405 http://cunit.sourceforge.net/ 00:06:19.405 00:06:19.405 00:06:19.405 Suite: accel_dif 00:06:19.405 Test: verify: DIF generated, GUARD check ...passed 00:06:19.405 Test: verify: DIF generated, APPTAG check ...passed 00:06:19.405 Test: verify: DIF generated, REFTAG check ...passed 00:06:19.405 Test: verify: DIF not generated, GUARD check ...[2024-07-12 12:20:13.216651] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:19.405 [2024-07-12 12:20:13.216725] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:19.405 passed 00:06:19.405 Test: verify: DIF not generated, APPTAG check ...[2024-07-12 12:20:13.216770] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:19.405 [2024-07-12 12:20:13.216800] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:19.405 passed 00:06:19.405 Test: verify: DIF not generated, REFTAG check ...[2024-07-12 12:20:13.216835] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:19.405 [2024-07-12 12:20:13.216863] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:19.405 passed 00:06:19.405 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:19.405 Test: verify: APPTAG incorrect, APPTAG check ...[2024-07-12 12:20:13.216967] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:19.405 passed 00:06:19.405 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:19.405 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:19.405 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:19.405 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-07-12 12:20:13.217134] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:19.405 passed 00:06:19.405 Test: generate copy: DIF generated, GUARD check ...passed 00:06:19.405 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:19.405 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:19.405 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:19.405 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:19.405 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:19.405 Test: generate copy: iovecs-len validate ...[2024-07-12 12:20:13.217396] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:19.405 passed 00:06:19.405 Test: generate copy: buffer alignment validate ...passed 00:06:19.405 00:06:19.405 Run Summary: Type Total Ran Passed Failed Inactive 00:06:19.405 suites 1 1 n/a 0 0 00:06:19.405 tests 20 20 20 0 0 00:06:19.405 asserts 204 204 204 0 n/a 00:06:19.405 00:06:19.405 Elapsed time = 0.003 seconds 00:06:19.662 00:06:19.662 real 0m0.583s 00:06:19.662 user 0m0.874s 00:06:19.662 sys 0m0.181s 00:06:19.663 12:20:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.663 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:19.663 ************************************ 00:06:19.663 END TEST accel_dif_functional_tests 00:06:19.663 ************************************ 00:06:19.663 00:06:19.663 real 1m3.114s 00:06:19.663 user 1m10.899s 00:06:19.663 sys 0m7.224s 00:06:19.663 12:20:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:19.663 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:19.663 ************************************ 00:06:19.663 END TEST accel 00:06:19.663 ************************************ 00:06:19.663 12:20:13 -- spdk/autotest.sh@190 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:19.663 12:20:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:19.663 12:20:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.663 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:19.663 ************************************ 00:06:19.663 START TEST accel_rpc 00:06:19.663 ************************************ 00:06:19.663 12:20:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:19.663 * Looking for test storage... 00:06:19.663 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:19.663 12:20:13 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:19.663 12:20:13 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=1164456 00:06:19.663 12:20:13 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:19.663 12:20:13 -- accel/accel_rpc.sh@15 -- # waitforlisten 1164456 00:06:19.663 12:20:13 -- common/autotest_common.sh@819 -- # '[' -z 1164456 ']' 00:06:19.921 12:20:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:19.921 12:20:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:19.921 12:20:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:19.921 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:19.921 12:20:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:19.921 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:19.921 [2024-07-12 12:20:13.629208] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:19.921 [2024-07-12 12:20:13.629304] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164456 ] 00:06:19.921 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.921 [2024-07-12 12:20:13.687916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.921 [2024-07-12 12:20:13.792996] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:19.921 [2024-07-12 12:20:13.793197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.921 12:20:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:19.921 12:20:13 -- common/autotest_common.sh@852 -- # return 0 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:19.921 12:20:13 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:19.921 12:20:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:19.921 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:19.921 ************************************ 00:06:19.921 START TEST accel_assign_opcode 00:06:19.921 ************************************ 00:06:19.921 12:20:13 -- common/autotest_common.sh@1104 -- # accel_assign_opcode_test_suite 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:19.921 12:20:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.921 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:19.921 [2024-07-12 12:20:13.833687] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:19.921 12:20:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:19.921 12:20:13 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:19.921 12:20:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:19.921 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:20.179 [2024-07-12 12:20:13.841703] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:20.179 12:20:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:20.179 12:20:13 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:20.179 12:20:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:20.179 12:20:13 -- common/autotest_common.sh@10 -- # set +x 00:06:20.179 12:20:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:20.179 12:20:14 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:20.179 12:20:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:20.179 12:20:14 -- common/autotest_common.sh@10 -- # set +x 00:06:20.179 12:20:14 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:20.179 12:20:14 -- accel/accel_rpc.sh@42 -- # grep software 00:06:20.436 12:20:14 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:20.436 software 00:06:20.436 00:06:20.436 real 0m0.307s 00:06:20.436 user 0m0.043s 00:06:20.436 sys 0m0.006s 00:06:20.436 12:20:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:20.436 12:20:14 -- common/autotest_common.sh@10 -- # set +x 00:06:20.436 ************************************ 00:06:20.436 END TEST accel_assign_opcode 00:06:20.436 ************************************ 00:06:20.436 12:20:14 -- accel/accel_rpc.sh@55 -- # killprocess 1164456 00:06:20.436 12:20:14 -- common/autotest_common.sh@926 -- # '[' -z 1164456 ']' 00:06:20.436 12:20:14 -- common/autotest_common.sh@930 -- # kill -0 1164456 00:06:20.436 12:20:14 -- common/autotest_common.sh@931 -- # uname 00:06:20.436 12:20:14 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:20.436 12:20:14 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1164456 00:06:20.436 12:20:14 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:20.436 12:20:14 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:20.436 12:20:14 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1164456' 00:06:20.436 killing process with pid 1164456 00:06:20.436 12:20:14 -- common/autotest_common.sh@945 -- # kill 1164456 00:06:20.436 12:20:14 -- common/autotest_common.sh@950 -- # wait 1164456 00:06:20.757 00:06:20.757 real 0m1.121s 00:06:20.757 user 0m1.049s 00:06:20.757 sys 0m0.409s 00:06:20.757 12:20:14 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:20.757 12:20:14 -- common/autotest_common.sh@10 -- # set +x 00:06:20.757 ************************************ 00:06:20.757 END TEST accel_rpc 00:06:20.757 ************************************ 00:06:21.015 12:20:14 -- spdk/autotest.sh@191 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:21.015 12:20:14 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:21.015 12:20:14 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:21.015 12:20:14 -- common/autotest_common.sh@10 -- # set +x 00:06:21.015 ************************************ 00:06:21.015 START TEST app_cmdline 00:06:21.015 ************************************ 00:06:21.015 12:20:14 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:21.015 * Looking for test storage... 00:06:21.015 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:21.015 12:20:14 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:21.015 12:20:14 -- app/cmdline.sh@17 -- # spdk_tgt_pid=1164659 00:06:21.015 12:20:14 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:21.015 12:20:14 -- app/cmdline.sh@18 -- # waitforlisten 1164659 00:06:21.015 12:20:14 -- common/autotest_common.sh@819 -- # '[' -z 1164659 ']' 00:06:21.015 12:20:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.015 12:20:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:21.015 12:20:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.015 12:20:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:21.015 12:20:14 -- common/autotest_common.sh@10 -- # set +x 00:06:21.015 [2024-07-12 12:20:14.781012] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:21.015 [2024-07-12 12:20:14.781099] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164659 ] 00:06:21.015 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.015 [2024-07-12 12:20:14.839809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.273 [2024-07-12 12:20:14.944227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:21.273 [2024-07-12 12:20:14.944395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:21.839 12:20:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:21.839 12:20:15 -- common/autotest_common.sh@852 -- # return 0 00:06:21.839 12:20:15 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:22.096 { 00:06:22.096 "version": "SPDK v24.01.1-pre git sha1 4b94202c6", 00:06:22.096 "fields": { 00:06:22.096 "major": 24, 00:06:22.096 "minor": 1, 00:06:22.096 "patch": 1, 00:06:22.096 "suffix": "-pre", 00:06:22.096 "commit": "4b94202c6" 00:06:22.096 } 00:06:22.096 } 00:06:22.096 12:20:15 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:22.096 12:20:15 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:22.096 12:20:15 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:22.096 12:20:15 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:22.096 12:20:15 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:22.096 12:20:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:22.096 12:20:15 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:22.096 12:20:15 -- common/autotest_common.sh@10 -- # set +x 00:06:22.096 12:20:15 -- app/cmdline.sh@26 -- # sort 00:06:22.096 12:20:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:22.355 12:20:16 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:22.355 12:20:16 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:22.355 12:20:16 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:22.355 12:20:16 -- common/autotest_common.sh@640 -- # local es=0 00:06:22.355 12:20:16 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:22.355 12:20:16 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:22.355 12:20:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:22.355 12:20:16 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:22.355 12:20:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:22.355 12:20:16 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:22.355 12:20:16 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:06:22.355 12:20:16 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:22.355 12:20:16 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:22.355 12:20:16 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:22.614 request: 00:06:22.614 { 00:06:22.614 "method": "env_dpdk_get_mem_stats", 00:06:22.614 "req_id": 1 00:06:22.614 } 00:06:22.614 Got JSON-RPC error response 00:06:22.614 response: 00:06:22.614 { 00:06:22.614 "code": -32601, 00:06:22.614 "message": "Method not found" 00:06:22.614 } 00:06:22.614 12:20:16 -- common/autotest_common.sh@643 -- # es=1 00:06:22.614 12:20:16 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:06:22.614 12:20:16 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:06:22.614 12:20:16 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:06:22.614 12:20:16 -- app/cmdline.sh@1 -- # killprocess 1164659 00:06:22.614 12:20:16 -- common/autotest_common.sh@926 -- # '[' -z 1164659 ']' 00:06:22.614 12:20:16 -- common/autotest_common.sh@930 -- # kill -0 1164659 00:06:22.614 12:20:16 -- common/autotest_common.sh@931 -- # uname 00:06:22.614 12:20:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:22.614 12:20:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1164659 00:06:22.614 12:20:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:22.614 12:20:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:22.614 12:20:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1164659' 00:06:22.614 killing process with pid 1164659 00:06:22.614 12:20:16 -- common/autotest_common.sh@945 -- # kill 1164659 00:06:22.614 12:20:16 -- common/autotest_common.sh@950 -- # wait 1164659 00:06:23.184 00:06:23.184 real 0m2.126s 00:06:23.184 user 0m2.703s 00:06:23.184 sys 0m0.489s 00:06:23.184 12:20:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:23.184 12:20:16 -- common/autotest_common.sh@10 -- # set +x 00:06:23.184 ************************************ 00:06:23.184 END TEST app_cmdline 00:06:23.184 ************************************ 00:06:23.184 12:20:16 -- spdk/autotest.sh@192 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:23.184 12:20:16 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:06:23.184 12:20:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.184 12:20:16 -- common/autotest_common.sh@10 -- # set +x 00:06:23.184 ************************************ 00:06:23.184 START TEST version 00:06:23.184 ************************************ 00:06:23.184 12:20:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:23.184 * Looking for test storage... 00:06:23.184 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:23.184 12:20:16 -- app/version.sh@17 -- # get_header_version major 00:06:23.184 12:20:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:23.184 12:20:16 -- app/version.sh@14 -- # cut -f2 00:06:23.184 12:20:16 -- app/version.sh@14 -- # tr -d '"' 00:06:23.184 12:20:16 -- app/version.sh@17 -- # major=24 00:06:23.184 12:20:16 -- app/version.sh@18 -- # get_header_version minor 00:06:23.184 12:20:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:23.184 12:20:16 -- app/version.sh@14 -- # cut -f2 00:06:23.184 12:20:16 -- app/version.sh@14 -- # tr -d '"' 00:06:23.184 12:20:16 -- app/version.sh@18 -- # minor=1 00:06:23.184 12:20:16 -- app/version.sh@19 -- # get_header_version patch 00:06:23.184 12:20:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:23.184 12:20:16 -- app/version.sh@14 -- # cut -f2 00:06:23.184 12:20:16 -- app/version.sh@14 -- # tr -d '"' 00:06:23.184 12:20:16 -- app/version.sh@19 -- # patch=1 00:06:23.184 12:20:16 -- app/version.sh@20 -- # get_header_version suffix 00:06:23.184 12:20:16 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:23.184 12:20:16 -- app/version.sh@14 -- # cut -f2 00:06:23.184 12:20:16 -- app/version.sh@14 -- # tr -d '"' 00:06:23.184 12:20:16 -- app/version.sh@20 -- # suffix=-pre 00:06:23.184 12:20:16 -- app/version.sh@22 -- # version=24.1 00:06:23.184 12:20:16 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:23.184 12:20:16 -- app/version.sh@25 -- # version=24.1.1 00:06:23.184 12:20:16 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:23.184 12:20:16 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:23.184 12:20:16 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:23.184 12:20:16 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:23.184 12:20:16 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:23.184 00:06:23.184 real 0m0.109s 00:06:23.184 user 0m0.057s 00:06:23.184 sys 0m0.073s 00:06:23.184 12:20:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:23.184 12:20:16 -- common/autotest_common.sh@10 -- # set +x 00:06:23.184 ************************************ 00:06:23.184 END TEST version 00:06:23.184 ************************************ 00:06:23.184 12:20:16 -- spdk/autotest.sh@194 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@204 -- # uname -s 00:06:23.184 12:20:16 -- spdk/autotest.sh@204 -- # [[ Linux == Linux ]] 00:06:23.184 12:20:16 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:23.184 12:20:16 -- spdk/autotest.sh@205 -- # [[ 0 -eq 1 ]] 00:06:23.184 12:20:16 -- spdk/autotest.sh@217 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@264 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@268 -- # timing_exit lib 00:06:23.184 12:20:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:23.184 12:20:16 -- common/autotest_common.sh@10 -- # set +x 00:06:23.184 12:20:16 -- spdk/autotest.sh@270 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@278 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@287 -- # '[' 1 -eq 1 ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@288 -- # export NET_TYPE 00:06:23.184 12:20:16 -- spdk/autotest.sh@291 -- # '[' tcp = rdma ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@294 -- # '[' tcp = tcp ']' 00:06:23.184 12:20:16 -- spdk/autotest.sh@295 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:23.184 12:20:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:23.184 12:20:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.184 12:20:16 -- common/autotest_common.sh@10 -- # set +x 00:06:23.184 ************************************ 00:06:23.184 START TEST nvmf_tcp 00:06:23.184 ************************************ 00:06:23.184 12:20:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:23.184 * Looking for test storage... 00:06:23.184 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:23.184 12:20:17 -- nvmf/common.sh@7 -- # uname -s 00:06:23.184 12:20:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:23.184 12:20:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:23.184 12:20:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:23.184 12:20:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:23.184 12:20:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:23.184 12:20:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:23.184 12:20:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:23.184 12:20:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:23.184 12:20:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:23.184 12:20:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:23.184 12:20:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:23.184 12:20:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:23.184 12:20:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:23.184 12:20:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:23.184 12:20:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:23.184 12:20:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:23.184 12:20:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:23.184 12:20:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:23.184 12:20:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:23.184 12:20:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.184 12:20:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.184 12:20:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.184 12:20:17 -- paths/export.sh@5 -- # export PATH 00:06:23.184 12:20:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.184 12:20:17 -- nvmf/common.sh@46 -- # : 0 00:06:23.184 12:20:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:23.184 12:20:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:23.184 12:20:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:23.184 12:20:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:23.184 12:20:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:23.184 12:20:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:23.184 12:20:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:23.184 12:20:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:23.184 12:20:17 -- common/autotest_common.sh@10 -- # set +x 00:06:23.184 12:20:17 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:23.185 12:20:17 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:23.185 12:20:17 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:23.185 12:20:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:23.185 12:20:17 -- common/autotest_common.sh@10 -- # set +x 00:06:23.185 ************************************ 00:06:23.185 START TEST nvmf_example 00:06:23.185 ************************************ 00:06:23.185 12:20:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:23.185 * Looking for test storage... 00:06:23.445 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:23.445 12:20:17 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:23.445 12:20:17 -- nvmf/common.sh@7 -- # uname -s 00:06:23.445 12:20:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:23.445 12:20:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:23.445 12:20:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:23.445 12:20:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:23.445 12:20:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:23.445 12:20:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:23.445 12:20:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:23.445 12:20:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:23.445 12:20:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:23.445 12:20:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:23.445 12:20:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:23.445 12:20:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:23.445 12:20:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:23.445 12:20:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:23.445 12:20:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:23.445 12:20:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:23.445 12:20:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:23.445 12:20:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:23.445 12:20:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:23.445 12:20:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.445 12:20:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.445 12:20:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.445 12:20:17 -- paths/export.sh@5 -- # export PATH 00:06:23.446 12:20:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:23.446 12:20:17 -- nvmf/common.sh@46 -- # : 0 00:06:23.446 12:20:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:23.446 12:20:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:23.446 12:20:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:23.446 12:20:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:23.446 12:20:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:23.446 12:20:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:23.446 12:20:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:23.446 12:20:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:23.446 12:20:17 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:23.446 12:20:17 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:23.446 12:20:17 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:23.446 12:20:17 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:23.446 12:20:17 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:23.446 12:20:17 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:23.446 12:20:17 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:23.446 12:20:17 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:23.446 12:20:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:23.446 12:20:17 -- common/autotest_common.sh@10 -- # set +x 00:06:23.446 12:20:17 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:23.446 12:20:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:23.446 12:20:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:23.446 12:20:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:23.446 12:20:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:23.446 12:20:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:23.446 12:20:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:23.446 12:20:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:23.446 12:20:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:23.446 12:20:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:23.446 12:20:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:23.446 12:20:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:23.446 12:20:17 -- common/autotest_common.sh@10 -- # set +x 00:06:25.412 12:20:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:25.412 12:20:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:25.412 12:20:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:25.412 12:20:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:25.412 12:20:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:25.412 12:20:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:25.412 12:20:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:25.412 12:20:19 -- nvmf/common.sh@294 -- # net_devs=() 00:06:25.412 12:20:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:25.412 12:20:19 -- nvmf/common.sh@295 -- # e810=() 00:06:25.412 12:20:19 -- nvmf/common.sh@295 -- # local -ga e810 00:06:25.412 12:20:19 -- nvmf/common.sh@296 -- # x722=() 00:06:25.412 12:20:19 -- nvmf/common.sh@296 -- # local -ga x722 00:06:25.412 12:20:19 -- nvmf/common.sh@297 -- # mlx=() 00:06:25.412 12:20:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:25.412 12:20:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:25.412 12:20:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:25.412 12:20:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:25.412 12:20:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:25.412 12:20:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:25.412 12:20:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:25.412 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:25.412 12:20:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:25.412 12:20:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:25.412 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:25.412 12:20:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:25.412 12:20:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:25.412 12:20:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:25.412 12:20:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:25.412 12:20:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:25.412 12:20:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:25.412 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:25.412 12:20:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:25.412 12:20:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:25.412 12:20:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:25.412 12:20:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:25.412 12:20:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:25.412 12:20:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:25.412 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:25.412 12:20:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:25.412 12:20:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:25.412 12:20:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:25.412 12:20:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:25.412 12:20:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:25.412 12:20:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:25.412 12:20:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:25.412 12:20:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:25.412 12:20:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:25.412 12:20:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:25.412 12:20:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:25.412 12:20:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:25.412 12:20:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:25.412 12:20:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:25.412 12:20:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:25.413 12:20:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:25.413 12:20:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:25.413 12:20:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:25.413 12:20:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:25.413 12:20:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:25.413 12:20:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:25.413 12:20:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:25.413 12:20:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:25.413 12:20:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:25.413 12:20:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:25.413 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:25.413 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:06:25.413 00:06:25.413 --- 10.0.0.2 ping statistics --- 00:06:25.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:25.413 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:06:25.413 12:20:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:25.413 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:25.413 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:06:25.413 00:06:25.413 --- 10.0.0.1 ping statistics --- 00:06:25.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:25.413 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:06:25.413 12:20:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:25.413 12:20:19 -- nvmf/common.sh@410 -- # return 0 00:06:25.413 12:20:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:25.413 12:20:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:25.413 12:20:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:25.413 12:20:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:25.413 12:20:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:25.413 12:20:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:25.413 12:20:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:25.413 12:20:19 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:25.413 12:20:19 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:25.413 12:20:19 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:25.413 12:20:19 -- common/autotest_common.sh@10 -- # set +x 00:06:25.413 12:20:19 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:25.413 12:20:19 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:25.413 12:20:19 -- target/nvmf_example.sh@34 -- # nvmfpid=1166694 00:06:25.413 12:20:19 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:25.413 12:20:19 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:25.413 12:20:19 -- target/nvmf_example.sh@36 -- # waitforlisten 1166694 00:06:25.413 12:20:19 -- common/autotest_common.sh@819 -- # '[' -z 1166694 ']' 00:06:25.413 12:20:19 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.413 12:20:19 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:25.413 12:20:19 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.413 12:20:19 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:25.413 12:20:19 -- common/autotest_common.sh@10 -- # set +x 00:06:25.671 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.607 12:20:20 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:26.607 12:20:20 -- common/autotest_common.sh@852 -- # return 0 00:06:26.607 12:20:20 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:26.607 12:20:20 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:26.607 12:20:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.607 12:20:20 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:26.607 12:20:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.607 12:20:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.607 12:20:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.607 12:20:20 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:26.607 12:20:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.607 12:20:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.607 12:20:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.607 12:20:20 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:26.607 12:20:20 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:26.607 12:20:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.607 12:20:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.607 12:20:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.607 12:20:20 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:26.607 12:20:20 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:26.607 12:20:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.607 12:20:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.607 12:20:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.607 12:20:20 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:26.607 12:20:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:26.607 12:20:20 -- common/autotest_common.sh@10 -- # set +x 00:06:26.607 12:20:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:26.607 12:20:20 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:26.607 12:20:20 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:26.607 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.815 Initializing NVMe Controllers 00:06:38.815 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:38.815 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:38.815 Initialization complete. Launching workers. 00:06:38.815 ======================================================== 00:06:38.815 Latency(us) 00:06:38.815 Device Information : IOPS MiB/s Average min max 00:06:38.815 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14847.87 58.00 4310.22 873.85 16651.55 00:06:38.815 ======================================================== 00:06:38.815 Total : 14847.87 58.00 4310.22 873.85 16651.55 00:06:38.815 00:06:38.815 12:20:30 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:38.815 12:20:30 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:38.815 12:20:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:38.815 12:20:30 -- nvmf/common.sh@116 -- # sync 00:06:38.815 12:20:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:38.815 12:20:30 -- nvmf/common.sh@119 -- # set +e 00:06:38.815 12:20:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:38.815 12:20:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:38.815 rmmod nvme_tcp 00:06:38.815 rmmod nvme_fabrics 00:06:38.815 rmmod nvme_keyring 00:06:38.815 12:20:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:38.815 12:20:30 -- nvmf/common.sh@123 -- # set -e 00:06:38.815 12:20:30 -- nvmf/common.sh@124 -- # return 0 00:06:38.815 12:20:30 -- nvmf/common.sh@477 -- # '[' -n 1166694 ']' 00:06:38.815 12:20:30 -- nvmf/common.sh@478 -- # killprocess 1166694 00:06:38.815 12:20:30 -- common/autotest_common.sh@926 -- # '[' -z 1166694 ']' 00:06:38.815 12:20:30 -- common/autotest_common.sh@930 -- # kill -0 1166694 00:06:38.815 12:20:30 -- common/autotest_common.sh@931 -- # uname 00:06:38.815 12:20:30 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:38.815 12:20:30 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1166694 00:06:38.815 12:20:30 -- common/autotest_common.sh@932 -- # process_name=nvmf 00:06:38.815 12:20:30 -- common/autotest_common.sh@936 -- # '[' nvmf = sudo ']' 00:06:38.815 12:20:30 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1166694' 00:06:38.815 killing process with pid 1166694 00:06:38.815 12:20:30 -- common/autotest_common.sh@945 -- # kill 1166694 00:06:38.815 12:20:30 -- common/autotest_common.sh@950 -- # wait 1166694 00:06:38.815 nvmf threads initialize successfully 00:06:38.815 bdev subsystem init successfully 00:06:38.815 created a nvmf target service 00:06:38.815 create targets's poll groups done 00:06:38.815 all subsystems of target started 00:06:38.816 nvmf target is running 00:06:38.816 all subsystems of target stopped 00:06:38.816 destroy targets's poll groups done 00:06:38.816 destroyed the nvmf target service 00:06:38.816 bdev subsystem finish successfully 00:06:38.816 nvmf threads destroy successfully 00:06:38.816 12:20:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:38.816 12:20:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:38.816 12:20:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:38.816 12:20:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:38.816 12:20:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:38.816 12:20:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:38.816 12:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:38.816 12:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:39.074 12:20:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:39.074 12:20:32 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:39.074 12:20:32 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:39.074 12:20:32 -- common/autotest_common.sh@10 -- # set +x 00:06:39.074 00:06:39.074 real 0m15.851s 00:06:39.074 user 0m44.957s 00:06:39.074 sys 0m3.231s 00:06:39.074 12:20:32 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:39.074 12:20:32 -- common/autotest_common.sh@10 -- # set +x 00:06:39.074 ************************************ 00:06:39.074 END TEST nvmf_example 00:06:39.074 ************************************ 00:06:39.074 12:20:32 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:39.074 12:20:32 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:39.074 12:20:32 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:39.074 12:20:32 -- common/autotest_common.sh@10 -- # set +x 00:06:39.074 ************************************ 00:06:39.074 START TEST nvmf_filesystem 00:06:39.074 ************************************ 00:06:39.074 12:20:32 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:39.074 * Looking for test storage... 00:06:39.335 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:39.335 12:20:32 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:39.335 12:20:32 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:39.335 12:20:32 -- common/autotest_common.sh@34 -- # set -e 00:06:39.335 12:20:32 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:39.335 12:20:32 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:39.335 12:20:32 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:39.335 12:20:32 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:39.335 12:20:32 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:39.335 12:20:32 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:39.335 12:20:32 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:39.335 12:20:32 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:39.335 12:20:32 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:39.335 12:20:32 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:39.335 12:20:32 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:39.335 12:20:32 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:39.335 12:20:32 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:39.335 12:20:32 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:39.335 12:20:32 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:39.335 12:20:32 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:39.335 12:20:32 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:39.335 12:20:32 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:39.335 12:20:32 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:39.335 12:20:32 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:39.335 12:20:32 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:39.335 12:20:32 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:39.335 12:20:32 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:39.335 12:20:32 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:39.335 12:20:32 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:39.335 12:20:33 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:39.335 12:20:33 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:39.335 12:20:33 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:39.335 12:20:33 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:39.335 12:20:33 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:39.335 12:20:33 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:39.335 12:20:33 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:39.335 12:20:33 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:39.335 12:20:33 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:39.335 12:20:33 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:39.335 12:20:33 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:39.335 12:20:33 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:39.335 12:20:33 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:39.335 12:20:33 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:39.335 12:20:33 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:39.335 12:20:33 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:39.335 12:20:33 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:39.335 12:20:33 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:39.335 12:20:33 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:39.335 12:20:33 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:39.335 12:20:33 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:39.335 12:20:33 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:39.335 12:20:33 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:39.335 12:20:33 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:39.335 12:20:33 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:39.335 12:20:33 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:39.335 12:20:33 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:39.335 12:20:33 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:39.335 12:20:33 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:39.335 12:20:33 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:39.335 12:20:33 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:39.335 12:20:33 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:39.335 12:20:33 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:39.335 12:20:33 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:39.335 12:20:33 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:39.335 12:20:33 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:39.335 12:20:33 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:39.335 12:20:33 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:39.335 12:20:33 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:39.335 12:20:33 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:39.335 12:20:33 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:39.335 12:20:33 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:39.335 12:20:33 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:39.335 12:20:33 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:39.335 12:20:33 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:39.335 12:20:33 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:39.335 12:20:33 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:39.335 12:20:33 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:39.335 12:20:33 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:39.335 12:20:33 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:39.335 12:20:33 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:39.335 12:20:33 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:39.335 12:20:33 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:39.335 12:20:33 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:39.335 12:20:33 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:39.335 12:20:33 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:39.335 12:20:33 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:39.335 12:20:33 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:39.335 12:20:33 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:39.335 12:20:33 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:39.335 12:20:33 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:39.335 12:20:33 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:39.335 12:20:33 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:39.335 12:20:33 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:39.335 12:20:33 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:39.335 12:20:33 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:39.335 12:20:33 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:39.335 12:20:33 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:39.335 12:20:33 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:39.335 12:20:33 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:39.335 12:20:33 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:39.335 12:20:33 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:39.335 12:20:33 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:39.335 12:20:33 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:39.335 #define SPDK_CONFIG_H 00:06:39.335 #define SPDK_CONFIG_APPS 1 00:06:39.335 #define SPDK_CONFIG_ARCH native 00:06:39.335 #undef SPDK_CONFIG_ASAN 00:06:39.335 #undef SPDK_CONFIG_AVAHI 00:06:39.335 #undef SPDK_CONFIG_CET 00:06:39.335 #define SPDK_CONFIG_COVERAGE 1 00:06:39.335 #define SPDK_CONFIG_CROSS_PREFIX 00:06:39.335 #undef SPDK_CONFIG_CRYPTO 00:06:39.335 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:39.335 #undef SPDK_CONFIG_CUSTOMOCF 00:06:39.335 #undef SPDK_CONFIG_DAOS 00:06:39.335 #define SPDK_CONFIG_DAOS_DIR 00:06:39.335 #define SPDK_CONFIG_DEBUG 1 00:06:39.335 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:39.335 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:39.335 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:39.335 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:39.335 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:39.335 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:39.335 #define SPDK_CONFIG_EXAMPLES 1 00:06:39.335 #undef SPDK_CONFIG_FC 00:06:39.335 #define SPDK_CONFIG_FC_PATH 00:06:39.335 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:39.335 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:39.335 #undef SPDK_CONFIG_FUSE 00:06:39.335 #undef SPDK_CONFIG_FUZZER 00:06:39.335 #define SPDK_CONFIG_FUZZER_LIB 00:06:39.335 #undef SPDK_CONFIG_GOLANG 00:06:39.335 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:39.335 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:39.335 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:39.335 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:39.335 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:39.335 #define SPDK_CONFIG_IDXD 1 00:06:39.335 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:39.335 #undef SPDK_CONFIG_IPSEC_MB 00:06:39.335 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:39.335 #define SPDK_CONFIG_ISAL 1 00:06:39.335 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:39.335 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:39.335 #define SPDK_CONFIG_LIBDIR 00:06:39.335 #undef SPDK_CONFIG_LTO 00:06:39.335 #define SPDK_CONFIG_MAX_LCORES 00:06:39.335 #define SPDK_CONFIG_NVME_CUSE 1 00:06:39.335 #undef SPDK_CONFIG_OCF 00:06:39.335 #define SPDK_CONFIG_OCF_PATH 00:06:39.335 #define SPDK_CONFIG_OPENSSL_PATH 00:06:39.335 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:39.335 #undef SPDK_CONFIG_PGO_USE 00:06:39.335 #define SPDK_CONFIG_PREFIX /usr/local 00:06:39.335 #undef SPDK_CONFIG_RAID5F 00:06:39.335 #undef SPDK_CONFIG_RBD 00:06:39.335 #define SPDK_CONFIG_RDMA 1 00:06:39.335 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:39.335 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:39.335 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:39.335 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:39.335 #define SPDK_CONFIG_SHARED 1 00:06:39.335 #undef SPDK_CONFIG_SMA 00:06:39.335 #define SPDK_CONFIG_TESTS 1 00:06:39.335 #undef SPDK_CONFIG_TSAN 00:06:39.335 #define SPDK_CONFIG_UBLK 1 00:06:39.335 #define SPDK_CONFIG_UBSAN 1 00:06:39.335 #undef SPDK_CONFIG_UNIT_TESTS 00:06:39.335 #undef SPDK_CONFIG_URING 00:06:39.335 #define SPDK_CONFIG_URING_PATH 00:06:39.335 #undef SPDK_CONFIG_URING_ZNS 00:06:39.335 #undef SPDK_CONFIG_USDT 00:06:39.335 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:39.335 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:39.335 #undef SPDK_CONFIG_VFIO_USER 00:06:39.335 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:39.335 #define SPDK_CONFIG_VHOST 1 00:06:39.335 #define SPDK_CONFIG_VIRTIO 1 00:06:39.335 #undef SPDK_CONFIG_VTUNE 00:06:39.335 #define SPDK_CONFIG_VTUNE_DIR 00:06:39.335 #define SPDK_CONFIG_WERROR 1 00:06:39.335 #define SPDK_CONFIG_WPDK_DIR 00:06:39.335 #undef SPDK_CONFIG_XNVME 00:06:39.335 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:39.335 12:20:33 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:39.335 12:20:33 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:39.335 12:20:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:39.335 12:20:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:39.335 12:20:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:39.335 12:20:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.335 12:20:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.335 12:20:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.335 12:20:33 -- paths/export.sh@5 -- # export PATH 00:06:39.335 12:20:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.335 12:20:33 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:39.335 12:20:33 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:39.335 12:20:33 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:39.335 12:20:33 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:39.335 12:20:33 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:39.335 12:20:33 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:39.335 12:20:33 -- pm/common@16 -- # TEST_TAG=N/A 00:06:39.335 12:20:33 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:39.335 12:20:33 -- common/autotest_common.sh@52 -- # : 1 00:06:39.335 12:20:33 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:39.335 12:20:33 -- common/autotest_common.sh@56 -- # : 0 00:06:39.335 12:20:33 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:39.335 12:20:33 -- common/autotest_common.sh@58 -- # : 0 00:06:39.335 12:20:33 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:39.335 12:20:33 -- common/autotest_common.sh@60 -- # : 1 00:06:39.335 12:20:33 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:39.335 12:20:33 -- common/autotest_common.sh@62 -- # : 0 00:06:39.335 12:20:33 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:39.335 12:20:33 -- common/autotest_common.sh@64 -- # : 00:06:39.335 12:20:33 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:39.335 12:20:33 -- common/autotest_common.sh@66 -- # : 0 00:06:39.335 12:20:33 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:39.335 12:20:33 -- common/autotest_common.sh@68 -- # : 0 00:06:39.335 12:20:33 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:39.335 12:20:33 -- common/autotest_common.sh@70 -- # : 0 00:06:39.335 12:20:33 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:39.335 12:20:33 -- common/autotest_common.sh@72 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:39.336 12:20:33 -- common/autotest_common.sh@74 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:39.336 12:20:33 -- common/autotest_common.sh@76 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:39.336 12:20:33 -- common/autotest_common.sh@78 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:39.336 12:20:33 -- common/autotest_common.sh@80 -- # : 1 00:06:39.336 12:20:33 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:39.336 12:20:33 -- common/autotest_common.sh@82 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:39.336 12:20:33 -- common/autotest_common.sh@84 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:39.336 12:20:33 -- common/autotest_common.sh@86 -- # : 1 00:06:39.336 12:20:33 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:39.336 12:20:33 -- common/autotest_common.sh@88 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:39.336 12:20:33 -- common/autotest_common.sh@90 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:39.336 12:20:33 -- common/autotest_common.sh@92 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:39.336 12:20:33 -- common/autotest_common.sh@94 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:39.336 12:20:33 -- common/autotest_common.sh@96 -- # : tcp 00:06:39.336 12:20:33 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:39.336 12:20:33 -- common/autotest_common.sh@98 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:39.336 12:20:33 -- common/autotest_common.sh@100 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:39.336 12:20:33 -- common/autotest_common.sh@102 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:39.336 12:20:33 -- common/autotest_common.sh@104 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:39.336 12:20:33 -- common/autotest_common.sh@106 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:39.336 12:20:33 -- common/autotest_common.sh@108 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:39.336 12:20:33 -- common/autotest_common.sh@110 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:39.336 12:20:33 -- common/autotest_common.sh@112 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:39.336 12:20:33 -- common/autotest_common.sh@114 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:39.336 12:20:33 -- common/autotest_common.sh@116 -- # : 1 00:06:39.336 12:20:33 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:39.336 12:20:33 -- common/autotest_common.sh@118 -- # : 00:06:39.336 12:20:33 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:39.336 12:20:33 -- common/autotest_common.sh@120 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:39.336 12:20:33 -- common/autotest_common.sh@122 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:39.336 12:20:33 -- common/autotest_common.sh@124 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:39.336 12:20:33 -- common/autotest_common.sh@126 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:39.336 12:20:33 -- common/autotest_common.sh@128 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:39.336 12:20:33 -- common/autotest_common.sh@130 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:39.336 12:20:33 -- common/autotest_common.sh@132 -- # : 00:06:39.336 12:20:33 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:39.336 12:20:33 -- common/autotest_common.sh@134 -- # : true 00:06:39.336 12:20:33 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:39.336 12:20:33 -- common/autotest_common.sh@136 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:39.336 12:20:33 -- common/autotest_common.sh@138 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:39.336 12:20:33 -- common/autotest_common.sh@140 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:39.336 12:20:33 -- common/autotest_common.sh@142 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:39.336 12:20:33 -- common/autotest_common.sh@144 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:39.336 12:20:33 -- common/autotest_common.sh@146 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:39.336 12:20:33 -- common/autotest_common.sh@148 -- # : e810 00:06:39.336 12:20:33 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:39.336 12:20:33 -- common/autotest_common.sh@150 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:39.336 12:20:33 -- common/autotest_common.sh@152 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:39.336 12:20:33 -- common/autotest_common.sh@154 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:39.336 12:20:33 -- common/autotest_common.sh@156 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:39.336 12:20:33 -- common/autotest_common.sh@158 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:39.336 12:20:33 -- common/autotest_common.sh@160 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:39.336 12:20:33 -- common/autotest_common.sh@163 -- # : 00:06:39.336 12:20:33 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:39.336 12:20:33 -- common/autotest_common.sh@165 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:39.336 12:20:33 -- common/autotest_common.sh@167 -- # : 0 00:06:39.336 12:20:33 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:39.336 12:20:33 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:39.336 12:20:33 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:39.336 12:20:33 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:39.336 12:20:33 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:39.336 12:20:33 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:39.336 12:20:33 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:39.336 12:20:33 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:39.336 12:20:33 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:39.336 12:20:33 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:39.336 12:20:33 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:39.336 12:20:33 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:39.336 12:20:33 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:39.336 12:20:33 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:39.336 12:20:33 -- common/autotest_common.sh@196 -- # cat 00:06:39.336 12:20:33 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:39.336 12:20:33 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:39.336 12:20:33 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:39.336 12:20:33 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:39.336 12:20:33 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:39.336 12:20:33 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:39.336 12:20:33 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:39.336 12:20:33 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:39.336 12:20:33 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:39.336 12:20:33 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:39.336 12:20:33 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:39.336 12:20:33 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:39.336 12:20:33 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:39.336 12:20:33 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:39.336 12:20:33 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:39.336 12:20:33 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:39.336 12:20:33 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:39.336 12:20:33 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:39.336 12:20:33 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:39.336 12:20:33 -- common/autotest_common.sh@248 -- # '[' 0 -eq 0 ']' 00:06:39.336 12:20:33 -- common/autotest_common.sh@249 -- # export valgrind= 00:06:39.336 12:20:33 -- common/autotest_common.sh@249 -- # valgrind= 00:06:39.336 12:20:33 -- common/autotest_common.sh@255 -- # uname -s 00:06:39.336 12:20:33 -- common/autotest_common.sh@255 -- # '[' Linux = Linux ']' 00:06:39.336 12:20:33 -- common/autotest_common.sh@256 -- # HUGEMEM=4096 00:06:39.336 12:20:33 -- common/autotest_common.sh@257 -- # export CLEAR_HUGE=yes 00:06:39.336 12:20:33 -- common/autotest_common.sh@257 -- # CLEAR_HUGE=yes 00:06:39.336 12:20:33 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:39.336 12:20:33 -- common/autotest_common.sh@258 -- # [[ 0 -eq 1 ]] 00:06:39.336 12:20:33 -- common/autotest_common.sh@265 -- # MAKE=make 00:06:39.336 12:20:33 -- common/autotest_common.sh@266 -- # MAKEFLAGS=-j48 00:06:39.336 12:20:33 -- common/autotest_common.sh@282 -- # export HUGEMEM=4096 00:06:39.336 12:20:33 -- common/autotest_common.sh@282 -- # HUGEMEM=4096 00:06:39.336 12:20:33 -- common/autotest_common.sh@284 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:39.336 12:20:33 -- common/autotest_common.sh@289 -- # NO_HUGE=() 00:06:39.336 12:20:33 -- common/autotest_common.sh@290 -- # TEST_MODE= 00:06:39.336 12:20:33 -- common/autotest_common.sh@291 -- # for i in "$@" 00:06:39.336 12:20:33 -- common/autotest_common.sh@292 -- # case "$i" in 00:06:39.336 12:20:33 -- common/autotest_common.sh@297 -- # TEST_TRANSPORT=tcp 00:06:39.336 12:20:33 -- common/autotest_common.sh@309 -- # [[ -z 1168449 ]] 00:06:39.336 12:20:33 -- common/autotest_common.sh@309 -- # kill -0 1168449 00:06:39.336 12:20:33 -- common/autotest_common.sh@1665 -- # set_test_storage 2147483648 00:06:39.336 12:20:33 -- common/autotest_common.sh@319 -- # [[ -v testdir ]] 00:06:39.336 12:20:33 -- common/autotest_common.sh@321 -- # local requested_size=2147483648 00:06:39.336 12:20:33 -- common/autotest_common.sh@322 -- # local mount target_dir 00:06:39.336 12:20:33 -- common/autotest_common.sh@324 -- # local -A mounts fss sizes avails uses 00:06:39.336 12:20:33 -- common/autotest_common.sh@325 -- # local source fs size avail mount use 00:06:39.336 12:20:33 -- common/autotest_common.sh@327 -- # local storage_fallback storage_candidates 00:06:39.336 12:20:33 -- common/autotest_common.sh@329 -- # mktemp -udt spdk.XXXXXX 00:06:39.336 12:20:33 -- common/autotest_common.sh@329 -- # storage_fallback=/tmp/spdk.wafJ0n 00:06:39.336 12:20:33 -- common/autotest_common.sh@334 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:39.336 12:20:33 -- common/autotest_common.sh@336 -- # [[ -n '' ]] 00:06:39.336 12:20:33 -- common/autotest_common.sh@341 -- # [[ -n '' ]] 00:06:39.336 12:20:33 -- common/autotest_common.sh@346 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.wafJ0n/tests/target /tmp/spdk.wafJ0n 00:06:39.336 12:20:33 -- common/autotest_common.sh@349 -- # requested_size=2214592512 00:06:39.336 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.336 12:20:33 -- common/autotest_common.sh@318 -- # df -T 00:06:39.336 12:20:33 -- common/autotest_common.sh@318 -- # grep -v Filesystem 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_devtmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=devtmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=67108864 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=67108864 00:06:39.336 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=0 00:06:39.336 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=/dev/pmem0 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=ext2 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=953643008 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=5284429824 00:06:39.336 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=4330786816 00:06:39.336 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=spdk_root 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=overlay 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=56405762048 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=61994708992 00:06:39.336 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=5588946944 00:06:39.336 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=30996094976 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997352448 00:06:39.336 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=1257472 00:06:39.336 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=12390182912 00:06:39.336 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=12398944256 00:06:39.336 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=8761344 00:06:39.336 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:39.336 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:39.337 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=30996979712 00:06:39.337 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=30997356544 00:06:39.337 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=376832 00:06:39.337 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.337 12:20:33 -- common/autotest_common.sh@352 -- # mounts["$mount"]=tmpfs 00:06:39.337 12:20:33 -- common/autotest_common.sh@352 -- # fss["$mount"]=tmpfs 00:06:39.337 12:20:33 -- common/autotest_common.sh@353 -- # avails["$mount"]=6199463936 00:06:39.337 12:20:33 -- common/autotest_common.sh@353 -- # sizes["$mount"]=6199468032 00:06:39.337 12:20:33 -- common/autotest_common.sh@354 -- # uses["$mount"]=4096 00:06:39.337 12:20:33 -- common/autotest_common.sh@351 -- # read -r source fs size use avail _ mount 00:06:39.337 12:20:33 -- common/autotest_common.sh@357 -- # printf '* Looking for test storage...\n' 00:06:39.337 * Looking for test storage... 00:06:39.337 12:20:33 -- common/autotest_common.sh@359 -- # local target_space new_size 00:06:39.337 12:20:33 -- common/autotest_common.sh@360 -- # for target_dir in "${storage_candidates[@]}" 00:06:39.337 12:20:33 -- common/autotest_common.sh@363 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:39.337 12:20:33 -- common/autotest_common.sh@363 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:39.337 12:20:33 -- common/autotest_common.sh@363 -- # mount=/ 00:06:39.337 12:20:33 -- common/autotest_common.sh@365 -- # target_space=56405762048 00:06:39.337 12:20:33 -- common/autotest_common.sh@366 -- # (( target_space == 0 || target_space < requested_size )) 00:06:39.337 12:20:33 -- common/autotest_common.sh@369 -- # (( target_space >= requested_size )) 00:06:39.337 12:20:33 -- common/autotest_common.sh@371 -- # [[ overlay == tmpfs ]] 00:06:39.337 12:20:33 -- common/autotest_common.sh@371 -- # [[ overlay == ramfs ]] 00:06:39.337 12:20:33 -- common/autotest_common.sh@371 -- # [[ / == / ]] 00:06:39.337 12:20:33 -- common/autotest_common.sh@372 -- # new_size=7803539456 00:06:39.337 12:20:33 -- common/autotest_common.sh@373 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:39.337 12:20:33 -- common/autotest_common.sh@378 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:39.337 12:20:33 -- common/autotest_common.sh@378 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:39.337 12:20:33 -- common/autotest_common.sh@379 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:39.337 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:39.337 12:20:33 -- common/autotest_common.sh@380 -- # return 0 00:06:39.337 12:20:33 -- common/autotest_common.sh@1667 -- # set -o errtrace 00:06:39.337 12:20:33 -- common/autotest_common.sh@1668 -- # shopt -s extdebug 00:06:39.337 12:20:33 -- common/autotest_common.sh@1669 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:39.337 12:20:33 -- common/autotest_common.sh@1671 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:39.337 12:20:33 -- common/autotest_common.sh@1672 -- # true 00:06:39.337 12:20:33 -- common/autotest_common.sh@1674 -- # xtrace_fd 00:06:39.337 12:20:33 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:39.337 12:20:33 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:39.337 12:20:33 -- common/autotest_common.sh@27 -- # exec 00:06:39.337 12:20:33 -- common/autotest_common.sh@29 -- # exec 00:06:39.337 12:20:33 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:39.337 12:20:33 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:39.337 12:20:33 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:39.337 12:20:33 -- common/autotest_common.sh@18 -- # set -x 00:06:39.337 12:20:33 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:39.337 12:20:33 -- nvmf/common.sh@7 -- # uname -s 00:06:39.337 12:20:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:39.337 12:20:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:39.337 12:20:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:39.337 12:20:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:39.337 12:20:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:39.337 12:20:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:39.337 12:20:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:39.337 12:20:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:39.337 12:20:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:39.337 12:20:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:39.337 12:20:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:39.337 12:20:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:39.337 12:20:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:39.337 12:20:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:39.337 12:20:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:39.337 12:20:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:39.337 12:20:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:39.337 12:20:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:39.337 12:20:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:39.337 12:20:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.337 12:20:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.337 12:20:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.337 12:20:33 -- paths/export.sh@5 -- # export PATH 00:06:39.337 12:20:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:39.337 12:20:33 -- nvmf/common.sh@46 -- # : 0 00:06:39.337 12:20:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:39.337 12:20:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:39.337 12:20:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:39.337 12:20:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:39.337 12:20:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:39.337 12:20:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:39.337 12:20:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:39.337 12:20:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:39.337 12:20:33 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:39.337 12:20:33 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:39.337 12:20:33 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:39.337 12:20:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:39.337 12:20:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:39.337 12:20:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:39.337 12:20:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:39.337 12:20:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:39.337 12:20:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:39.337 12:20:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:39.337 12:20:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:39.337 12:20:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:39.337 12:20:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:39.337 12:20:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:39.337 12:20:33 -- common/autotest_common.sh@10 -- # set +x 00:06:41.235 12:20:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:41.235 12:20:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:41.235 12:20:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:41.235 12:20:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:41.235 12:20:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:41.235 12:20:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:41.235 12:20:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:41.235 12:20:35 -- nvmf/common.sh@294 -- # net_devs=() 00:06:41.235 12:20:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:41.235 12:20:35 -- nvmf/common.sh@295 -- # e810=() 00:06:41.235 12:20:35 -- nvmf/common.sh@295 -- # local -ga e810 00:06:41.235 12:20:35 -- nvmf/common.sh@296 -- # x722=() 00:06:41.235 12:20:35 -- nvmf/common.sh@296 -- # local -ga x722 00:06:41.235 12:20:35 -- nvmf/common.sh@297 -- # mlx=() 00:06:41.235 12:20:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:41.235 12:20:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:41.235 12:20:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:41.235 12:20:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:41.235 12:20:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:41.235 12:20:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:41.235 12:20:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:41.235 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:41.235 12:20:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:41.235 12:20:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:41.235 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:41.235 12:20:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:41.235 12:20:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:41.235 12:20:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:41.235 12:20:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:41.235 12:20:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:41.235 12:20:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:41.235 12:20:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:41.235 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:41.235 12:20:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:41.235 12:20:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:41.235 12:20:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:41.235 12:20:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:41.236 12:20:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:41.236 12:20:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:41.236 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:41.236 12:20:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:41.236 12:20:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:41.236 12:20:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:41.236 12:20:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:41.236 12:20:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:41.236 12:20:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:41.236 12:20:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:41.236 12:20:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:41.236 12:20:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:41.236 12:20:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:41.236 12:20:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:41.236 12:20:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:41.236 12:20:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:41.236 12:20:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:41.236 12:20:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:41.236 12:20:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:41.236 12:20:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:41.236 12:20:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:41.236 12:20:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:41.236 12:20:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:41.236 12:20:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:41.236 12:20:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:41.236 12:20:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:41.494 12:20:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:41.494 12:20:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:41.494 12:20:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:41.494 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:41.494 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.127 ms 00:06:41.494 00:06:41.494 --- 10.0.0.2 ping statistics --- 00:06:41.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:41.494 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:06:41.494 12:20:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:41.494 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:41.494 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:06:41.494 00:06:41.494 --- 10.0.0.1 ping statistics --- 00:06:41.494 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:41.494 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:06:41.494 12:20:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:41.494 12:20:35 -- nvmf/common.sh@410 -- # return 0 00:06:41.494 12:20:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:41.494 12:20:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:41.494 12:20:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:41.494 12:20:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:41.494 12:20:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:41.494 12:20:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:41.494 12:20:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:41.494 12:20:35 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:41.494 12:20:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:41.494 12:20:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:41.494 12:20:35 -- common/autotest_common.sh@10 -- # set +x 00:06:41.494 ************************************ 00:06:41.494 START TEST nvmf_filesystem_no_in_capsule 00:06:41.494 ************************************ 00:06:41.494 12:20:35 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 0 00:06:41.494 12:20:35 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:41.494 12:20:35 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:41.494 12:20:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:41.494 12:20:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:41.494 12:20:35 -- common/autotest_common.sh@10 -- # set +x 00:06:41.494 12:20:35 -- nvmf/common.sh@469 -- # nvmfpid=1170077 00:06:41.494 12:20:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:41.494 12:20:35 -- nvmf/common.sh@470 -- # waitforlisten 1170077 00:06:41.494 12:20:35 -- common/autotest_common.sh@819 -- # '[' -z 1170077 ']' 00:06:41.494 12:20:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.494 12:20:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:41.494 12:20:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.494 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.494 12:20:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:41.494 12:20:35 -- common/autotest_common.sh@10 -- # set +x 00:06:41.494 [2024-07-12 12:20:35.270586] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:41.494 [2024-07-12 12:20:35.270667] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:41.494 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.494 [2024-07-12 12:20:35.343993] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:41.754 [2024-07-12 12:20:35.465095] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.754 [2024-07-12 12:20:35.465262] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:41.754 [2024-07-12 12:20:35.465282] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:41.754 [2024-07-12 12:20:35.465302] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:41.754 [2024-07-12 12:20:35.465388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:41.754 [2024-07-12 12:20:35.465444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:41.754 [2024-07-12 12:20:35.465496] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:41.754 [2024-07-12 12:20:35.465499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.319 12:20:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:42.319 12:20:36 -- common/autotest_common.sh@852 -- # return 0 00:06:42.319 12:20:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:42.319 12:20:36 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:42.319 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 12:20:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:42.577 12:20:36 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:42.577 12:20:36 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:42.577 12:20:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:42.577 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 [2024-07-12 12:20:36.250307] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:42.577 12:20:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:42.577 12:20:36 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:42.577 12:20:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:42.577 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 Malloc1 00:06:42.577 12:20:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:42.577 12:20:36 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:42.577 12:20:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:42.577 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 12:20:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:42.577 12:20:36 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:42.577 12:20:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:42.577 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 12:20:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:42.577 12:20:36 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:42.577 12:20:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:42.577 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 [2024-07-12 12:20:36.424414] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:42.577 12:20:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:42.577 12:20:36 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:42.577 12:20:36 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:42.577 12:20:36 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:42.577 12:20:36 -- common/autotest_common.sh@1359 -- # local bs 00:06:42.577 12:20:36 -- common/autotest_common.sh@1360 -- # local nb 00:06:42.577 12:20:36 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:42.577 12:20:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:42.577 12:20:36 -- common/autotest_common.sh@10 -- # set +x 00:06:42.577 12:20:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:42.577 12:20:36 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:42.577 { 00:06:42.577 "name": "Malloc1", 00:06:42.577 "aliases": [ 00:06:42.577 "9a452c3c-6b3f-43ec-8071-5a9abed03f62" 00:06:42.577 ], 00:06:42.577 "product_name": "Malloc disk", 00:06:42.577 "block_size": 512, 00:06:42.577 "num_blocks": 1048576, 00:06:42.577 "uuid": "9a452c3c-6b3f-43ec-8071-5a9abed03f62", 00:06:42.577 "assigned_rate_limits": { 00:06:42.577 "rw_ios_per_sec": 0, 00:06:42.577 "rw_mbytes_per_sec": 0, 00:06:42.577 "r_mbytes_per_sec": 0, 00:06:42.577 "w_mbytes_per_sec": 0 00:06:42.577 }, 00:06:42.577 "claimed": true, 00:06:42.577 "claim_type": "exclusive_write", 00:06:42.577 "zoned": false, 00:06:42.577 "supported_io_types": { 00:06:42.577 "read": true, 00:06:42.577 "write": true, 00:06:42.577 "unmap": true, 00:06:42.577 "write_zeroes": true, 00:06:42.577 "flush": true, 00:06:42.577 "reset": true, 00:06:42.577 "compare": false, 00:06:42.577 "compare_and_write": false, 00:06:42.577 "abort": true, 00:06:42.577 "nvme_admin": false, 00:06:42.577 "nvme_io": false 00:06:42.577 }, 00:06:42.577 "memory_domains": [ 00:06:42.577 { 00:06:42.577 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:42.577 "dma_device_type": 2 00:06:42.577 } 00:06:42.577 ], 00:06:42.577 "driver_specific": {} 00:06:42.577 } 00:06:42.577 ]' 00:06:42.577 12:20:36 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:42.577 12:20:36 -- common/autotest_common.sh@1362 -- # bs=512 00:06:42.577 12:20:36 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:42.836 12:20:36 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:42.836 12:20:36 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:42.836 12:20:36 -- common/autotest_common.sh@1367 -- # echo 512 00:06:42.836 12:20:36 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:42.836 12:20:36 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:43.403 12:20:37 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:43.403 12:20:37 -- common/autotest_common.sh@1177 -- # local i=0 00:06:43.403 12:20:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:43.403 12:20:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:43.403 12:20:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:45.323 12:20:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:45.323 12:20:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:45.323 12:20:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:45.323 12:20:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:45.323 12:20:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:45.323 12:20:39 -- common/autotest_common.sh@1187 -- # return 0 00:06:45.323 12:20:39 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:45.323 12:20:39 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:45.323 12:20:39 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:45.323 12:20:39 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:45.323 12:20:39 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:45.323 12:20:39 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:45.323 12:20:39 -- setup/common.sh@80 -- # echo 536870912 00:06:45.323 12:20:39 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:45.323 12:20:39 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:45.323 12:20:39 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:45.323 12:20:39 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:45.890 12:20:39 -- target/filesystem.sh@69 -- # partprobe 00:06:46.148 12:20:39 -- target/filesystem.sh@70 -- # sleep 1 00:06:47.084 12:20:40 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:06:47.084 12:20:40 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:47.084 12:20:40 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:47.084 12:20:40 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:47.084 12:20:40 -- common/autotest_common.sh@10 -- # set +x 00:06:47.084 ************************************ 00:06:47.084 START TEST filesystem_ext4 00:06:47.084 ************************************ 00:06:47.084 12:20:40 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:47.084 12:20:40 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:47.084 12:20:40 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:47.084 12:20:40 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:47.084 12:20:40 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:47.084 12:20:40 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:47.084 12:20:40 -- common/autotest_common.sh@904 -- # local i=0 00:06:47.084 12:20:40 -- common/autotest_common.sh@905 -- # local force 00:06:47.084 12:20:40 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:47.084 12:20:40 -- common/autotest_common.sh@908 -- # force=-F 00:06:47.084 12:20:40 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:47.084 mke2fs 1.46.5 (30-Dec-2021) 00:06:47.342 Discarding device blocks: 0/522240 done 00:06:47.342 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:47.342 Filesystem UUID: 0a6542d5-a11e-4d12-a81b-dd2cbd7ef8ca 00:06:47.342 Superblock backups stored on blocks: 00:06:47.342 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:47.342 00:06:47.342 Allocating group tables: 0/64 done 00:06:47.342 Writing inode tables: 0/64 done 00:06:47.600 Creating journal (8192 blocks): done 00:06:48.424 Writing superblocks and filesystem accounting information: 0/6426/64 done 00:06:48.424 00:06:48.424 12:20:42 -- common/autotest_common.sh@921 -- # return 0 00:06:48.424 12:20:42 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:49.358 12:20:42 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:49.358 12:20:42 -- target/filesystem.sh@25 -- # sync 00:06:49.358 12:20:42 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:49.358 12:20:42 -- target/filesystem.sh@27 -- # sync 00:06:49.358 12:20:42 -- target/filesystem.sh@29 -- # i=0 00:06:49.358 12:20:42 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:49.358 12:20:43 -- target/filesystem.sh@37 -- # kill -0 1170077 00:06:49.358 12:20:43 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:49.358 12:20:43 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:49.358 12:20:43 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:49.358 12:20:43 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:49.358 00:06:49.358 real 0m2.065s 00:06:49.358 user 0m0.020s 00:06:49.358 sys 0m0.052s 00:06:49.358 12:20:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:49.358 12:20:43 -- common/autotest_common.sh@10 -- # set +x 00:06:49.358 ************************************ 00:06:49.358 END TEST filesystem_ext4 00:06:49.358 ************************************ 00:06:49.358 12:20:43 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:06:49.358 12:20:43 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:49.358 12:20:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:49.358 12:20:43 -- common/autotest_common.sh@10 -- # set +x 00:06:49.358 ************************************ 00:06:49.358 START TEST filesystem_btrfs 00:06:49.358 ************************************ 00:06:49.358 12:20:43 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:06:49.358 12:20:43 -- target/filesystem.sh@18 -- # fstype=btrfs 00:06:49.358 12:20:43 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:49.358 12:20:43 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:06:49.358 12:20:43 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:06:49.358 12:20:43 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:49.358 12:20:43 -- common/autotest_common.sh@904 -- # local i=0 00:06:49.358 12:20:43 -- common/autotest_common.sh@905 -- # local force 00:06:49.358 12:20:43 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:06:49.358 12:20:43 -- common/autotest_common.sh@910 -- # force=-f 00:06:49.358 12:20:43 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:06:49.617 btrfs-progs v6.6.2 00:06:49.617 See https://btrfs.readthedocs.io for more information. 00:06:49.617 00:06:49.617 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:06:49.617 NOTE: several default settings have changed in version 5.15, please make sure 00:06:49.617 this does not affect your deployments: 00:06:49.617 - DUP for metadata (-m dup) 00:06:49.617 - enabled no-holes (-O no-holes) 00:06:49.617 - enabled free-space-tree (-R free-space-tree) 00:06:49.617 00:06:49.617 Label: (null) 00:06:49.617 UUID: 9b38e6d3-ae41-4522-b046-07e3bd580a2f 00:06:49.617 Node size: 16384 00:06:49.617 Sector size: 4096 00:06:49.617 Filesystem size: 510.00MiB 00:06:49.617 Block group profiles: 00:06:49.617 Data: single 8.00MiB 00:06:49.617 Metadata: DUP 32.00MiB 00:06:49.617 System: DUP 8.00MiB 00:06:49.617 SSD detected: yes 00:06:49.617 Zoned device: no 00:06:49.617 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:06:49.617 Runtime features: free-space-tree 00:06:49.617 Checksum: crc32c 00:06:49.617 Number of devices: 1 00:06:49.617 Devices: 00:06:49.617 ID SIZE PATH 00:06:49.617 1 510.00MiB /dev/nvme0n1p1 00:06:49.617 00:06:49.617 12:20:43 -- common/autotest_common.sh@921 -- # return 0 00:06:49.617 12:20:43 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:50.551 12:20:44 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:50.551 12:20:44 -- target/filesystem.sh@25 -- # sync 00:06:50.551 12:20:44 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:50.551 12:20:44 -- target/filesystem.sh@27 -- # sync 00:06:50.551 12:20:44 -- target/filesystem.sh@29 -- # i=0 00:06:50.551 12:20:44 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:50.551 12:20:44 -- target/filesystem.sh@37 -- # kill -0 1170077 00:06:50.551 12:20:44 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:50.551 12:20:44 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:50.551 12:20:44 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:50.551 12:20:44 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:50.551 00:06:50.551 real 0m1.247s 00:06:50.551 user 0m0.029s 00:06:50.551 sys 0m0.109s 00:06:50.551 12:20:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:50.551 12:20:44 -- common/autotest_common.sh@10 -- # set +x 00:06:50.551 ************************************ 00:06:50.551 END TEST filesystem_btrfs 00:06:50.551 ************************************ 00:06:50.551 12:20:44 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:06:50.551 12:20:44 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:50.551 12:20:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:50.551 12:20:44 -- common/autotest_common.sh@10 -- # set +x 00:06:50.551 ************************************ 00:06:50.551 START TEST filesystem_xfs 00:06:50.551 ************************************ 00:06:50.551 12:20:44 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:06:50.551 12:20:44 -- target/filesystem.sh@18 -- # fstype=xfs 00:06:50.551 12:20:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:50.551 12:20:44 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:06:50.551 12:20:44 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:06:50.551 12:20:44 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:50.551 12:20:44 -- common/autotest_common.sh@904 -- # local i=0 00:06:50.551 12:20:44 -- common/autotest_common.sh@905 -- # local force 00:06:50.551 12:20:44 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:06:50.551 12:20:44 -- common/autotest_common.sh@910 -- # force=-f 00:06:50.551 12:20:44 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:06:50.551 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:06:50.551 = sectsz=512 attr=2, projid32bit=1 00:06:50.551 = crc=1 finobt=1, sparse=1, rmapbt=0 00:06:50.551 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:06:50.551 data = bsize=4096 blocks=130560, imaxpct=25 00:06:50.551 = sunit=0 swidth=0 blks 00:06:50.552 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:06:50.552 log =internal log bsize=4096 blocks=16384, version=2 00:06:50.552 = sectsz=512 sunit=0 blks, lazy-count=1 00:06:50.552 realtime =none extsz=4096 blocks=0, rtextents=0 00:06:51.513 Discarding blocks...Done. 00:06:51.513 12:20:45 -- common/autotest_common.sh@921 -- # return 0 00:06:51.513 12:20:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:06:53.412 12:20:47 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:06:53.412 12:20:47 -- target/filesystem.sh@25 -- # sync 00:06:53.412 12:20:47 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:06:53.412 12:20:47 -- target/filesystem.sh@27 -- # sync 00:06:53.412 12:20:47 -- target/filesystem.sh@29 -- # i=0 00:06:53.412 12:20:47 -- target/filesystem.sh@30 -- # umount /mnt/device 00:06:53.412 12:20:47 -- target/filesystem.sh@37 -- # kill -0 1170077 00:06:53.412 12:20:47 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:06:53.412 12:20:47 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:06:53.412 12:20:47 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:06:53.412 12:20:47 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:06:53.412 00:06:53.412 real 0m2.759s 00:06:53.412 user 0m0.009s 00:06:53.412 sys 0m0.068s 00:06:53.412 12:20:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.412 12:20:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.412 ************************************ 00:06:53.412 END TEST filesystem_xfs 00:06:53.412 ************************************ 00:06:53.412 12:20:47 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:06:53.412 12:20:47 -- target/filesystem.sh@93 -- # sync 00:06:53.412 12:20:47 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:06:53.412 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:06:53.412 12:20:47 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:06:53.412 12:20:47 -- common/autotest_common.sh@1198 -- # local i=0 00:06:53.412 12:20:47 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:06:53.412 12:20:47 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:53.412 12:20:47 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:06:53.412 12:20:47 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:06:53.412 12:20:47 -- common/autotest_common.sh@1210 -- # return 0 00:06:53.412 12:20:47 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:53.412 12:20:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:53.412 12:20:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.412 12:20:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:53.412 12:20:47 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:06:53.412 12:20:47 -- target/filesystem.sh@101 -- # killprocess 1170077 00:06:53.412 12:20:47 -- common/autotest_common.sh@926 -- # '[' -z 1170077 ']' 00:06:53.413 12:20:47 -- common/autotest_common.sh@930 -- # kill -0 1170077 00:06:53.413 12:20:47 -- common/autotest_common.sh@931 -- # uname 00:06:53.413 12:20:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:06:53.413 12:20:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1170077 00:06:53.413 12:20:47 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:06:53.413 12:20:47 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:06:53.413 12:20:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1170077' 00:06:53.413 killing process with pid 1170077 00:06:53.413 12:20:47 -- common/autotest_common.sh@945 -- # kill 1170077 00:06:53.413 12:20:47 -- common/autotest_common.sh@950 -- # wait 1170077 00:06:53.979 12:20:47 -- target/filesystem.sh@102 -- # nvmfpid= 00:06:53.979 00:06:53.979 real 0m12.528s 00:06:53.979 user 0m48.084s 00:06:53.979 sys 0m1.817s 00:06:53.979 12:20:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:06:53.979 12:20:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.979 ************************************ 00:06:53.979 END TEST nvmf_filesystem_no_in_capsule 00:06:53.979 ************************************ 00:06:53.979 12:20:47 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:06:53.979 12:20:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:06:53.979 12:20:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:53.979 12:20:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.979 ************************************ 00:06:53.979 START TEST nvmf_filesystem_in_capsule 00:06:53.979 ************************************ 00:06:53.979 12:20:47 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_part 4096 00:06:53.979 12:20:47 -- target/filesystem.sh@47 -- # in_capsule=4096 00:06:53.979 12:20:47 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:53.979 12:20:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:53.979 12:20:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:06:53.979 12:20:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.979 12:20:47 -- nvmf/common.sh@469 -- # nvmfpid=1171798 00:06:53.979 12:20:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:53.979 12:20:47 -- nvmf/common.sh@470 -- # waitforlisten 1171798 00:06:53.979 12:20:47 -- common/autotest_common.sh@819 -- # '[' -z 1171798 ']' 00:06:53.979 12:20:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.979 12:20:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:06:53.979 12:20:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.979 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.979 12:20:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:06:53.979 12:20:47 -- common/autotest_common.sh@10 -- # set +x 00:06:53.979 [2024-07-12 12:20:47.828462] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:06:53.979 [2024-07-12 12:20:47.828540] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:53.979 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.979 [2024-07-12 12:20:47.897397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:54.238 [2024-07-12 12:20:48.018553] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:54.238 [2024-07-12 12:20:48.018723] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:54.238 [2024-07-12 12:20:48.018743] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:54.238 [2024-07-12 12:20:48.018758] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:54.238 [2024-07-12 12:20:48.018835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:54.238 [2024-07-12 12:20:48.021888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:54.238 [2024-07-12 12:20:48.021921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.238 [2024-07-12 12:20:48.021917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:55.173 12:20:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:06:55.173 12:20:48 -- common/autotest_common.sh@852 -- # return 0 00:06:55.173 12:20:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:55.173 12:20:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:06:55.173 12:20:48 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 12:20:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:55.173 12:20:48 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:55.173 12:20:48 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:06:55.173 12:20:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:55.173 12:20:48 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 [2024-07-12 12:20:48.829446] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:55.173 12:20:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.173 12:20:48 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:55.173 12:20:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:55.173 12:20:48 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 Malloc1 00:06:55.173 12:20:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.173 12:20:48 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:55.173 12:20:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:55.173 12:20:48 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 12:20:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.173 12:20:48 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:55.173 12:20:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:55.173 12:20:48 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 12:20:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.173 12:20:49 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:55.173 12:20:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:55.173 12:20:49 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 [2024-07-12 12:20:49.008401] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:55.173 12:20:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.173 12:20:49 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:55.173 12:20:49 -- common/autotest_common.sh@1357 -- # local bdev_name=Malloc1 00:06:55.173 12:20:49 -- common/autotest_common.sh@1358 -- # local bdev_info 00:06:55.173 12:20:49 -- common/autotest_common.sh@1359 -- # local bs 00:06:55.173 12:20:49 -- common/autotest_common.sh@1360 -- # local nb 00:06:55.173 12:20:49 -- common/autotest_common.sh@1361 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:55.173 12:20:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:06:55.173 12:20:49 -- common/autotest_common.sh@10 -- # set +x 00:06:55.173 12:20:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:06:55.173 12:20:49 -- common/autotest_common.sh@1361 -- # bdev_info='[ 00:06:55.173 { 00:06:55.173 "name": "Malloc1", 00:06:55.173 "aliases": [ 00:06:55.173 "e2a26ae6-008b-4cb0-a51e-55d243b8ba39" 00:06:55.173 ], 00:06:55.173 "product_name": "Malloc disk", 00:06:55.173 "block_size": 512, 00:06:55.173 "num_blocks": 1048576, 00:06:55.173 "uuid": "e2a26ae6-008b-4cb0-a51e-55d243b8ba39", 00:06:55.173 "assigned_rate_limits": { 00:06:55.173 "rw_ios_per_sec": 0, 00:06:55.173 "rw_mbytes_per_sec": 0, 00:06:55.173 "r_mbytes_per_sec": 0, 00:06:55.173 "w_mbytes_per_sec": 0 00:06:55.173 }, 00:06:55.173 "claimed": true, 00:06:55.173 "claim_type": "exclusive_write", 00:06:55.173 "zoned": false, 00:06:55.173 "supported_io_types": { 00:06:55.173 "read": true, 00:06:55.173 "write": true, 00:06:55.173 "unmap": true, 00:06:55.173 "write_zeroes": true, 00:06:55.173 "flush": true, 00:06:55.173 "reset": true, 00:06:55.173 "compare": false, 00:06:55.173 "compare_and_write": false, 00:06:55.173 "abort": true, 00:06:55.173 "nvme_admin": false, 00:06:55.173 "nvme_io": false 00:06:55.173 }, 00:06:55.173 "memory_domains": [ 00:06:55.173 { 00:06:55.173 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:55.173 "dma_device_type": 2 00:06:55.173 } 00:06:55.173 ], 00:06:55.173 "driver_specific": {} 00:06:55.173 } 00:06:55.173 ]' 00:06:55.173 12:20:49 -- common/autotest_common.sh@1362 -- # jq '.[] .block_size' 00:06:55.173 12:20:49 -- common/autotest_common.sh@1362 -- # bs=512 00:06:55.173 12:20:49 -- common/autotest_common.sh@1363 -- # jq '.[] .num_blocks' 00:06:55.430 12:20:49 -- common/autotest_common.sh@1363 -- # nb=1048576 00:06:55.430 12:20:49 -- common/autotest_common.sh@1366 -- # bdev_size=512 00:06:55.430 12:20:49 -- common/autotest_common.sh@1367 -- # echo 512 00:06:55.431 12:20:49 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:55.431 12:20:49 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:56.000 12:20:49 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:56.000 12:20:49 -- common/autotest_common.sh@1177 -- # local i=0 00:06:56.000 12:20:49 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:06:56.000 12:20:49 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:06:56.000 12:20:49 -- common/autotest_common.sh@1184 -- # sleep 2 00:06:57.902 12:20:51 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:06:57.903 12:20:51 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:06:57.903 12:20:51 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:06:57.903 12:20:51 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:06:57.903 12:20:51 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:06:57.903 12:20:51 -- common/autotest_common.sh@1187 -- # return 0 00:06:57.903 12:20:51 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:57.903 12:20:51 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:57.903 12:20:51 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:57.903 12:20:51 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:57.903 12:20:51 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:57.903 12:20:51 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:57.903 12:20:51 -- setup/common.sh@80 -- # echo 536870912 00:06:57.903 12:20:51 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:57.903 12:20:51 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:57.903 12:20:51 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:57.903 12:20:51 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:58.161 12:20:52 -- target/filesystem.sh@69 -- # partprobe 00:06:58.725 12:20:52 -- target/filesystem.sh@70 -- # sleep 1 00:06:59.661 12:20:53 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:06:59.661 12:20:53 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:06:59.661 12:20:53 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:06:59.661 12:20:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:06:59.661 12:20:53 -- common/autotest_common.sh@10 -- # set +x 00:06:59.661 ************************************ 00:06:59.661 START TEST filesystem_in_capsule_ext4 00:06:59.661 ************************************ 00:06:59.661 12:20:53 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create ext4 nvme0n1 00:06:59.661 12:20:53 -- target/filesystem.sh@18 -- # fstype=ext4 00:06:59.661 12:20:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:06:59.661 12:20:53 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:06:59.661 12:20:53 -- common/autotest_common.sh@902 -- # local fstype=ext4 00:06:59.661 12:20:53 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:06:59.661 12:20:53 -- common/autotest_common.sh@904 -- # local i=0 00:06:59.661 12:20:53 -- common/autotest_common.sh@905 -- # local force 00:06:59.661 12:20:53 -- common/autotest_common.sh@907 -- # '[' ext4 = ext4 ']' 00:06:59.661 12:20:53 -- common/autotest_common.sh@908 -- # force=-F 00:06:59.661 12:20:53 -- common/autotest_common.sh@913 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:06:59.661 mke2fs 1.46.5 (30-Dec-2021) 00:06:59.661 Discarding device blocks: 0/522240 done 00:06:59.920 Creating filesystem with 522240 1k blocks and 130560 inodes 00:06:59.920 Filesystem UUID: 93974daf-6711-45f4-8bce-14de0b019ba2 00:06:59.920 Superblock backups stored on blocks: 00:06:59.920 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:06:59.920 00:06:59.920 Allocating group tables: 0/64 done 00:06:59.920 Writing inode tables: 0/64 done 00:07:00.178 Creating journal (8192 blocks): done 00:07:01.141 Writing superblocks and filesystem accounting information: 0/64 1/64 done 00:07:01.141 00:07:01.141 12:20:54 -- common/autotest_common.sh@921 -- # return 0 00:07:01.141 12:20:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:01.708 12:20:55 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:01.708 12:20:55 -- target/filesystem.sh@25 -- # sync 00:07:01.708 12:20:55 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:01.708 12:20:55 -- target/filesystem.sh@27 -- # sync 00:07:01.708 12:20:55 -- target/filesystem.sh@29 -- # i=0 00:07:01.708 12:20:55 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:01.708 12:20:55 -- target/filesystem.sh@37 -- # kill -0 1171798 00:07:01.708 12:20:55 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:01.708 12:20:55 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:01.708 12:20:55 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:01.708 12:20:55 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:01.708 00:07:01.708 real 0m2.032s 00:07:01.708 user 0m0.016s 00:07:01.708 sys 0m0.060s 00:07:01.708 12:20:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:01.708 12:20:55 -- common/autotest_common.sh@10 -- # set +x 00:07:01.708 ************************************ 00:07:01.708 END TEST filesystem_in_capsule_ext4 00:07:01.708 ************************************ 00:07:01.708 12:20:55 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:01.708 12:20:55 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:01.708 12:20:55 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:01.708 12:20:55 -- common/autotest_common.sh@10 -- # set +x 00:07:01.708 ************************************ 00:07:01.708 START TEST filesystem_in_capsule_btrfs 00:07:01.708 ************************************ 00:07:01.708 12:20:55 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:01.708 12:20:55 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:01.708 12:20:55 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:01.708 12:20:55 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:01.708 12:20:55 -- common/autotest_common.sh@902 -- # local fstype=btrfs 00:07:01.708 12:20:55 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:01.708 12:20:55 -- common/autotest_common.sh@904 -- # local i=0 00:07:01.708 12:20:55 -- common/autotest_common.sh@905 -- # local force 00:07:01.708 12:20:55 -- common/autotest_common.sh@907 -- # '[' btrfs = ext4 ']' 00:07:01.708 12:20:55 -- common/autotest_common.sh@910 -- # force=-f 00:07:01.708 12:20:55 -- common/autotest_common.sh@913 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:01.967 btrfs-progs v6.6.2 00:07:01.967 See https://btrfs.readthedocs.io for more information. 00:07:01.967 00:07:01.967 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:01.967 NOTE: several default settings have changed in version 5.15, please make sure 00:07:01.967 this does not affect your deployments: 00:07:01.967 - DUP for metadata (-m dup) 00:07:01.967 - enabled no-holes (-O no-holes) 00:07:01.967 - enabled free-space-tree (-R free-space-tree) 00:07:01.967 00:07:01.967 Label: (null) 00:07:01.967 UUID: 89683abd-9763-4e42-b8fb-032eb0be47a5 00:07:01.967 Node size: 16384 00:07:01.967 Sector size: 4096 00:07:01.967 Filesystem size: 510.00MiB 00:07:01.967 Block group profiles: 00:07:01.967 Data: single 8.00MiB 00:07:01.967 Metadata: DUP 32.00MiB 00:07:01.967 System: DUP 8.00MiB 00:07:01.967 SSD detected: yes 00:07:01.967 Zoned device: no 00:07:01.967 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:01.967 Runtime features: free-space-tree 00:07:01.967 Checksum: crc32c 00:07:01.967 Number of devices: 1 00:07:01.967 Devices: 00:07:01.967 ID SIZE PATH 00:07:01.967 1 510.00MiB /dev/nvme0n1p1 00:07:01.967 00:07:01.967 12:20:55 -- common/autotest_common.sh@921 -- # return 0 00:07:01.967 12:20:55 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:02.533 12:20:56 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:02.533 12:20:56 -- target/filesystem.sh@25 -- # sync 00:07:02.533 12:20:56 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:02.533 12:20:56 -- target/filesystem.sh@27 -- # sync 00:07:02.533 12:20:56 -- target/filesystem.sh@29 -- # i=0 00:07:02.533 12:20:56 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:02.533 12:20:56 -- target/filesystem.sh@37 -- # kill -0 1171798 00:07:02.534 12:20:56 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:02.534 12:20:56 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:02.534 12:20:56 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:02.534 12:20:56 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:02.534 00:07:02.534 real 0m0.937s 00:07:02.534 user 0m0.029s 00:07:02.534 sys 0m0.106s 00:07:02.534 12:20:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:02.534 12:20:56 -- common/autotest_common.sh@10 -- # set +x 00:07:02.534 ************************************ 00:07:02.534 END TEST filesystem_in_capsule_btrfs 00:07:02.534 ************************************ 00:07:02.534 12:20:56 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:02.534 12:20:56 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:07:02.534 12:20:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:02.534 12:20:56 -- common/autotest_common.sh@10 -- # set +x 00:07:02.534 ************************************ 00:07:02.534 START TEST filesystem_in_capsule_xfs 00:07:02.534 ************************************ 00:07:02.534 12:20:56 -- common/autotest_common.sh@1104 -- # nvmf_filesystem_create xfs nvme0n1 00:07:02.534 12:20:56 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:02.534 12:20:56 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:02.534 12:20:56 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:02.534 12:20:56 -- common/autotest_common.sh@902 -- # local fstype=xfs 00:07:02.534 12:20:56 -- common/autotest_common.sh@903 -- # local dev_name=/dev/nvme0n1p1 00:07:02.534 12:20:56 -- common/autotest_common.sh@904 -- # local i=0 00:07:02.534 12:20:56 -- common/autotest_common.sh@905 -- # local force 00:07:02.534 12:20:56 -- common/autotest_common.sh@907 -- # '[' xfs = ext4 ']' 00:07:02.534 12:20:56 -- common/autotest_common.sh@910 -- # force=-f 00:07:02.534 12:20:56 -- common/autotest_common.sh@913 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:02.792 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:02.792 = sectsz=512 attr=2, projid32bit=1 00:07:02.792 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:02.792 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:02.792 data = bsize=4096 blocks=130560, imaxpct=25 00:07:02.792 = sunit=0 swidth=0 blks 00:07:02.792 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:02.792 log =internal log bsize=4096 blocks=16384, version=2 00:07:02.792 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:02.792 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:03.727 Discarding blocks...Done. 00:07:03.727 12:20:57 -- common/autotest_common.sh@921 -- # return 0 00:07:03.727 12:20:57 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:06.266 12:20:59 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:06.266 12:20:59 -- target/filesystem.sh@25 -- # sync 00:07:06.266 12:20:59 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:06.266 12:20:59 -- target/filesystem.sh@27 -- # sync 00:07:06.266 12:20:59 -- target/filesystem.sh@29 -- # i=0 00:07:06.266 12:20:59 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:06.266 12:20:59 -- target/filesystem.sh@37 -- # kill -0 1171798 00:07:06.266 12:20:59 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:06.266 12:20:59 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:06.266 12:20:59 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:06.266 12:20:59 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:06.266 00:07:06.266 real 0m3.559s 00:07:06.266 user 0m0.007s 00:07:06.266 sys 0m0.069s 00:07:06.266 12:20:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:06.266 12:20:59 -- common/autotest_common.sh@10 -- # set +x 00:07:06.266 ************************************ 00:07:06.266 END TEST filesystem_in_capsule_xfs 00:07:06.266 ************************************ 00:07:06.266 12:20:59 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:06.524 12:21:00 -- target/filesystem.sh@93 -- # sync 00:07:06.524 12:21:00 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:06.524 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:06.524 12:21:00 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:06.524 12:21:00 -- common/autotest_common.sh@1198 -- # local i=0 00:07:06.524 12:21:00 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:07:06.524 12:21:00 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:06.524 12:21:00 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:07:06.524 12:21:00 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:06.524 12:21:00 -- common/autotest_common.sh@1210 -- # return 0 00:07:06.524 12:21:00 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:06.524 12:21:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:06.524 12:21:00 -- common/autotest_common.sh@10 -- # set +x 00:07:06.524 12:21:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:06.524 12:21:00 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:06.524 12:21:00 -- target/filesystem.sh@101 -- # killprocess 1171798 00:07:06.524 12:21:00 -- common/autotest_common.sh@926 -- # '[' -z 1171798 ']' 00:07:06.524 12:21:00 -- common/autotest_common.sh@930 -- # kill -0 1171798 00:07:06.524 12:21:00 -- common/autotest_common.sh@931 -- # uname 00:07:06.524 12:21:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:06.524 12:21:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1171798 00:07:06.524 12:21:00 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:06.524 12:21:00 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:06.524 12:21:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1171798' 00:07:06.524 killing process with pid 1171798 00:07:06.524 12:21:00 -- common/autotest_common.sh@945 -- # kill 1171798 00:07:06.524 12:21:00 -- common/autotest_common.sh@950 -- # wait 1171798 00:07:07.090 12:21:00 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:07.090 00:07:07.090 real 0m13.054s 00:07:07.090 user 0m50.162s 00:07:07.090 sys 0m1.916s 00:07:07.090 12:21:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:07.090 12:21:00 -- common/autotest_common.sh@10 -- # set +x 00:07:07.090 ************************************ 00:07:07.090 END TEST nvmf_filesystem_in_capsule 00:07:07.090 ************************************ 00:07:07.090 12:21:00 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:07.090 12:21:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:07.090 12:21:00 -- nvmf/common.sh@116 -- # sync 00:07:07.090 12:21:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:07.090 12:21:00 -- nvmf/common.sh@119 -- # set +e 00:07:07.090 12:21:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:07.090 12:21:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:07.090 rmmod nvme_tcp 00:07:07.090 rmmod nvme_fabrics 00:07:07.090 rmmod nvme_keyring 00:07:07.090 12:21:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:07.090 12:21:00 -- nvmf/common.sh@123 -- # set -e 00:07:07.090 12:21:00 -- nvmf/common.sh@124 -- # return 0 00:07:07.090 12:21:00 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:07.090 12:21:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:07.090 12:21:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:07.090 12:21:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:07.090 12:21:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:07.090 12:21:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:07.090 12:21:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:07.090 12:21:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:07.090 12:21:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:09.624 12:21:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:09.624 00:07:09.624 real 0m30.014s 00:07:09.624 user 1m39.109s 00:07:09.624 sys 0m5.294s 00:07:09.624 12:21:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:09.624 12:21:02 -- common/autotest_common.sh@10 -- # set +x 00:07:09.624 ************************************ 00:07:09.624 END TEST nvmf_filesystem 00:07:09.624 ************************************ 00:07:09.624 12:21:02 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:09.624 12:21:02 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:09.624 12:21:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:09.624 12:21:02 -- common/autotest_common.sh@10 -- # set +x 00:07:09.624 ************************************ 00:07:09.624 START TEST nvmf_discovery 00:07:09.624 ************************************ 00:07:09.624 12:21:02 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:09.624 * Looking for test storage... 00:07:09.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:09.624 12:21:03 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:09.624 12:21:03 -- nvmf/common.sh@7 -- # uname -s 00:07:09.624 12:21:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:09.624 12:21:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:09.625 12:21:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:09.625 12:21:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:09.625 12:21:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:09.625 12:21:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:09.625 12:21:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:09.625 12:21:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:09.625 12:21:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:09.625 12:21:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:09.625 12:21:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:09.625 12:21:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:09.625 12:21:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:09.625 12:21:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:09.625 12:21:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:09.625 12:21:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:09.625 12:21:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:09.625 12:21:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:09.625 12:21:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:09.625 12:21:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.625 12:21:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.625 12:21:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.625 12:21:03 -- paths/export.sh@5 -- # export PATH 00:07:09.625 12:21:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:09.625 12:21:03 -- nvmf/common.sh@46 -- # : 0 00:07:09.625 12:21:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:09.625 12:21:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:09.625 12:21:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:09.625 12:21:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:09.625 12:21:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:09.625 12:21:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:09.625 12:21:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:09.625 12:21:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:09.625 12:21:03 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:09.625 12:21:03 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:09.625 12:21:03 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:09.625 12:21:03 -- target/discovery.sh@15 -- # hash nvme 00:07:09.625 12:21:03 -- target/discovery.sh@20 -- # nvmftestinit 00:07:09.625 12:21:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:09.625 12:21:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:09.625 12:21:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:09.625 12:21:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:09.625 12:21:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:09.625 12:21:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:09.625 12:21:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:09.625 12:21:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:09.625 12:21:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:09.625 12:21:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:09.625 12:21:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:09.625 12:21:03 -- common/autotest_common.sh@10 -- # set +x 00:07:11.574 12:21:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:11.574 12:21:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:11.574 12:21:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:11.574 12:21:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:11.574 12:21:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:11.574 12:21:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:11.574 12:21:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:11.574 12:21:05 -- nvmf/common.sh@294 -- # net_devs=() 00:07:11.574 12:21:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:11.574 12:21:05 -- nvmf/common.sh@295 -- # e810=() 00:07:11.574 12:21:05 -- nvmf/common.sh@295 -- # local -ga e810 00:07:11.574 12:21:05 -- nvmf/common.sh@296 -- # x722=() 00:07:11.574 12:21:05 -- nvmf/common.sh@296 -- # local -ga x722 00:07:11.574 12:21:05 -- nvmf/common.sh@297 -- # mlx=() 00:07:11.574 12:21:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:11.574 12:21:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:11.574 12:21:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:11.574 12:21:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:11.574 12:21:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:11.574 12:21:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:11.574 12:21:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:11.574 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:11.574 12:21:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:11.574 12:21:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:11.574 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:11.574 12:21:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:11.574 12:21:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:11.574 12:21:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:11.574 12:21:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:11.574 12:21:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:11.574 12:21:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:11.574 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:11.574 12:21:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:11.574 12:21:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:11.574 12:21:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:11.574 12:21:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:11.574 12:21:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:11.574 12:21:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:11.574 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:11.574 12:21:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:11.574 12:21:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:11.574 12:21:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:11.574 12:21:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:11.574 12:21:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:11.574 12:21:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:11.574 12:21:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:11.574 12:21:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:11.574 12:21:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:11.574 12:21:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:11.574 12:21:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:11.574 12:21:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:11.574 12:21:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:11.574 12:21:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:11.574 12:21:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:11.574 12:21:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:11.574 12:21:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:11.574 12:21:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:11.574 12:21:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:11.574 12:21:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:11.574 12:21:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:11.574 12:21:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:11.574 12:21:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:11.574 12:21:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:11.574 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:11.574 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:07:11.574 00:07:11.574 --- 10.0.0.2 ping statistics --- 00:07:11.574 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:11.574 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:07:11.574 12:21:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:11.574 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:11.574 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:07:11.574 00:07:11.574 --- 10.0.0.1 ping statistics --- 00:07:11.574 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:11.574 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:07:11.574 12:21:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:11.574 12:21:05 -- nvmf/common.sh@410 -- # return 0 00:07:11.574 12:21:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:11.574 12:21:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:11.574 12:21:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:11.574 12:21:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:11.574 12:21:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:11.574 12:21:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:11.574 12:21:05 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:11.574 12:21:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:11.574 12:21:05 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:11.574 12:21:05 -- common/autotest_common.sh@10 -- # set +x 00:07:11.574 12:21:05 -- nvmf/common.sh@469 -- # nvmfpid=1175591 00:07:11.574 12:21:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:11.574 12:21:05 -- nvmf/common.sh@470 -- # waitforlisten 1175591 00:07:11.574 12:21:05 -- common/autotest_common.sh@819 -- # '[' -z 1175591 ']' 00:07:11.574 12:21:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:11.574 12:21:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:11.574 12:21:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:11.574 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:11.574 12:21:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:11.574 12:21:05 -- common/autotest_common.sh@10 -- # set +x 00:07:11.574 [2024-07-12 12:21:05.248269] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:07:11.574 [2024-07-12 12:21:05.248344] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:11.574 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.574 [2024-07-12 12:21:05.315122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:11.574 [2024-07-12 12:21:05.426235] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:11.574 [2024-07-12 12:21:05.426384] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:11.574 [2024-07-12 12:21:05.426402] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:11.574 [2024-07-12 12:21:05.426415] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:11.574 [2024-07-12 12:21:05.426473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:11.574 [2024-07-12 12:21:05.426490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:11.574 [2024-07-12 12:21:05.426614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:11.574 [2024-07-12 12:21:05.426618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.509 12:21:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:12.509 12:21:06 -- common/autotest_common.sh@852 -- # return 0 00:07:12.509 12:21:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:12.509 12:21:06 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:12.509 12:21:06 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 [2024-07-12 12:21:06.227413] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@26 -- # seq 1 4 00:07:12.509 12:21:06 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.509 12:21:06 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 Null1 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 [2024-07-12 12:21:06.267710] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.509 12:21:06 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 Null2 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.509 12:21:06 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 Null3 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:12.509 12:21:06 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 Null4 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:12.509 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.509 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.509 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.509 12:21:06 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:12.768 00:07:12.768 Discovery Log Number of Records 6, Generation counter 6 00:07:12.768 =====Discovery Log Entry 0====== 00:07:12.768 trtype: tcp 00:07:12.768 adrfam: ipv4 00:07:12.768 subtype: current discovery subsystem 00:07:12.768 treq: not required 00:07:12.768 portid: 0 00:07:12.768 trsvcid: 4420 00:07:12.768 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:12.768 traddr: 10.0.0.2 00:07:12.768 eflags: explicit discovery connections, duplicate discovery information 00:07:12.768 sectype: none 00:07:12.768 =====Discovery Log Entry 1====== 00:07:12.768 trtype: tcp 00:07:12.768 adrfam: ipv4 00:07:12.768 subtype: nvme subsystem 00:07:12.768 treq: not required 00:07:12.768 portid: 0 00:07:12.768 trsvcid: 4420 00:07:12.768 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:12.768 traddr: 10.0.0.2 00:07:12.768 eflags: none 00:07:12.768 sectype: none 00:07:12.768 =====Discovery Log Entry 2====== 00:07:12.768 trtype: tcp 00:07:12.768 adrfam: ipv4 00:07:12.768 subtype: nvme subsystem 00:07:12.768 treq: not required 00:07:12.768 portid: 0 00:07:12.768 trsvcid: 4420 00:07:12.768 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:12.768 traddr: 10.0.0.2 00:07:12.768 eflags: none 00:07:12.768 sectype: none 00:07:12.768 =====Discovery Log Entry 3====== 00:07:12.768 trtype: tcp 00:07:12.768 adrfam: ipv4 00:07:12.768 subtype: nvme subsystem 00:07:12.768 treq: not required 00:07:12.768 portid: 0 00:07:12.768 trsvcid: 4420 00:07:12.768 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:12.768 traddr: 10.0.0.2 00:07:12.768 eflags: none 00:07:12.768 sectype: none 00:07:12.768 =====Discovery Log Entry 4====== 00:07:12.768 trtype: tcp 00:07:12.768 adrfam: ipv4 00:07:12.768 subtype: nvme subsystem 00:07:12.768 treq: not required 00:07:12.768 portid: 0 00:07:12.768 trsvcid: 4420 00:07:12.768 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:12.768 traddr: 10.0.0.2 00:07:12.768 eflags: none 00:07:12.768 sectype: none 00:07:12.768 =====Discovery Log Entry 5====== 00:07:12.768 trtype: tcp 00:07:12.768 adrfam: ipv4 00:07:12.768 subtype: discovery subsystem referral 00:07:12.768 treq: not required 00:07:12.768 portid: 0 00:07:12.768 trsvcid: 4430 00:07:12.768 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:12.768 traddr: 10.0.0.2 00:07:12.768 eflags: none 00:07:12.768 sectype: none 00:07:12.768 12:21:06 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:12.768 Perform nvmf subsystem discovery via RPC 00:07:12.768 12:21:06 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:12.768 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.768 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.768 [2024-07-12 12:21:06.508335] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:12.768 [ 00:07:12.768 { 00:07:12.768 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:12.768 "subtype": "Discovery", 00:07:12.768 "listen_addresses": [ 00:07:12.768 { 00:07:12.768 "transport": "TCP", 00:07:12.768 "trtype": "TCP", 00:07:12.768 "adrfam": "IPv4", 00:07:12.768 "traddr": "10.0.0.2", 00:07:12.768 "trsvcid": "4420" 00:07:12.768 } 00:07:12.768 ], 00:07:12.768 "allow_any_host": true, 00:07:12.768 "hosts": [] 00:07:12.768 }, 00:07:12.768 { 00:07:12.768 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:12.768 "subtype": "NVMe", 00:07:12.768 "listen_addresses": [ 00:07:12.768 { 00:07:12.768 "transport": "TCP", 00:07:12.768 "trtype": "TCP", 00:07:12.768 "adrfam": "IPv4", 00:07:12.768 "traddr": "10.0.0.2", 00:07:12.768 "trsvcid": "4420" 00:07:12.768 } 00:07:12.768 ], 00:07:12.768 "allow_any_host": true, 00:07:12.768 "hosts": [], 00:07:12.768 "serial_number": "SPDK00000000000001", 00:07:12.768 "model_number": "SPDK bdev Controller", 00:07:12.768 "max_namespaces": 32, 00:07:12.768 "min_cntlid": 1, 00:07:12.768 "max_cntlid": 65519, 00:07:12.768 "namespaces": [ 00:07:12.768 { 00:07:12.768 "nsid": 1, 00:07:12.768 "bdev_name": "Null1", 00:07:12.768 "name": "Null1", 00:07:12.768 "nguid": "FE1EB687D8B04877BA16653342EA811D", 00:07:12.768 "uuid": "fe1eb687-d8b0-4877-ba16-653342ea811d" 00:07:12.768 } 00:07:12.768 ] 00:07:12.768 }, 00:07:12.768 { 00:07:12.768 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:12.768 "subtype": "NVMe", 00:07:12.768 "listen_addresses": [ 00:07:12.768 { 00:07:12.768 "transport": "TCP", 00:07:12.768 "trtype": "TCP", 00:07:12.768 "adrfam": "IPv4", 00:07:12.768 "traddr": "10.0.0.2", 00:07:12.769 "trsvcid": "4420" 00:07:12.769 } 00:07:12.769 ], 00:07:12.769 "allow_any_host": true, 00:07:12.769 "hosts": [], 00:07:12.769 "serial_number": "SPDK00000000000002", 00:07:12.769 "model_number": "SPDK bdev Controller", 00:07:12.769 "max_namespaces": 32, 00:07:12.769 "min_cntlid": 1, 00:07:12.769 "max_cntlid": 65519, 00:07:12.769 "namespaces": [ 00:07:12.769 { 00:07:12.769 "nsid": 1, 00:07:12.769 "bdev_name": "Null2", 00:07:12.769 "name": "Null2", 00:07:12.769 "nguid": "3E2D6F392FD541D0BD1A30A8EF0F44D0", 00:07:12.769 "uuid": "3e2d6f39-2fd5-41d0-bd1a-30a8ef0f44d0" 00:07:12.769 } 00:07:12.769 ] 00:07:12.769 }, 00:07:12.769 { 00:07:12.769 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:12.769 "subtype": "NVMe", 00:07:12.769 "listen_addresses": [ 00:07:12.769 { 00:07:12.769 "transport": "TCP", 00:07:12.769 "trtype": "TCP", 00:07:12.769 "adrfam": "IPv4", 00:07:12.769 "traddr": "10.0.0.2", 00:07:12.769 "trsvcid": "4420" 00:07:12.769 } 00:07:12.769 ], 00:07:12.769 "allow_any_host": true, 00:07:12.769 "hosts": [], 00:07:12.769 "serial_number": "SPDK00000000000003", 00:07:12.769 "model_number": "SPDK bdev Controller", 00:07:12.769 "max_namespaces": 32, 00:07:12.769 "min_cntlid": 1, 00:07:12.769 "max_cntlid": 65519, 00:07:12.769 "namespaces": [ 00:07:12.769 { 00:07:12.769 "nsid": 1, 00:07:12.769 "bdev_name": "Null3", 00:07:12.769 "name": "Null3", 00:07:12.769 "nguid": "D654BDF122C94F4C8F7FC59DBA00F78A", 00:07:12.769 "uuid": "d654bdf1-22c9-4f4c-8f7f-c59dba00f78a" 00:07:12.769 } 00:07:12.769 ] 00:07:12.769 }, 00:07:12.769 { 00:07:12.769 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:12.769 "subtype": "NVMe", 00:07:12.769 "listen_addresses": [ 00:07:12.769 { 00:07:12.769 "transport": "TCP", 00:07:12.769 "trtype": "TCP", 00:07:12.769 "adrfam": "IPv4", 00:07:12.769 "traddr": "10.0.0.2", 00:07:12.769 "trsvcid": "4420" 00:07:12.769 } 00:07:12.769 ], 00:07:12.769 "allow_any_host": true, 00:07:12.769 "hosts": [], 00:07:12.769 "serial_number": "SPDK00000000000004", 00:07:12.769 "model_number": "SPDK bdev Controller", 00:07:12.769 "max_namespaces": 32, 00:07:12.769 "min_cntlid": 1, 00:07:12.769 "max_cntlid": 65519, 00:07:12.769 "namespaces": [ 00:07:12.769 { 00:07:12.769 "nsid": 1, 00:07:12.769 "bdev_name": "Null4", 00:07:12.769 "name": "Null4", 00:07:12.769 "nguid": "E992E1C654784FE4BC1C418C4492B973", 00:07:12.769 "uuid": "e992e1c6-5478-4fe4-bc1c-418c4492b973" 00:07:12.769 } 00:07:12.769 ] 00:07:12.769 } 00:07:12.769 ] 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@42 -- # seq 1 4 00:07:12.769 12:21:06 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:12.769 12:21:06 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:12.769 12:21:06 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:12.769 12:21:06 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:12.769 12:21:06 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:12.769 12:21:06 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:12.769 12:21:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:12.769 12:21:06 -- common/autotest_common.sh@10 -- # set +x 00:07:12.769 12:21:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:12.769 12:21:06 -- target/discovery.sh@49 -- # check_bdevs= 00:07:12.769 12:21:06 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:12.769 12:21:06 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:12.769 12:21:06 -- target/discovery.sh@57 -- # nvmftestfini 00:07:12.769 12:21:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:12.769 12:21:06 -- nvmf/common.sh@116 -- # sync 00:07:12.769 12:21:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:12.769 12:21:06 -- nvmf/common.sh@119 -- # set +e 00:07:12.769 12:21:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:12.769 12:21:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:12.769 rmmod nvme_tcp 00:07:12.769 rmmod nvme_fabrics 00:07:12.769 rmmod nvme_keyring 00:07:13.028 12:21:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:13.028 12:21:06 -- nvmf/common.sh@123 -- # set -e 00:07:13.028 12:21:06 -- nvmf/common.sh@124 -- # return 0 00:07:13.028 12:21:06 -- nvmf/common.sh@477 -- # '[' -n 1175591 ']' 00:07:13.028 12:21:06 -- nvmf/common.sh@478 -- # killprocess 1175591 00:07:13.028 12:21:06 -- common/autotest_common.sh@926 -- # '[' -z 1175591 ']' 00:07:13.028 12:21:06 -- common/autotest_common.sh@930 -- # kill -0 1175591 00:07:13.028 12:21:06 -- common/autotest_common.sh@931 -- # uname 00:07:13.028 12:21:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:13.028 12:21:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1175591 00:07:13.028 12:21:06 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:13.028 12:21:06 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:13.028 12:21:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1175591' 00:07:13.028 killing process with pid 1175591 00:07:13.028 12:21:06 -- common/autotest_common.sh@945 -- # kill 1175591 00:07:13.028 [2024-07-12 12:21:06.725792] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:13.028 12:21:06 -- common/autotest_common.sh@950 -- # wait 1175591 00:07:13.287 12:21:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:13.287 12:21:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:13.287 12:21:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:13.287 12:21:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:13.287 12:21:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:13.287 12:21:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:13.287 12:21:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:13.287 12:21:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:15.190 12:21:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:15.190 00:07:15.190 real 0m6.045s 00:07:15.190 user 0m7.093s 00:07:15.190 sys 0m1.853s 00:07:15.191 12:21:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:15.191 12:21:09 -- common/autotest_common.sh@10 -- # set +x 00:07:15.191 ************************************ 00:07:15.191 END TEST nvmf_discovery 00:07:15.191 ************************************ 00:07:15.191 12:21:09 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:15.191 12:21:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:15.191 12:21:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:15.191 12:21:09 -- common/autotest_common.sh@10 -- # set +x 00:07:15.191 ************************************ 00:07:15.191 START TEST nvmf_referrals 00:07:15.191 ************************************ 00:07:15.191 12:21:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:15.191 * Looking for test storage... 00:07:15.191 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:15.449 12:21:09 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:15.449 12:21:09 -- nvmf/common.sh@7 -- # uname -s 00:07:15.449 12:21:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:15.449 12:21:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:15.449 12:21:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:15.449 12:21:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:15.449 12:21:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:15.449 12:21:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:15.449 12:21:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:15.449 12:21:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:15.449 12:21:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:15.449 12:21:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:15.449 12:21:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:15.449 12:21:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:15.449 12:21:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:15.449 12:21:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:15.449 12:21:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:15.449 12:21:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:15.449 12:21:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:15.449 12:21:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:15.449 12:21:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:15.449 12:21:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.449 12:21:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.449 12:21:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.449 12:21:09 -- paths/export.sh@5 -- # export PATH 00:07:15.449 12:21:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:15.449 12:21:09 -- nvmf/common.sh@46 -- # : 0 00:07:15.449 12:21:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:15.449 12:21:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:15.449 12:21:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:15.449 12:21:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:15.450 12:21:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:15.450 12:21:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:15.450 12:21:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:15.450 12:21:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:15.450 12:21:09 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:15.450 12:21:09 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:15.450 12:21:09 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:15.450 12:21:09 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:15.450 12:21:09 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:15.450 12:21:09 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:15.450 12:21:09 -- target/referrals.sh@37 -- # nvmftestinit 00:07:15.450 12:21:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:15.450 12:21:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:15.450 12:21:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:15.450 12:21:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:15.450 12:21:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:15.450 12:21:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:15.450 12:21:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:15.450 12:21:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:15.450 12:21:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:15.450 12:21:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:15.450 12:21:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:15.450 12:21:09 -- common/autotest_common.sh@10 -- # set +x 00:07:17.353 12:21:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:17.353 12:21:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:17.353 12:21:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:17.353 12:21:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:17.353 12:21:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:17.353 12:21:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:17.353 12:21:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:17.353 12:21:11 -- nvmf/common.sh@294 -- # net_devs=() 00:07:17.353 12:21:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:17.353 12:21:11 -- nvmf/common.sh@295 -- # e810=() 00:07:17.353 12:21:11 -- nvmf/common.sh@295 -- # local -ga e810 00:07:17.353 12:21:11 -- nvmf/common.sh@296 -- # x722=() 00:07:17.353 12:21:11 -- nvmf/common.sh@296 -- # local -ga x722 00:07:17.353 12:21:11 -- nvmf/common.sh@297 -- # mlx=() 00:07:17.353 12:21:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:17.353 12:21:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:17.353 12:21:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:17.353 12:21:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:17.353 12:21:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:17.354 12:21:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:17.354 12:21:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:17.354 12:21:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:17.354 12:21:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:17.354 12:21:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:17.354 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:17.354 12:21:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:17.354 12:21:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:17.354 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:17.354 12:21:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:17.354 12:21:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:17.354 12:21:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:17.354 12:21:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:17.354 12:21:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:17.354 12:21:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:17.354 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:17.354 12:21:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:17.354 12:21:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:17.354 12:21:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:17.354 12:21:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:17.354 12:21:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:17.354 12:21:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:17.354 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:17.354 12:21:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:17.354 12:21:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:17.354 12:21:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:17.354 12:21:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:17.354 12:21:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:17.354 12:21:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:17.354 12:21:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:17.354 12:21:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:17.354 12:21:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:17.354 12:21:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:17.354 12:21:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:17.354 12:21:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:17.354 12:21:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:17.354 12:21:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:17.354 12:21:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:17.354 12:21:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:17.354 12:21:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:17.354 12:21:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:17.354 12:21:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:17.354 12:21:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:17.354 12:21:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:17.354 12:21:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:17.354 12:21:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:17.354 12:21:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:17.354 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:17.354 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:07:17.354 00:07:17.354 --- 10.0.0.2 ping statistics --- 00:07:17.354 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:17.354 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:07:17.354 12:21:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:17.354 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:17.354 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:07:17.354 00:07:17.354 --- 10.0.0.1 ping statistics --- 00:07:17.354 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:17.354 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:07:17.354 12:21:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:17.354 12:21:11 -- nvmf/common.sh@410 -- # return 0 00:07:17.354 12:21:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:17.354 12:21:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:17.354 12:21:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:17.354 12:21:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:17.354 12:21:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:17.354 12:21:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:17.354 12:21:11 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:17.354 12:21:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:17.354 12:21:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:17.354 12:21:11 -- common/autotest_common.sh@10 -- # set +x 00:07:17.354 12:21:11 -- nvmf/common.sh@469 -- # nvmfpid=1178215 00:07:17.354 12:21:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:17.354 12:21:11 -- nvmf/common.sh@470 -- # waitforlisten 1178215 00:07:17.354 12:21:11 -- common/autotest_common.sh@819 -- # '[' -z 1178215 ']' 00:07:17.354 12:21:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.354 12:21:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:17.354 12:21:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.354 12:21:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:17.354 12:21:11 -- common/autotest_common.sh@10 -- # set +x 00:07:17.613 [2024-07-12 12:21:11.301261] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:07:17.613 [2024-07-12 12:21:11.301345] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:17.613 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.613 [2024-07-12 12:21:11.371567] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.613 [2024-07-12 12:21:11.492847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:17.613 [2024-07-12 12:21:11.493058] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:17.613 [2024-07-12 12:21:11.493088] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:17.613 [2024-07-12 12:21:11.493104] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:17.613 [2024-07-12 12:21:11.493197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.613 [2024-07-12 12:21:11.493274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.613 [2024-07-12 12:21:11.493337] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.613 [2024-07-12 12:21:11.493341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.550 12:21:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:18.550 12:21:12 -- common/autotest_common.sh@852 -- # return 0 00:07:18.550 12:21:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:18.550 12:21:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 12:21:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:18.550 12:21:12 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 [2024-07-12 12:21:12.266305] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 [2024-07-12 12:21:12.278527] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- target/referrals.sh@48 -- # jq length 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:18.550 12:21:12 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:18.550 12:21:12 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:18.550 12:21:12 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:18.550 12:21:12 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:18.550 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.550 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.550 12:21:12 -- target/referrals.sh@21 -- # sort 00:07:18.550 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:18.550 12:21:12 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:18.550 12:21:12 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:18.550 12:21:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:18.550 12:21:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:18.550 12:21:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:18.550 12:21:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:18.550 12:21:12 -- target/referrals.sh@26 -- # sort 00:07:18.809 12:21:12 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:18.809 12:21:12 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:18.809 12:21:12 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:18.809 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.809 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.809 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.809 12:21:12 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:18.809 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.809 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.809 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.809 12:21:12 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:18.809 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.809 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.809 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.809 12:21:12 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:18.809 12:21:12 -- target/referrals.sh@56 -- # jq length 00:07:18.809 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:18.809 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:18.809 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:18.810 12:21:12 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:18.810 12:21:12 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:18.810 12:21:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:18.810 12:21:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:18.810 12:21:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:18.810 12:21:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:18.810 12:21:12 -- target/referrals.sh@26 -- # sort 00:07:19.068 12:21:12 -- target/referrals.sh@26 -- # echo 00:07:19.068 12:21:12 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:19.068 12:21:12 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:19.068 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.068 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:19.068 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.068 12:21:12 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:19.068 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.068 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:19.068 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.068 12:21:12 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:19.068 12:21:12 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:19.068 12:21:12 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.068 12:21:12 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.068 12:21:12 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:19.068 12:21:12 -- common/autotest_common.sh@10 -- # set +x 00:07:19.068 12:21:12 -- target/referrals.sh@21 -- # sort 00:07:19.068 12:21:12 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.068 12:21:12 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:19.068 12:21:12 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:19.068 12:21:12 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:19.068 12:21:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:19.068 12:21:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:19.068 12:21:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.068 12:21:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:19.068 12:21:12 -- target/referrals.sh@26 -- # sort 00:07:19.068 12:21:12 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:19.068 12:21:12 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:19.068 12:21:12 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:19.068 12:21:12 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:19.068 12:21:12 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:19.068 12:21:12 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.068 12:21:12 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:19.324 12:21:13 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:19.324 12:21:13 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:19.324 12:21:13 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:19.324 12:21:13 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:19.324 12:21:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.324 12:21:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:19.324 12:21:13 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:19.324 12:21:13 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:19.324 12:21:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.324 12:21:13 -- common/autotest_common.sh@10 -- # set +x 00:07:19.324 12:21:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.324 12:21:13 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:19.324 12:21:13 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:19.324 12:21:13 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.324 12:21:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.324 12:21:13 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:19.324 12:21:13 -- common/autotest_common.sh@10 -- # set +x 00:07:19.324 12:21:13 -- target/referrals.sh@21 -- # sort 00:07:19.324 12:21:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.324 12:21:13 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:19.324 12:21:13 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:19.324 12:21:13 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:19.324 12:21:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:19.324 12:21:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:19.324 12:21:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.324 12:21:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:19.324 12:21:13 -- target/referrals.sh@26 -- # sort 00:07:19.581 12:21:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:19.581 12:21:13 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:19.581 12:21:13 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:19.581 12:21:13 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:19.581 12:21:13 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:19.581 12:21:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.581 12:21:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:19.581 12:21:13 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:19.581 12:21:13 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:19.581 12:21:13 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:19.581 12:21:13 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:19.581 12:21:13 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.581 12:21:13 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:19.840 12:21:13 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:19.840 12:21:13 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:19.840 12:21:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.840 12:21:13 -- common/autotest_common.sh@10 -- # set +x 00:07:19.840 12:21:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.840 12:21:13 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:19.840 12:21:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:19.840 12:21:13 -- target/referrals.sh@82 -- # jq length 00:07:19.840 12:21:13 -- common/autotest_common.sh@10 -- # set +x 00:07:19.840 12:21:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:19.840 12:21:13 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:19.840 12:21:13 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:19.840 12:21:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:19.840 12:21:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:19.840 12:21:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:19.840 12:21:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:19.840 12:21:13 -- target/referrals.sh@26 -- # sort 00:07:19.840 12:21:13 -- target/referrals.sh@26 -- # echo 00:07:19.840 12:21:13 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:19.840 12:21:13 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:19.840 12:21:13 -- target/referrals.sh@86 -- # nvmftestfini 00:07:19.840 12:21:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:19.840 12:21:13 -- nvmf/common.sh@116 -- # sync 00:07:19.840 12:21:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:19.840 12:21:13 -- nvmf/common.sh@119 -- # set +e 00:07:19.840 12:21:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:19.840 12:21:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:19.840 rmmod nvme_tcp 00:07:19.840 rmmod nvme_fabrics 00:07:19.840 rmmod nvme_keyring 00:07:19.840 12:21:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:19.840 12:21:13 -- nvmf/common.sh@123 -- # set -e 00:07:19.840 12:21:13 -- nvmf/common.sh@124 -- # return 0 00:07:19.840 12:21:13 -- nvmf/common.sh@477 -- # '[' -n 1178215 ']' 00:07:19.840 12:21:13 -- nvmf/common.sh@478 -- # killprocess 1178215 00:07:19.840 12:21:13 -- common/autotest_common.sh@926 -- # '[' -z 1178215 ']' 00:07:19.840 12:21:13 -- common/autotest_common.sh@930 -- # kill -0 1178215 00:07:19.840 12:21:13 -- common/autotest_common.sh@931 -- # uname 00:07:20.099 12:21:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:07:20.099 12:21:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1178215 00:07:20.099 12:21:13 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:07:20.099 12:21:13 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:07:20.099 12:21:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1178215' 00:07:20.099 killing process with pid 1178215 00:07:20.099 12:21:13 -- common/autotest_common.sh@945 -- # kill 1178215 00:07:20.099 12:21:13 -- common/autotest_common.sh@950 -- # wait 1178215 00:07:20.359 12:21:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:20.359 12:21:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:20.359 12:21:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:20.359 12:21:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:20.359 12:21:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:20.359 12:21:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:20.359 12:21:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:20.359 12:21:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:22.262 12:21:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:22.262 00:07:22.262 real 0m7.052s 00:07:22.262 user 0m11.580s 00:07:22.262 sys 0m2.147s 00:07:22.262 12:21:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:07:22.262 12:21:16 -- common/autotest_common.sh@10 -- # set +x 00:07:22.262 ************************************ 00:07:22.262 END TEST nvmf_referrals 00:07:22.262 ************************************ 00:07:22.262 12:21:16 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:22.262 12:21:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:07:22.262 12:21:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:07:22.262 12:21:16 -- common/autotest_common.sh@10 -- # set +x 00:07:22.262 ************************************ 00:07:22.262 START TEST nvmf_connect_disconnect 00:07:22.262 ************************************ 00:07:22.262 12:21:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:22.520 * Looking for test storage... 00:07:22.520 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:22.520 12:21:16 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:22.520 12:21:16 -- nvmf/common.sh@7 -- # uname -s 00:07:22.520 12:21:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:22.520 12:21:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:22.520 12:21:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:22.520 12:21:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:22.520 12:21:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:22.520 12:21:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:22.520 12:21:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:22.520 12:21:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:22.520 12:21:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:22.520 12:21:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:22.520 12:21:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:22.520 12:21:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:22.520 12:21:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:22.520 12:21:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:22.520 12:21:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:22.520 12:21:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:22.520 12:21:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:22.520 12:21:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:22.520 12:21:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:22.520 12:21:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.520 12:21:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.520 12:21:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.520 12:21:16 -- paths/export.sh@5 -- # export PATH 00:07:22.520 12:21:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:22.520 12:21:16 -- nvmf/common.sh@46 -- # : 0 00:07:22.520 12:21:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:22.520 12:21:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:22.520 12:21:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:22.520 12:21:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:22.520 12:21:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:22.520 12:21:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:22.520 12:21:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:22.520 12:21:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:22.520 12:21:16 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:22.520 12:21:16 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:22.520 12:21:16 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:22.520 12:21:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:22.520 12:21:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:22.520 12:21:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:22.520 12:21:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:22.520 12:21:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:22.520 12:21:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:22.520 12:21:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:22.520 12:21:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:22.520 12:21:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:22.520 12:21:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:22.520 12:21:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:22.520 12:21:16 -- common/autotest_common.sh@10 -- # set +x 00:07:24.420 12:21:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:24.420 12:21:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:24.420 12:21:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:24.420 12:21:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:24.420 12:21:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:24.420 12:21:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:24.420 12:21:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:24.420 12:21:18 -- nvmf/common.sh@294 -- # net_devs=() 00:07:24.420 12:21:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:24.420 12:21:18 -- nvmf/common.sh@295 -- # e810=() 00:07:24.420 12:21:18 -- nvmf/common.sh@295 -- # local -ga e810 00:07:24.420 12:21:18 -- nvmf/common.sh@296 -- # x722=() 00:07:24.420 12:21:18 -- nvmf/common.sh@296 -- # local -ga x722 00:07:24.420 12:21:18 -- nvmf/common.sh@297 -- # mlx=() 00:07:24.420 12:21:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:24.420 12:21:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:24.420 12:21:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:24.420 12:21:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:24.420 12:21:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:24.420 12:21:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:24.420 12:21:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:24.420 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:24.420 12:21:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:24.420 12:21:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:24.420 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:24.420 12:21:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:24.420 12:21:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:24.420 12:21:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:24.420 12:21:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:24.420 12:21:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:24.420 12:21:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:24.420 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:24.420 12:21:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:24.420 12:21:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:24.420 12:21:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:24.420 12:21:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:24.420 12:21:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:24.420 12:21:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:24.420 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:24.420 12:21:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:24.420 12:21:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:24.420 12:21:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:24.420 12:21:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:24.420 12:21:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:24.420 12:21:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:24.420 12:21:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:24.420 12:21:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:24.420 12:21:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:24.420 12:21:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:24.420 12:21:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:24.420 12:21:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:24.420 12:21:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:24.420 12:21:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:24.420 12:21:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:24.420 12:21:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:24.420 12:21:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:24.420 12:21:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:24.420 12:21:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:24.421 12:21:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:24.421 12:21:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:24.421 12:21:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:24.421 12:21:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:24.421 12:21:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:24.421 12:21:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:24.421 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:24.421 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:07:24.421 00:07:24.421 --- 10.0.0.2 ping statistics --- 00:07:24.421 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:24.421 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:07:24.421 12:21:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:24.421 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:24.421 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:07:24.421 00:07:24.421 --- 10.0.0.1 ping statistics --- 00:07:24.421 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:24.421 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:07:24.680 12:21:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:24.680 12:21:18 -- nvmf/common.sh@410 -- # return 0 00:07:24.680 12:21:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:24.680 12:21:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:24.680 12:21:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:24.680 12:21:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:24.680 12:21:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:24.680 12:21:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:24.680 12:21:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:24.680 12:21:18 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:24.680 12:21:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:24.680 12:21:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:07:24.680 12:21:18 -- common/autotest_common.sh@10 -- # set +x 00:07:24.680 12:21:18 -- nvmf/common.sh@469 -- # nvmfpid=1180656 00:07:24.680 12:21:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:24.680 12:21:18 -- nvmf/common.sh@470 -- # waitforlisten 1180656 00:07:24.680 12:21:18 -- common/autotest_common.sh@819 -- # '[' -z 1180656 ']' 00:07:24.680 12:21:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:24.680 12:21:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:07:24.680 12:21:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:24.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:24.680 12:21:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:07:24.680 12:21:18 -- common/autotest_common.sh@10 -- # set +x 00:07:24.680 [2024-07-12 12:21:18.413243] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:07:24.680 [2024-07-12 12:21:18.413318] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:24.680 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.680 [2024-07-12 12:21:18.477588] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:24.680 [2024-07-12 12:21:18.587524] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:24.680 [2024-07-12 12:21:18.587667] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:24.680 [2024-07-12 12:21:18.587684] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:24.680 [2024-07-12 12:21:18.587695] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:24.680 [2024-07-12 12:21:18.587748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:24.680 [2024-07-12 12:21:18.587805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:24.680 [2024-07-12 12:21:18.587877] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:24.680 [2024-07-12 12:21:18.587883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.617 12:21:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:07:25.617 12:21:19 -- common/autotest_common.sh@852 -- # return 0 00:07:25.617 12:21:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:25.617 12:21:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:07:25.617 12:21:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.617 12:21:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:25.618 12:21:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.618 12:21:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.618 [2024-07-12 12:21:19.402423] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:25.618 12:21:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:25.618 12:21:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.618 12:21:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.618 12:21:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:25.618 12:21:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.618 12:21:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.618 12:21:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:25.618 12:21:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.618 12:21:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.618 12:21:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:25.618 12:21:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:07:25.618 12:21:19 -- common/autotest_common.sh@10 -- # set +x 00:07:25.618 [2024-07-12 12:21:19.455354] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:25.618 12:21:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:25.618 12:21:19 -- target/connect_disconnect.sh@34 -- # set +x 00:07:28.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:30.687 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:32.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:35.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:37.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:39.574 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:42.096 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:44.620 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:47.144 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:49.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:54.096 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.028 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:01.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.992 [2024-07-12 12:21:56.626630] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf94c20 is same with the state(5) to be set 00:08:02.992 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.054 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.961 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.024 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.928 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.461 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.997 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.898 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:32.870 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.405 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.309 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.395 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.834 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.740 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.846 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.751 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.288 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.730 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.832 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:09.750 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.191 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.725 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.262 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.163 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:23.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.599 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.724 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.178 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.623 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.161 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.067 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.497 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.023 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:53.555 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.008 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:00.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.422 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.473 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.911 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.442 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.505 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.409 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.909 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.438 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.971 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.878 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.950 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.296 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.833 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.383 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.286 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.823 [2024-07-12 12:24:47.308616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf95540 is same with the state(5) to be set 00:10:53.823 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.273 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.236 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.140 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.675 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:12.204 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.664 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.664 12:25:10 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:16.664 12:25:10 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:16.664 12:25:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:16.664 12:25:10 -- nvmf/common.sh@116 -- # sync 00:11:16.664 12:25:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:16.664 12:25:10 -- nvmf/common.sh@119 -- # set +e 00:11:16.664 12:25:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:16.664 12:25:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:16.664 rmmod nvme_tcp 00:11:16.664 rmmod nvme_fabrics 00:11:16.664 rmmod nvme_keyring 00:11:16.664 12:25:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:16.664 12:25:10 -- nvmf/common.sh@123 -- # set -e 00:11:16.664 12:25:10 -- nvmf/common.sh@124 -- # return 0 00:11:16.664 12:25:10 -- nvmf/common.sh@477 -- # '[' -n 1180656 ']' 00:11:16.664 12:25:10 -- nvmf/common.sh@478 -- # killprocess 1180656 00:11:16.664 12:25:10 -- common/autotest_common.sh@926 -- # '[' -z 1180656 ']' 00:11:16.664 12:25:10 -- common/autotest_common.sh@930 -- # kill -0 1180656 00:11:16.664 12:25:10 -- common/autotest_common.sh@931 -- # uname 00:11:16.664 12:25:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:16.664 12:25:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1180656 00:11:16.664 12:25:10 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:16.664 12:25:10 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:16.664 12:25:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1180656' 00:11:16.664 killing process with pid 1180656 00:11:16.664 12:25:10 -- common/autotest_common.sh@945 -- # kill 1180656 00:11:16.664 12:25:10 -- common/autotest_common.sh@950 -- # wait 1180656 00:11:16.664 12:25:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:16.664 12:25:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:16.664 12:25:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:16.664 12:25:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:16.664 12:25:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:16.664 12:25:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:16.664 12:25:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:16.664 12:25:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:19.203 12:25:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:19.203 00:11:19.203 real 3m56.372s 00:11:19.203 user 14m59.256s 00:11:19.203 sys 0m35.794s 00:11:19.203 12:25:12 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:19.203 12:25:12 -- common/autotest_common.sh@10 -- # set +x 00:11:19.203 ************************************ 00:11:19.203 END TEST nvmf_connect_disconnect 00:11:19.203 ************************************ 00:11:19.203 12:25:12 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:19.203 12:25:12 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:19.203 12:25:12 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:19.203 12:25:12 -- common/autotest_common.sh@10 -- # set +x 00:11:19.203 ************************************ 00:11:19.203 START TEST nvmf_multitarget 00:11:19.203 ************************************ 00:11:19.203 12:25:12 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:19.203 * Looking for test storage... 00:11:19.203 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:19.203 12:25:12 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:19.203 12:25:12 -- nvmf/common.sh@7 -- # uname -s 00:11:19.203 12:25:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:19.203 12:25:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:19.203 12:25:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:19.203 12:25:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:19.203 12:25:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:19.203 12:25:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:19.203 12:25:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:19.203 12:25:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:19.203 12:25:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:19.203 12:25:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:19.203 12:25:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:19.203 12:25:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:19.203 12:25:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:19.203 12:25:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:19.203 12:25:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:19.203 12:25:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:19.203 12:25:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:19.203 12:25:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:19.203 12:25:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:19.203 12:25:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:19.203 12:25:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:19.203 12:25:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:19.203 12:25:12 -- paths/export.sh@5 -- # export PATH 00:11:19.204 12:25:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:19.204 12:25:12 -- nvmf/common.sh@46 -- # : 0 00:11:19.204 12:25:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:19.204 12:25:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:19.204 12:25:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:19.204 12:25:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:19.204 12:25:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:19.204 12:25:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:19.204 12:25:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:19.204 12:25:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:19.204 12:25:12 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:19.204 12:25:12 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:19.204 12:25:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:19.204 12:25:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:19.204 12:25:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:19.204 12:25:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:19.204 12:25:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:19.204 12:25:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:19.204 12:25:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:19.204 12:25:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:19.204 12:25:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:19.204 12:25:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:19.204 12:25:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:19.204 12:25:12 -- common/autotest_common.sh@10 -- # set +x 00:11:20.581 12:25:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:20.581 12:25:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:20.581 12:25:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:20.581 12:25:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:20.581 12:25:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:20.581 12:25:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:20.581 12:25:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:20.581 12:25:14 -- nvmf/common.sh@294 -- # net_devs=() 00:11:20.581 12:25:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:20.581 12:25:14 -- nvmf/common.sh@295 -- # e810=() 00:11:20.581 12:25:14 -- nvmf/common.sh@295 -- # local -ga e810 00:11:20.581 12:25:14 -- nvmf/common.sh@296 -- # x722=() 00:11:20.581 12:25:14 -- nvmf/common.sh@296 -- # local -ga x722 00:11:20.581 12:25:14 -- nvmf/common.sh@297 -- # mlx=() 00:11:20.581 12:25:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:20.581 12:25:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:20.581 12:25:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:20.581 12:25:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:20.581 12:25:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:20.581 12:25:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:20.581 12:25:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:20.581 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:20.581 12:25:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:20.581 12:25:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:20.581 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:20.581 12:25:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:20.581 12:25:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:20.581 12:25:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:20.581 12:25:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:20.581 12:25:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:20.581 12:25:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:20.581 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:20.581 12:25:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:20.581 12:25:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:20.581 12:25:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:20.581 12:25:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:20.581 12:25:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:20.581 12:25:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:20.581 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:20.581 12:25:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:20.581 12:25:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:20.581 12:25:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:20.581 12:25:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:20.581 12:25:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:20.581 12:25:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:20.581 12:25:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:20.581 12:25:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:20.581 12:25:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:20.581 12:25:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:20.581 12:25:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:20.581 12:25:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:20.581 12:25:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:20.581 12:25:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:20.581 12:25:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:20.581 12:25:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:20.581 12:25:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:20.581 12:25:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:20.838 12:25:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:20.838 12:25:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:20.838 12:25:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:20.838 12:25:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:20.838 12:25:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:20.838 12:25:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:20.838 12:25:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:20.838 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:20.838 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.197 ms 00:11:20.838 00:11:20.838 --- 10.0.0.2 ping statistics --- 00:11:20.838 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:20.838 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:11:20.838 12:25:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:20.838 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:20.838 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:11:20.838 00:11:20.838 --- 10.0.0.1 ping statistics --- 00:11:20.838 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:20.838 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:11:20.838 12:25:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:20.838 12:25:14 -- nvmf/common.sh@410 -- # return 0 00:11:20.838 12:25:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:20.838 12:25:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:20.838 12:25:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:20.838 12:25:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:20.838 12:25:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:20.838 12:25:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:20.838 12:25:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:20.838 12:25:14 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:20.838 12:25:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:20.838 12:25:14 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:20.838 12:25:14 -- common/autotest_common.sh@10 -- # set +x 00:11:20.838 12:25:14 -- nvmf/common.sh@469 -- # nvmfpid=1212669 00:11:20.838 12:25:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:20.839 12:25:14 -- nvmf/common.sh@470 -- # waitforlisten 1212669 00:11:20.839 12:25:14 -- common/autotest_common.sh@819 -- # '[' -z 1212669 ']' 00:11:20.839 12:25:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:20.839 12:25:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:20.839 12:25:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:20.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:20.839 12:25:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:20.839 12:25:14 -- common/autotest_common.sh@10 -- # set +x 00:11:20.839 [2024-07-12 12:25:14.667811] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:11:20.839 [2024-07-12 12:25:14.667924] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:20.839 EAL: No free 2048 kB hugepages reported on node 1 00:11:20.839 [2024-07-12 12:25:14.736459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:21.096 [2024-07-12 12:25:14.857193] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:21.096 [2024-07-12 12:25:14.857371] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:21.096 [2024-07-12 12:25:14.857401] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:21.096 [2024-07-12 12:25:14.857415] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:21.096 [2024-07-12 12:25:14.857484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:21.096 [2024-07-12 12:25:14.857538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:21.096 [2024-07-12 12:25:14.857588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:21.096 [2024-07-12 12:25:14.857591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:22.030 12:25:15 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:22.030 12:25:15 -- common/autotest_common.sh@852 -- # return 0 00:11:22.030 12:25:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:22.030 12:25:15 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:22.030 12:25:15 -- common/autotest_common.sh@10 -- # set +x 00:11:22.030 12:25:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:22.030 12:25:15 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:22.030 12:25:15 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:22.030 12:25:15 -- target/multitarget.sh@21 -- # jq length 00:11:22.030 12:25:15 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:22.030 12:25:15 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:22.030 "nvmf_tgt_1" 00:11:22.030 12:25:15 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:22.287 "nvmf_tgt_2" 00:11:22.287 12:25:16 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:22.287 12:25:16 -- target/multitarget.sh@28 -- # jq length 00:11:22.287 12:25:16 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:22.287 12:25:16 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:22.544 true 00:11:22.544 12:25:16 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:22.544 true 00:11:22.544 12:25:16 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:22.544 12:25:16 -- target/multitarget.sh@35 -- # jq length 00:11:22.544 12:25:16 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:22.544 12:25:16 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:22.544 12:25:16 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:22.544 12:25:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:22.544 12:25:16 -- nvmf/common.sh@116 -- # sync 00:11:22.544 12:25:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:22.544 12:25:16 -- nvmf/common.sh@119 -- # set +e 00:11:22.544 12:25:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:22.544 12:25:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:22.544 rmmod nvme_tcp 00:11:22.804 rmmod nvme_fabrics 00:11:22.804 rmmod nvme_keyring 00:11:22.804 12:25:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:22.804 12:25:16 -- nvmf/common.sh@123 -- # set -e 00:11:22.804 12:25:16 -- nvmf/common.sh@124 -- # return 0 00:11:22.804 12:25:16 -- nvmf/common.sh@477 -- # '[' -n 1212669 ']' 00:11:22.804 12:25:16 -- nvmf/common.sh@478 -- # killprocess 1212669 00:11:22.804 12:25:16 -- common/autotest_common.sh@926 -- # '[' -z 1212669 ']' 00:11:22.804 12:25:16 -- common/autotest_common.sh@930 -- # kill -0 1212669 00:11:22.804 12:25:16 -- common/autotest_common.sh@931 -- # uname 00:11:22.804 12:25:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:22.804 12:25:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1212669 00:11:22.804 12:25:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:22.804 12:25:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:22.804 12:25:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1212669' 00:11:22.804 killing process with pid 1212669 00:11:22.804 12:25:16 -- common/autotest_common.sh@945 -- # kill 1212669 00:11:22.804 12:25:16 -- common/autotest_common.sh@950 -- # wait 1212669 00:11:23.063 12:25:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:23.063 12:25:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:23.063 12:25:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:23.063 12:25:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:23.063 12:25:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:23.063 12:25:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:23.063 12:25:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:23.063 12:25:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:24.967 12:25:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:24.967 00:11:24.967 real 0m6.308s 00:11:24.967 user 0m9.296s 00:11:24.967 sys 0m1.850s 00:11:24.967 12:25:18 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:24.967 12:25:18 -- common/autotest_common.sh@10 -- # set +x 00:11:24.967 ************************************ 00:11:24.967 END TEST nvmf_multitarget 00:11:24.967 ************************************ 00:11:24.967 12:25:18 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:24.967 12:25:18 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:24.967 12:25:18 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:24.967 12:25:18 -- common/autotest_common.sh@10 -- # set +x 00:11:24.967 ************************************ 00:11:24.967 START TEST nvmf_rpc 00:11:24.967 ************************************ 00:11:24.967 12:25:18 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:25.225 * Looking for test storage... 00:11:25.225 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:25.225 12:25:18 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:25.225 12:25:18 -- nvmf/common.sh@7 -- # uname -s 00:11:25.225 12:25:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:25.225 12:25:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:25.225 12:25:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:25.225 12:25:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:25.225 12:25:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:25.225 12:25:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:25.225 12:25:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:25.225 12:25:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:25.225 12:25:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:25.225 12:25:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:25.225 12:25:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:25.225 12:25:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:25.225 12:25:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:25.225 12:25:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:25.225 12:25:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:25.225 12:25:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:25.225 12:25:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:25.225 12:25:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:25.225 12:25:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:25.225 12:25:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.226 12:25:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.226 12:25:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.226 12:25:18 -- paths/export.sh@5 -- # export PATH 00:11:25.226 12:25:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:25.226 12:25:18 -- nvmf/common.sh@46 -- # : 0 00:11:25.226 12:25:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:25.226 12:25:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:25.226 12:25:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:25.226 12:25:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:25.226 12:25:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:25.226 12:25:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:25.226 12:25:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:25.226 12:25:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:25.226 12:25:18 -- target/rpc.sh@11 -- # loops=5 00:11:25.226 12:25:18 -- target/rpc.sh@23 -- # nvmftestinit 00:11:25.226 12:25:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:25.226 12:25:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:25.226 12:25:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:25.226 12:25:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:25.226 12:25:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:25.226 12:25:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:25.226 12:25:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:25.226 12:25:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:25.226 12:25:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:25.226 12:25:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:25.226 12:25:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:25.226 12:25:18 -- common/autotest_common.sh@10 -- # set +x 00:11:27.126 12:25:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:27.126 12:25:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:27.126 12:25:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:27.126 12:25:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:27.126 12:25:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:27.127 12:25:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:27.127 12:25:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:27.127 12:25:20 -- nvmf/common.sh@294 -- # net_devs=() 00:11:27.127 12:25:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:27.127 12:25:20 -- nvmf/common.sh@295 -- # e810=() 00:11:27.127 12:25:20 -- nvmf/common.sh@295 -- # local -ga e810 00:11:27.127 12:25:20 -- nvmf/common.sh@296 -- # x722=() 00:11:27.127 12:25:20 -- nvmf/common.sh@296 -- # local -ga x722 00:11:27.127 12:25:20 -- nvmf/common.sh@297 -- # mlx=() 00:11:27.127 12:25:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:27.127 12:25:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:27.127 12:25:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:27.127 12:25:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:27.127 12:25:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:27.127 12:25:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:27.127 12:25:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:27.127 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:27.127 12:25:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:27.127 12:25:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:27.127 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:27.127 12:25:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:27.127 12:25:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:27.127 12:25:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:27.127 12:25:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:27.127 12:25:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:27.127 12:25:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:27.127 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:27.127 12:25:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:27.127 12:25:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:27.127 12:25:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:27.127 12:25:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:27.127 12:25:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:27.127 12:25:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:27.127 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:27.127 12:25:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:27.127 12:25:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:27.127 12:25:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:27.127 12:25:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:27.127 12:25:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:27.127 12:25:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:27.127 12:25:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:27.127 12:25:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:27.127 12:25:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:27.127 12:25:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:27.127 12:25:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:27.127 12:25:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:27.127 12:25:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:27.127 12:25:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:27.127 12:25:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:27.127 12:25:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:27.127 12:25:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:27.127 12:25:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:27.388 12:25:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:27.388 12:25:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:27.388 12:25:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:27.388 12:25:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:27.388 12:25:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:27.388 12:25:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:27.388 12:25:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:27.388 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:27.388 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.160 ms 00:11:27.388 00:11:27.388 --- 10.0.0.2 ping statistics --- 00:11:27.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:27.388 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:11:27.388 12:25:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:27.388 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:27.388 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:11:27.388 00:11:27.388 --- 10.0.0.1 ping statistics --- 00:11:27.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:27.388 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:11:27.388 12:25:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:27.388 12:25:21 -- nvmf/common.sh@410 -- # return 0 00:11:27.388 12:25:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:27.388 12:25:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:27.388 12:25:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:27.388 12:25:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:27.388 12:25:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:27.388 12:25:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:27.388 12:25:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:27.388 12:25:21 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:27.388 12:25:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:27.388 12:25:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:27.388 12:25:21 -- common/autotest_common.sh@10 -- # set +x 00:11:27.388 12:25:21 -- nvmf/common.sh@469 -- # nvmfpid=1214870 00:11:27.388 12:25:21 -- nvmf/common.sh@470 -- # waitforlisten 1214870 00:11:27.388 12:25:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:27.388 12:25:21 -- common/autotest_common.sh@819 -- # '[' -z 1214870 ']' 00:11:27.388 12:25:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:27.388 12:25:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:27.388 12:25:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:27.388 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:27.388 12:25:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:27.388 12:25:21 -- common/autotest_common.sh@10 -- # set +x 00:11:27.388 [2024-07-12 12:25:21.201942] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:11:27.388 [2024-07-12 12:25:21.202019] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:27.388 EAL: No free 2048 kB hugepages reported on node 1 00:11:27.388 [2024-07-12 12:25:21.266711] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:27.646 [2024-07-12 12:25:21.380240] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:27.646 [2024-07-12 12:25:21.380389] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:27.646 [2024-07-12 12:25:21.380405] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:27.646 [2024-07-12 12:25:21.380417] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:27.646 [2024-07-12 12:25:21.380473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:27.646 [2024-07-12 12:25:21.380530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:27.646 [2024-07-12 12:25:21.380595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:27.646 [2024-07-12 12:25:21.380598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:28.578 12:25:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:28.578 12:25:22 -- common/autotest_common.sh@852 -- # return 0 00:11:28.578 12:25:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:28.578 12:25:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:28.578 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.578 12:25:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:28.578 12:25:22 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:28.578 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.578 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.578 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.578 12:25:22 -- target/rpc.sh@26 -- # stats='{ 00:11:28.578 "tick_rate": 2700000000, 00:11:28.578 "poll_groups": [ 00:11:28.578 { 00:11:28.578 "name": "nvmf_tgt_poll_group_0", 00:11:28.578 "admin_qpairs": 0, 00:11:28.578 "io_qpairs": 0, 00:11:28.578 "current_admin_qpairs": 0, 00:11:28.578 "current_io_qpairs": 0, 00:11:28.578 "pending_bdev_io": 0, 00:11:28.578 "completed_nvme_io": 0, 00:11:28.578 "transports": [] 00:11:28.578 }, 00:11:28.578 { 00:11:28.578 "name": "nvmf_tgt_poll_group_1", 00:11:28.578 "admin_qpairs": 0, 00:11:28.578 "io_qpairs": 0, 00:11:28.578 "current_admin_qpairs": 0, 00:11:28.578 "current_io_qpairs": 0, 00:11:28.578 "pending_bdev_io": 0, 00:11:28.578 "completed_nvme_io": 0, 00:11:28.578 "transports": [] 00:11:28.578 }, 00:11:28.578 { 00:11:28.578 "name": "nvmf_tgt_poll_group_2", 00:11:28.578 "admin_qpairs": 0, 00:11:28.578 "io_qpairs": 0, 00:11:28.578 "current_admin_qpairs": 0, 00:11:28.578 "current_io_qpairs": 0, 00:11:28.578 "pending_bdev_io": 0, 00:11:28.578 "completed_nvme_io": 0, 00:11:28.578 "transports": [] 00:11:28.578 }, 00:11:28.578 { 00:11:28.578 "name": "nvmf_tgt_poll_group_3", 00:11:28.578 "admin_qpairs": 0, 00:11:28.578 "io_qpairs": 0, 00:11:28.578 "current_admin_qpairs": 0, 00:11:28.578 "current_io_qpairs": 0, 00:11:28.578 "pending_bdev_io": 0, 00:11:28.578 "completed_nvme_io": 0, 00:11:28.578 "transports": [] 00:11:28.578 } 00:11:28.578 ] 00:11:28.578 }' 00:11:28.578 12:25:22 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:28.578 12:25:22 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:28.578 12:25:22 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:28.578 12:25:22 -- target/rpc.sh@15 -- # wc -l 00:11:28.578 12:25:22 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:28.579 12:25:22 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:28.579 12:25:22 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:28.579 12:25:22 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 [2024-07-12 12:25:22.296800] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@33 -- # stats='{ 00:11:28.579 "tick_rate": 2700000000, 00:11:28.579 "poll_groups": [ 00:11:28.579 { 00:11:28.579 "name": "nvmf_tgt_poll_group_0", 00:11:28.579 "admin_qpairs": 0, 00:11:28.579 "io_qpairs": 0, 00:11:28.579 "current_admin_qpairs": 0, 00:11:28.579 "current_io_qpairs": 0, 00:11:28.579 "pending_bdev_io": 0, 00:11:28.579 "completed_nvme_io": 0, 00:11:28.579 "transports": [ 00:11:28.579 { 00:11:28.579 "trtype": "TCP" 00:11:28.579 } 00:11:28.579 ] 00:11:28.579 }, 00:11:28.579 { 00:11:28.579 "name": "nvmf_tgt_poll_group_1", 00:11:28.579 "admin_qpairs": 0, 00:11:28.579 "io_qpairs": 0, 00:11:28.579 "current_admin_qpairs": 0, 00:11:28.579 "current_io_qpairs": 0, 00:11:28.579 "pending_bdev_io": 0, 00:11:28.579 "completed_nvme_io": 0, 00:11:28.579 "transports": [ 00:11:28.579 { 00:11:28.579 "trtype": "TCP" 00:11:28.579 } 00:11:28.579 ] 00:11:28.579 }, 00:11:28.579 { 00:11:28.579 "name": "nvmf_tgt_poll_group_2", 00:11:28.579 "admin_qpairs": 0, 00:11:28.579 "io_qpairs": 0, 00:11:28.579 "current_admin_qpairs": 0, 00:11:28.579 "current_io_qpairs": 0, 00:11:28.579 "pending_bdev_io": 0, 00:11:28.579 "completed_nvme_io": 0, 00:11:28.579 "transports": [ 00:11:28.579 { 00:11:28.579 "trtype": "TCP" 00:11:28.579 } 00:11:28.579 ] 00:11:28.579 }, 00:11:28.579 { 00:11:28.579 "name": "nvmf_tgt_poll_group_3", 00:11:28.579 "admin_qpairs": 0, 00:11:28.579 "io_qpairs": 0, 00:11:28.579 "current_admin_qpairs": 0, 00:11:28.579 "current_io_qpairs": 0, 00:11:28.579 "pending_bdev_io": 0, 00:11:28.579 "completed_nvme_io": 0, 00:11:28.579 "transports": [ 00:11:28.579 { 00:11:28.579 "trtype": "TCP" 00:11:28.579 } 00:11:28.579 ] 00:11:28.579 } 00:11:28.579 ] 00:11:28.579 }' 00:11:28.579 12:25:22 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:28.579 12:25:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:28.579 12:25:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:28.579 12:25:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:28.579 12:25:22 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:28.579 12:25:22 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:28.579 12:25:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:28.579 12:25:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:28.579 12:25:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:28.579 12:25:22 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:28.579 12:25:22 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:28.579 12:25:22 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:28.579 12:25:22 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:28.579 12:25:22 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 Malloc1 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:28.579 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.579 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.579 [2024-07-12 12:25:22.450262] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:28.579 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.579 12:25:22 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:28.579 12:25:22 -- common/autotest_common.sh@640 -- # local es=0 00:11:28.579 12:25:22 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:28.579 12:25:22 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:28.579 12:25:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:28.579 12:25:22 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:28.579 12:25:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:28.579 12:25:22 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:28.579 12:25:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:28.579 12:25:22 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:28.579 12:25:22 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:28.579 12:25:22 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:28.579 [2024-07-12 12:25:22.472771] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:28.837 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:28.837 could not add new controller: failed to write to nvme-fabrics device 00:11:28.837 12:25:22 -- common/autotest_common.sh@643 -- # es=1 00:11:28.837 12:25:22 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:28.837 12:25:22 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:28.837 12:25:22 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:28.837 12:25:22 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:28.837 12:25:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:28.837 12:25:22 -- common/autotest_common.sh@10 -- # set +x 00:11:28.837 12:25:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:28.837 12:25:22 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:29.403 12:25:23 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:29.403 12:25:23 -- common/autotest_common.sh@1177 -- # local i=0 00:11:29.403 12:25:23 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:29.403 12:25:23 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:29.403 12:25:23 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:31.309 12:25:25 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:31.309 12:25:25 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:31.309 12:25:25 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:31.309 12:25:25 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:31.309 12:25:25 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:31.309 12:25:25 -- common/autotest_common.sh@1187 -- # return 0 00:11:31.309 12:25:25 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:31.309 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.309 12:25:25 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:31.309 12:25:25 -- common/autotest_common.sh@1198 -- # local i=0 00:11:31.309 12:25:25 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:31.309 12:25:25 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:31.309 12:25:25 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:31.309 12:25:25 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:31.309 12:25:25 -- common/autotest_common.sh@1210 -- # return 0 00:11:31.309 12:25:25 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:31.309 12:25:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:31.309 12:25:25 -- common/autotest_common.sh@10 -- # set +x 00:11:31.309 12:25:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:31.309 12:25:25 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.309 12:25:25 -- common/autotest_common.sh@640 -- # local es=0 00:11:31.309 12:25:25 -- common/autotest_common.sh@642 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.567 12:25:25 -- common/autotest_common.sh@628 -- # local arg=nvme 00:11:31.567 12:25:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:31.567 12:25:25 -- common/autotest_common.sh@632 -- # type -t nvme 00:11:31.567 12:25:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:31.567 12:25:25 -- common/autotest_common.sh@634 -- # type -P nvme 00:11:31.567 12:25:25 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:11:31.567 12:25:25 -- common/autotest_common.sh@634 -- # arg=/usr/sbin/nvme 00:11:31.567 12:25:25 -- common/autotest_common.sh@634 -- # [[ -x /usr/sbin/nvme ]] 00:11:31.567 12:25:25 -- common/autotest_common.sh@643 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:31.567 [2024-07-12 12:25:25.242613] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:31.567 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:31.567 could not add new controller: failed to write to nvme-fabrics device 00:11:31.567 12:25:25 -- common/autotest_common.sh@643 -- # es=1 00:11:31.567 12:25:25 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:11:31.567 12:25:25 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:11:31.567 12:25:25 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:11:31.567 12:25:25 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:31.567 12:25:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:31.567 12:25:25 -- common/autotest_common.sh@10 -- # set +x 00:11:31.567 12:25:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:31.567 12:25:25 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:32.134 12:25:25 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:32.134 12:25:25 -- common/autotest_common.sh@1177 -- # local i=0 00:11:32.134 12:25:25 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:32.134 12:25:25 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:32.134 12:25:25 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:34.037 12:25:27 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:34.037 12:25:27 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:34.037 12:25:27 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:34.037 12:25:27 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:34.037 12:25:27 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:34.037 12:25:27 -- common/autotest_common.sh@1187 -- # return 0 00:11:34.037 12:25:27 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:34.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.037 12:25:27 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:34.037 12:25:27 -- common/autotest_common.sh@1198 -- # local i=0 00:11:34.037 12:25:27 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:34.037 12:25:27 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:34.294 12:25:27 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:34.295 12:25:27 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:34.295 12:25:27 -- common/autotest_common.sh@1210 -- # return 0 00:11:34.295 12:25:27 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:34.295 12:25:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:34.295 12:25:27 -- common/autotest_common.sh@10 -- # set +x 00:11:34.295 12:25:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:34.295 12:25:27 -- target/rpc.sh@81 -- # seq 1 5 00:11:34.295 12:25:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:34.295 12:25:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:34.295 12:25:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:34.295 12:25:27 -- common/autotest_common.sh@10 -- # set +x 00:11:34.295 12:25:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:34.295 12:25:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:34.295 12:25:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:34.295 12:25:27 -- common/autotest_common.sh@10 -- # set +x 00:11:34.295 [2024-07-12 12:25:27.990443] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:34.295 12:25:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:34.295 12:25:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:34.295 12:25:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:34.295 12:25:27 -- common/autotest_common.sh@10 -- # set +x 00:11:34.295 12:25:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:34.295 12:25:28 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:34.295 12:25:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:34.295 12:25:28 -- common/autotest_common.sh@10 -- # set +x 00:11:34.295 12:25:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:34.295 12:25:28 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:34.861 12:25:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:34.861 12:25:28 -- common/autotest_common.sh@1177 -- # local i=0 00:11:34.861 12:25:28 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:34.861 12:25:28 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:34.861 12:25:28 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:36.816 12:25:30 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:36.816 12:25:30 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:36.816 12:25:30 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:36.816 12:25:30 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:36.816 12:25:30 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:36.816 12:25:30 -- common/autotest_common.sh@1187 -- # return 0 00:11:36.816 12:25:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:37.074 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.074 12:25:30 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:37.074 12:25:30 -- common/autotest_common.sh@1198 -- # local i=0 00:11:37.074 12:25:30 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:37.074 12:25:30 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.074 12:25:30 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:37.074 12:25:30 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:37.074 12:25:30 -- common/autotest_common.sh@1210 -- # return 0 00:11:37.074 12:25:30 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:37.074 12:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.074 12:25:30 -- common/autotest_common.sh@10 -- # set +x 00:11:37.074 12:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.074 12:25:30 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:37.074 12:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.074 12:25:30 -- common/autotest_common.sh@10 -- # set +x 00:11:37.074 12:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.074 12:25:30 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:37.074 12:25:30 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:37.074 12:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.074 12:25:30 -- common/autotest_common.sh@10 -- # set +x 00:11:37.074 12:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.074 12:25:30 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:37.074 12:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.074 12:25:30 -- common/autotest_common.sh@10 -- # set +x 00:11:37.074 [2024-07-12 12:25:30.792354] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:37.074 12:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.074 12:25:30 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:37.074 12:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.074 12:25:30 -- common/autotest_common.sh@10 -- # set +x 00:11:37.074 12:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.074 12:25:30 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:37.074 12:25:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:37.074 12:25:30 -- common/autotest_common.sh@10 -- # set +x 00:11:37.074 12:25:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:37.074 12:25:30 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:37.645 12:25:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:37.645 12:25:31 -- common/autotest_common.sh@1177 -- # local i=0 00:11:37.645 12:25:31 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:37.645 12:25:31 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:37.645 12:25:31 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:39.551 12:25:33 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:39.551 12:25:33 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:39.551 12:25:33 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:39.551 12:25:33 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:39.551 12:25:33 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:39.551 12:25:33 -- common/autotest_common.sh@1187 -- # return 0 00:11:39.551 12:25:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:39.808 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.808 12:25:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:39.808 12:25:33 -- common/autotest_common.sh@1198 -- # local i=0 00:11:39.808 12:25:33 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:39.808 12:25:33 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:39.808 12:25:33 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:39.808 12:25:33 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:39.808 12:25:33 -- common/autotest_common.sh@1210 -- # return 0 00:11:39.808 12:25:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:39.808 12:25:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.808 12:25:33 -- common/autotest_common.sh@10 -- # set +x 00:11:39.808 12:25:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.808 12:25:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:39.808 12:25:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.808 12:25:33 -- common/autotest_common.sh@10 -- # set +x 00:11:39.808 12:25:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.808 12:25:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:39.808 12:25:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:39.808 12:25:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.808 12:25:33 -- common/autotest_common.sh@10 -- # set +x 00:11:39.808 12:25:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.808 12:25:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:39.808 12:25:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.809 12:25:33 -- common/autotest_common.sh@10 -- # set +x 00:11:39.809 [2024-07-12 12:25:33.553626] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:39.809 12:25:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.809 12:25:33 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:39.809 12:25:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.809 12:25:33 -- common/autotest_common.sh@10 -- # set +x 00:11:39.809 12:25:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.809 12:25:33 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:39.809 12:25:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:39.809 12:25:33 -- common/autotest_common.sh@10 -- # set +x 00:11:39.809 12:25:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:39.809 12:25:33 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:40.375 12:25:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:40.375 12:25:34 -- common/autotest_common.sh@1177 -- # local i=0 00:11:40.375 12:25:34 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:40.375 12:25:34 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:40.375 12:25:34 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:42.913 12:25:36 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:42.913 12:25:36 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:42.913 12:25:36 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:42.913 12:25:36 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:42.913 12:25:36 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:42.913 12:25:36 -- common/autotest_common.sh@1187 -- # return 0 00:11:42.913 12:25:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:42.913 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.913 12:25:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:42.913 12:25:36 -- common/autotest_common.sh@1198 -- # local i=0 00:11:42.913 12:25:36 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:42.913 12:25:36 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.913 12:25:36 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:42.913 12:25:36 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:42.913 12:25:36 -- common/autotest_common.sh@1210 -- # return 0 00:11:42.913 12:25:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:42.913 12:25:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.913 12:25:36 -- common/autotest_common.sh@10 -- # set +x 00:11:42.913 12:25:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.913 12:25:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:42.913 12:25:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.913 12:25:36 -- common/autotest_common.sh@10 -- # set +x 00:11:42.913 12:25:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.913 12:25:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:42.913 12:25:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:42.913 12:25:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.913 12:25:36 -- common/autotest_common.sh@10 -- # set +x 00:11:42.913 12:25:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.913 12:25:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:42.913 12:25:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.913 12:25:36 -- common/autotest_common.sh@10 -- # set +x 00:11:42.913 [2024-07-12 12:25:36.349609] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:42.913 12:25:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.913 12:25:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:42.913 12:25:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.913 12:25:36 -- common/autotest_common.sh@10 -- # set +x 00:11:42.913 12:25:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.913 12:25:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:42.913 12:25:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:42.914 12:25:36 -- common/autotest_common.sh@10 -- # set +x 00:11:42.914 12:25:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:42.914 12:25:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:43.172 12:25:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:43.172 12:25:37 -- common/autotest_common.sh@1177 -- # local i=0 00:11:43.172 12:25:37 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:43.172 12:25:37 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:43.172 12:25:37 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:45.709 12:25:39 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:45.709 12:25:39 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:45.709 12:25:39 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:45.709 12:25:39 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:45.709 12:25:39 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:45.709 12:25:39 -- common/autotest_common.sh@1187 -- # return 0 00:11:45.709 12:25:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:45.709 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.709 12:25:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:45.709 12:25:39 -- common/autotest_common.sh@1198 -- # local i=0 00:11:45.709 12:25:39 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:45.709 12:25:39 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.709 12:25:39 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:45.709 12:25:39 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:45.709 12:25:39 -- common/autotest_common.sh@1210 -- # return 0 00:11:45.709 12:25:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:45.709 12:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.709 12:25:39 -- common/autotest_common.sh@10 -- # set +x 00:11:45.709 12:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.709 12:25:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:45.709 12:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.709 12:25:39 -- common/autotest_common.sh@10 -- # set +x 00:11:45.709 12:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.709 12:25:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:45.709 12:25:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:45.709 12:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.710 12:25:39 -- common/autotest_common.sh@10 -- # set +x 00:11:45.710 12:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.710 12:25:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:45.710 12:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.710 12:25:39 -- common/autotest_common.sh@10 -- # set +x 00:11:45.710 [2024-07-12 12:25:39.160588] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:45.710 12:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.710 12:25:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:45.710 12:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.710 12:25:39 -- common/autotest_common.sh@10 -- # set +x 00:11:45.710 12:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.710 12:25:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:45.710 12:25:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:45.710 12:25:39 -- common/autotest_common.sh@10 -- # set +x 00:11:45.710 12:25:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:45.710 12:25:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:45.970 12:25:39 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:45.970 12:25:39 -- common/autotest_common.sh@1177 -- # local i=0 00:11:45.970 12:25:39 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:11:45.970 12:25:39 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:11:45.970 12:25:39 -- common/autotest_common.sh@1184 -- # sleep 2 00:11:48.504 12:25:41 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:11:48.504 12:25:41 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:11:48.504 12:25:41 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:11:48.504 12:25:41 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:11:48.504 12:25:41 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:11:48.504 12:25:41 -- common/autotest_common.sh@1187 -- # return 0 00:11:48.504 12:25:41 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:48.504 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.504 12:25:41 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:48.504 12:25:41 -- common/autotest_common.sh@1198 -- # local i=0 00:11:48.504 12:25:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:11:48.504 12:25:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:48.504 12:25:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:11:48.504 12:25:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:48.504 12:25:41 -- common/autotest_common.sh@1210 -- # return 0 00:11:48.504 12:25:41 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:48.504 12:25:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:41 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:41 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:41 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:41 -- target/rpc.sh@99 -- # seq 1 5 00:11:48.504 12:25:41 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.504 12:25:41 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.504 12:25:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:41 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:41 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.504 12:25:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:41 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 [2024-07-12 12:25:41.999978] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.504 12:25:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 [2024-07-12 12:25:42.048089] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.504 12:25:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 [2024-07-12 12:25:42.096286] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.504 12:25:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.504 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.504 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.504 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.505 12:25:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 [2024-07-12 12:25:42.144423] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:48.505 12:25:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 [2024-07-12 12:25:42.192596] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:48.505 12:25:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:11:48.505 12:25:42 -- common/autotest_common.sh@10 -- # set +x 00:11:48.505 12:25:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:11:48.505 12:25:42 -- target/rpc.sh@110 -- # stats='{ 00:11:48.505 "tick_rate": 2700000000, 00:11:48.505 "poll_groups": [ 00:11:48.505 { 00:11:48.505 "name": "nvmf_tgt_poll_group_0", 00:11:48.505 "admin_qpairs": 2, 00:11:48.505 "io_qpairs": 84, 00:11:48.505 "current_admin_qpairs": 0, 00:11:48.505 "current_io_qpairs": 0, 00:11:48.505 "pending_bdev_io": 0, 00:11:48.505 "completed_nvme_io": 184, 00:11:48.505 "transports": [ 00:11:48.505 { 00:11:48.505 "trtype": "TCP" 00:11:48.505 } 00:11:48.505 ] 00:11:48.505 }, 00:11:48.505 { 00:11:48.505 "name": "nvmf_tgt_poll_group_1", 00:11:48.505 "admin_qpairs": 2, 00:11:48.505 "io_qpairs": 84, 00:11:48.505 "current_admin_qpairs": 0, 00:11:48.505 "current_io_qpairs": 0, 00:11:48.505 "pending_bdev_io": 0, 00:11:48.505 "completed_nvme_io": 183, 00:11:48.505 "transports": [ 00:11:48.505 { 00:11:48.505 "trtype": "TCP" 00:11:48.505 } 00:11:48.505 ] 00:11:48.505 }, 00:11:48.505 { 00:11:48.505 "name": "nvmf_tgt_poll_group_2", 00:11:48.505 "admin_qpairs": 1, 00:11:48.505 "io_qpairs": 84, 00:11:48.505 "current_admin_qpairs": 0, 00:11:48.505 "current_io_qpairs": 0, 00:11:48.505 "pending_bdev_io": 0, 00:11:48.505 "completed_nvme_io": 137, 00:11:48.505 "transports": [ 00:11:48.505 { 00:11:48.505 "trtype": "TCP" 00:11:48.505 } 00:11:48.505 ] 00:11:48.505 }, 00:11:48.505 { 00:11:48.505 "name": "nvmf_tgt_poll_group_3", 00:11:48.505 "admin_qpairs": 2, 00:11:48.505 "io_qpairs": 84, 00:11:48.505 "current_admin_qpairs": 0, 00:11:48.505 "current_io_qpairs": 0, 00:11:48.505 "pending_bdev_io": 0, 00:11:48.505 "completed_nvme_io": 182, 00:11:48.505 "transports": [ 00:11:48.505 { 00:11:48.505 "trtype": "TCP" 00:11:48.505 } 00:11:48.505 ] 00:11:48.505 } 00:11:48.505 ] 00:11:48.505 }' 00:11:48.505 12:25:42 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:48.505 12:25:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:48.505 12:25:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:48.505 12:25:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:48.505 12:25:42 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:48.505 12:25:42 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:48.505 12:25:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:48.505 12:25:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:48.505 12:25:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:48.505 12:25:42 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:11:48.505 12:25:42 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:48.505 12:25:42 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:48.505 12:25:42 -- target/rpc.sh@123 -- # nvmftestfini 00:11:48.505 12:25:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:48.505 12:25:42 -- nvmf/common.sh@116 -- # sync 00:11:48.505 12:25:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:48.505 12:25:42 -- nvmf/common.sh@119 -- # set +e 00:11:48.505 12:25:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:48.505 12:25:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:48.505 rmmod nvme_tcp 00:11:48.505 rmmod nvme_fabrics 00:11:48.505 rmmod nvme_keyring 00:11:48.505 12:25:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:48.505 12:25:42 -- nvmf/common.sh@123 -- # set -e 00:11:48.505 12:25:42 -- nvmf/common.sh@124 -- # return 0 00:11:48.505 12:25:42 -- nvmf/common.sh@477 -- # '[' -n 1214870 ']' 00:11:48.505 12:25:42 -- nvmf/common.sh@478 -- # killprocess 1214870 00:11:48.505 12:25:42 -- common/autotest_common.sh@926 -- # '[' -z 1214870 ']' 00:11:48.505 12:25:42 -- common/autotest_common.sh@930 -- # kill -0 1214870 00:11:48.505 12:25:42 -- common/autotest_common.sh@931 -- # uname 00:11:48.505 12:25:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:11:48.505 12:25:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1214870 00:11:48.505 12:25:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:11:48.505 12:25:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:11:48.505 12:25:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1214870' 00:11:48.505 killing process with pid 1214870 00:11:48.505 12:25:42 -- common/autotest_common.sh@945 -- # kill 1214870 00:11:48.505 12:25:42 -- common/autotest_common.sh@950 -- # wait 1214870 00:11:49.075 12:25:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:49.076 12:25:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:49.076 12:25:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:49.076 12:25:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:49.076 12:25:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:49.076 12:25:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.076 12:25:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.076 12:25:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:50.975 12:25:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:50.975 00:11:50.975 real 0m25.867s 00:11:50.975 user 1m24.447s 00:11:50.975 sys 0m4.264s 00:11:50.975 12:25:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:11:50.975 12:25:44 -- common/autotest_common.sh@10 -- # set +x 00:11:50.976 ************************************ 00:11:50.976 END TEST nvmf_rpc 00:11:50.976 ************************************ 00:11:50.976 12:25:44 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:50.976 12:25:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:11:50.976 12:25:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:11:50.976 12:25:44 -- common/autotest_common.sh@10 -- # set +x 00:11:50.976 ************************************ 00:11:50.976 START TEST nvmf_invalid 00:11:50.976 ************************************ 00:11:50.976 12:25:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:50.976 * Looking for test storage... 00:11:50.976 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:50.976 12:25:44 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:50.976 12:25:44 -- nvmf/common.sh@7 -- # uname -s 00:11:50.976 12:25:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:50.976 12:25:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:50.976 12:25:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:50.976 12:25:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:50.976 12:25:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:50.976 12:25:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:50.976 12:25:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:50.976 12:25:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:50.976 12:25:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:50.976 12:25:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:50.976 12:25:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.976 12:25:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:50.976 12:25:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:50.976 12:25:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:50.976 12:25:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:50.976 12:25:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:50.976 12:25:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:50.976 12:25:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:50.976 12:25:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:50.976 12:25:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.976 12:25:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.976 12:25:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.976 12:25:44 -- paths/export.sh@5 -- # export PATH 00:11:50.976 12:25:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:50.976 12:25:44 -- nvmf/common.sh@46 -- # : 0 00:11:50.976 12:25:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:50.976 12:25:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:50.976 12:25:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:50.976 12:25:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:50.976 12:25:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:50.976 12:25:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:50.976 12:25:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:50.976 12:25:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:50.976 12:25:44 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:50.976 12:25:44 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:11:50.976 12:25:44 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:50.976 12:25:44 -- target/invalid.sh@14 -- # target=foobar 00:11:50.976 12:25:44 -- target/invalid.sh@16 -- # RANDOM=0 00:11:50.976 12:25:44 -- target/invalid.sh@34 -- # nvmftestinit 00:11:50.976 12:25:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:50.976 12:25:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:50.976 12:25:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:50.976 12:25:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:50.976 12:25:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:50.976 12:25:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:50.976 12:25:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:50.976 12:25:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:50.976 12:25:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:50.976 12:25:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:50.976 12:25:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:50.976 12:25:44 -- common/autotest_common.sh@10 -- # set +x 00:11:52.877 12:25:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:52.877 12:25:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:52.877 12:25:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:52.877 12:25:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:52.877 12:25:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:52.877 12:25:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:52.877 12:25:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:52.877 12:25:46 -- nvmf/common.sh@294 -- # net_devs=() 00:11:52.877 12:25:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:52.877 12:25:46 -- nvmf/common.sh@295 -- # e810=() 00:11:52.877 12:25:46 -- nvmf/common.sh@295 -- # local -ga e810 00:11:52.877 12:25:46 -- nvmf/common.sh@296 -- # x722=() 00:11:52.877 12:25:46 -- nvmf/common.sh@296 -- # local -ga x722 00:11:52.877 12:25:46 -- nvmf/common.sh@297 -- # mlx=() 00:11:52.877 12:25:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:52.877 12:25:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:52.877 12:25:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:52.877 12:25:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:52.877 12:25:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:52.877 12:25:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:52.877 12:25:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:52.877 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:52.877 12:25:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:52.877 12:25:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:52.877 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:52.877 12:25:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:52.877 12:25:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:52.877 12:25:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:52.877 12:25:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:52.877 12:25:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:52.877 12:25:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:52.877 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:52.877 12:25:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:52.877 12:25:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:52.877 12:25:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:52.877 12:25:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:52.877 12:25:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:52.877 12:25:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:52.877 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:52.877 12:25:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:52.877 12:25:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:52.877 12:25:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:52.877 12:25:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:52.877 12:25:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:52.877 12:25:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:52.877 12:25:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:52.877 12:25:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:52.877 12:25:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:52.877 12:25:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:52.877 12:25:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:52.877 12:25:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:52.877 12:25:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:52.877 12:25:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:52.877 12:25:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:52.877 12:25:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:52.877 12:25:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:52.877 12:25:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:52.877 12:25:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:52.877 12:25:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:52.877 12:25:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:52.877 12:25:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:53.136 12:25:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:53.136 12:25:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:53.136 12:25:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:53.136 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:53.136 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.151 ms 00:11:53.136 00:11:53.136 --- 10.0.0.2 ping statistics --- 00:11:53.136 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.136 rtt min/avg/max/mdev = 0.151/0.151/0.151/0.000 ms 00:11:53.136 12:25:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:53.136 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:53.136 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:11:53.136 00:11:53.136 --- 10.0.0.1 ping statistics --- 00:11:53.136 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.136 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:11:53.136 12:25:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:53.136 12:25:46 -- nvmf/common.sh@410 -- # return 0 00:11:53.136 12:25:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:53.136 12:25:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:53.136 12:25:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:53.136 12:25:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:53.136 12:25:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:53.136 12:25:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:53.136 12:25:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:53.136 12:25:46 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:53.136 12:25:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:53.136 12:25:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:11:53.136 12:25:46 -- common/autotest_common.sh@10 -- # set +x 00:11:53.136 12:25:46 -- nvmf/common.sh@469 -- # nvmfpid=1219501 00:11:53.136 12:25:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:53.136 12:25:46 -- nvmf/common.sh@470 -- # waitforlisten 1219501 00:11:53.136 12:25:46 -- common/autotest_common.sh@819 -- # '[' -z 1219501 ']' 00:11:53.136 12:25:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:53.136 12:25:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:11:53.136 12:25:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:53.136 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:53.136 12:25:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:11:53.136 12:25:46 -- common/autotest_common.sh@10 -- # set +x 00:11:53.136 [2024-07-12 12:25:46.909282] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:11:53.136 [2024-07-12 12:25:46.909375] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:53.136 EAL: No free 2048 kB hugepages reported on node 1 00:11:53.136 [2024-07-12 12:25:46.979576] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:53.395 [2024-07-12 12:25:47.101276] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:53.395 [2024-07-12 12:25:47.101454] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:53.395 [2024-07-12 12:25:47.101484] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:53.395 [2024-07-12 12:25:47.101499] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:53.395 [2024-07-12 12:25:47.101562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:53.395 [2024-07-12 12:25:47.101591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:53.395 [2024-07-12 12:25:47.101641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:53.395 [2024-07-12 12:25:47.101644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:53.962 12:25:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:11:53.962 12:25:47 -- common/autotest_common.sh@852 -- # return 0 00:11:53.962 12:25:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:53.962 12:25:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:11:53.962 12:25:47 -- common/autotest_common.sh@10 -- # set +x 00:11:53.962 12:25:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:53.962 12:25:47 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:53.962 12:25:47 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode2678 00:11:54.220 [2024-07-12 12:25:48.070870] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:54.220 12:25:48 -- target/invalid.sh@40 -- # out='request: 00:11:54.220 { 00:11:54.220 "nqn": "nqn.2016-06.io.spdk:cnode2678", 00:11:54.220 "tgt_name": "foobar", 00:11:54.220 "method": "nvmf_create_subsystem", 00:11:54.220 "req_id": 1 00:11:54.220 } 00:11:54.220 Got JSON-RPC error response 00:11:54.220 response: 00:11:54.220 { 00:11:54.220 "code": -32603, 00:11:54.220 "message": "Unable to find target foobar" 00:11:54.220 }' 00:11:54.220 12:25:48 -- target/invalid.sh@41 -- # [[ request: 00:11:54.220 { 00:11:54.220 "nqn": "nqn.2016-06.io.spdk:cnode2678", 00:11:54.220 "tgt_name": "foobar", 00:11:54.220 "method": "nvmf_create_subsystem", 00:11:54.220 "req_id": 1 00:11:54.220 } 00:11:54.220 Got JSON-RPC error response 00:11:54.220 response: 00:11:54.220 { 00:11:54.220 "code": -32603, 00:11:54.221 "message": "Unable to find target foobar" 00:11:54.221 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:54.221 12:25:48 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:54.221 12:25:48 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode20543 00:11:54.478 [2024-07-12 12:25:48.311732] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20543: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:54.478 12:25:48 -- target/invalid.sh@45 -- # out='request: 00:11:54.478 { 00:11:54.478 "nqn": "nqn.2016-06.io.spdk:cnode20543", 00:11:54.478 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:54.478 "method": "nvmf_create_subsystem", 00:11:54.478 "req_id": 1 00:11:54.478 } 00:11:54.478 Got JSON-RPC error response 00:11:54.478 response: 00:11:54.478 { 00:11:54.478 "code": -32602, 00:11:54.478 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:54.478 }' 00:11:54.478 12:25:48 -- target/invalid.sh@46 -- # [[ request: 00:11:54.478 { 00:11:54.478 "nqn": "nqn.2016-06.io.spdk:cnode20543", 00:11:54.478 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:11:54.478 "method": "nvmf_create_subsystem", 00:11:54.478 "req_id": 1 00:11:54.478 } 00:11:54.478 Got JSON-RPC error response 00:11:54.478 response: 00:11:54.478 { 00:11:54.478 "code": -32602, 00:11:54.478 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:11:54.478 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:54.478 12:25:48 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:54.478 12:25:48 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode16272 00:11:54.737 [2024-07-12 12:25:48.572592] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16272: invalid model number 'SPDK_Controller' 00:11:54.737 12:25:48 -- target/invalid.sh@50 -- # out='request: 00:11:54.737 { 00:11:54.737 "nqn": "nqn.2016-06.io.spdk:cnode16272", 00:11:54.737 "model_number": "SPDK_Controller\u001f", 00:11:54.737 "method": "nvmf_create_subsystem", 00:11:54.737 "req_id": 1 00:11:54.737 } 00:11:54.737 Got JSON-RPC error response 00:11:54.737 response: 00:11:54.737 { 00:11:54.737 "code": -32602, 00:11:54.737 "message": "Invalid MN SPDK_Controller\u001f" 00:11:54.737 }' 00:11:54.737 12:25:48 -- target/invalid.sh@51 -- # [[ request: 00:11:54.737 { 00:11:54.737 "nqn": "nqn.2016-06.io.spdk:cnode16272", 00:11:54.737 "model_number": "SPDK_Controller\u001f", 00:11:54.737 "method": "nvmf_create_subsystem", 00:11:54.737 "req_id": 1 00:11:54.737 } 00:11:54.737 Got JSON-RPC error response 00:11:54.737 response: 00:11:54.737 { 00:11:54.737 "code": -32602, 00:11:54.737 "message": "Invalid MN SPDK_Controller\u001f" 00:11:54.737 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:54.737 12:25:48 -- target/invalid.sh@54 -- # gen_random_s 21 00:11:54.737 12:25:48 -- target/invalid.sh@19 -- # local length=21 ll 00:11:54.737 12:25:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:54.737 12:25:48 -- target/invalid.sh@21 -- # local chars 00:11:54.737 12:25:48 -- target/invalid.sh@22 -- # local string 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 103 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+=g 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 121 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+=y 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 43 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+=+ 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 56 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x38' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+=8 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 123 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+='{' 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 85 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x55' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+=U 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # printf %x 70 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x46' 00:11:54.737 12:25:48 -- target/invalid.sh@25 -- # string+=F 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.737 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 34 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x22' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+='"' 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 75 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+=K 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 75 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+=K 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 38 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x26' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+='&' 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 102 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x66' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+=f 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 113 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x71' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+=q 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 78 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+=N 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 99 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x63' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+=c 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 62 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # string+='>' 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.738 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # printf %x 105 00:11:54.738 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x69' 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # string+=i 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # printf %x 121 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x79' 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # string+=y 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # printf %x 114 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x72' 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # string+=r 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # printf %x 81 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x51' 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # string+=Q 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # printf %x 94 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:11:54.996 12:25:48 -- target/invalid.sh@25 -- # string+='^' 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:54.996 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:54.996 12:25:48 -- target/invalid.sh@28 -- # [[ g == \- ]] 00:11:54.996 12:25:48 -- target/invalid.sh@31 -- # echo 'gy+8{UF"KK&fqNc>iyrQ^' 00:11:54.996 12:25:48 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'gy+8{UF"KK&fqNc>iyrQ^' nqn.2016-06.io.spdk:cnode351 00:11:54.996 [2024-07-12 12:25:48.901637] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode351: invalid serial number 'gy+8{UF"KK&fqNc>iyrQ^' 00:11:55.255 12:25:48 -- target/invalid.sh@54 -- # out='request: 00:11:55.255 { 00:11:55.255 "nqn": "nqn.2016-06.io.spdk:cnode351", 00:11:55.255 "serial_number": "gy+8{UF\"KK&fqNc>iyrQ^", 00:11:55.255 "method": "nvmf_create_subsystem", 00:11:55.255 "req_id": 1 00:11:55.255 } 00:11:55.255 Got JSON-RPC error response 00:11:55.255 response: 00:11:55.255 { 00:11:55.255 "code": -32602, 00:11:55.255 "message": "Invalid SN gy+8{UF\"KK&fqNc>iyrQ^" 00:11:55.255 }' 00:11:55.255 12:25:48 -- target/invalid.sh@55 -- # [[ request: 00:11:55.255 { 00:11:55.255 "nqn": "nqn.2016-06.io.spdk:cnode351", 00:11:55.255 "serial_number": "gy+8{UF\"KK&fqNc>iyrQ^", 00:11:55.255 "method": "nvmf_create_subsystem", 00:11:55.255 "req_id": 1 00:11:55.255 } 00:11:55.255 Got JSON-RPC error response 00:11:55.255 response: 00:11:55.255 { 00:11:55.255 "code": -32602, 00:11:55.255 "message": "Invalid SN gy+8{UF\"KK&fqNc>iyrQ^" 00:11:55.255 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:55.255 12:25:48 -- target/invalid.sh@58 -- # gen_random_s 41 00:11:55.255 12:25:48 -- target/invalid.sh@19 -- # local length=41 ll 00:11:55.255 12:25:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:55.255 12:25:48 -- target/invalid.sh@21 -- # local chars 00:11:55.255 12:25:48 -- target/invalid.sh@22 -- # local string 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 78 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=N 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 125 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='}' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 92 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='\' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 93 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=']' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 106 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=j 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 118 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=v 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 111 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=o 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 60 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='<' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 36 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x24' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='$' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 60 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='<' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 64 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x40' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=@ 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 60 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='<' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 103 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x67' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=g 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 109 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=m 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 72 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=H 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 39 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x27' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=\' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 43 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=+ 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 92 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='\' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 127 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=$'\177' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 88 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x58' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=X 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 94 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+='^' 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 101 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x65' 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # string+=e 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.255 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.255 12:25:48 -- target/invalid.sh@25 -- # printf %x 96 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+='`' 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # printf %x 79 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+=O 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # printf %x 57 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x39' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+=9 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # printf %x 42 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+='*' 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # printf %x 80 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+=P 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # printf %x 108 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+=l 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # printf %x 88 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # echo -e '\x58' 00:11:55.256 12:25:48 -- target/invalid.sh@25 -- # string+=X 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 50 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x32' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=2 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 42 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+='*' 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 84 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=T 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 124 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+='|' 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 113 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x71' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=q 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 51 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x33' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=3 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 87 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x57' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=W 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 46 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=. 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 52 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x34' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=4 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 37 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x25' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=% 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 87 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x57' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+=W 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # printf %x 63 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:55.256 12:25:49 -- target/invalid.sh@25 -- # string+='?' 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:11:55.256 12:25:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:11:55.256 12:25:49 -- target/invalid.sh@28 -- # [[ N == \- ]] 00:11:55.256 12:25:49 -- target/invalid.sh@31 -- # echo 'N}\]jvo<$<@ /dev/null' 00:11:57.895 12:25:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:00.423 12:25:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:00.423 00:12:00.423 real 0m8.966s 00:12:00.423 user 0m21.926s 00:12:00.423 sys 0m2.297s 00:12:00.423 12:25:53 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:00.423 12:25:53 -- common/autotest_common.sh@10 -- # set +x 00:12:00.423 ************************************ 00:12:00.423 END TEST nvmf_invalid 00:12:00.423 ************************************ 00:12:00.423 12:25:53 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:00.423 12:25:53 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:00.423 12:25:53 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:00.423 12:25:53 -- common/autotest_common.sh@10 -- # set +x 00:12:00.423 ************************************ 00:12:00.423 START TEST nvmf_abort 00:12:00.423 ************************************ 00:12:00.423 12:25:53 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:00.423 * Looking for test storage... 00:12:00.423 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:00.423 12:25:53 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:00.423 12:25:53 -- nvmf/common.sh@7 -- # uname -s 00:12:00.423 12:25:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:00.423 12:25:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:00.423 12:25:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:00.423 12:25:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:00.423 12:25:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:00.423 12:25:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:00.423 12:25:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:00.423 12:25:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:00.423 12:25:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:00.423 12:25:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:00.423 12:25:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:00.423 12:25:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:00.423 12:25:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:00.423 12:25:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:00.423 12:25:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:00.423 12:25:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:00.423 12:25:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:00.423 12:25:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:00.423 12:25:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:00.423 12:25:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.423 12:25:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.423 12:25:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.423 12:25:53 -- paths/export.sh@5 -- # export PATH 00:12:00.423 12:25:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:00.423 12:25:53 -- nvmf/common.sh@46 -- # : 0 00:12:00.423 12:25:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:00.423 12:25:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:00.423 12:25:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:00.423 12:25:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:00.424 12:25:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:00.424 12:25:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:00.424 12:25:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:00.424 12:25:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:00.424 12:25:53 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:00.424 12:25:53 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:00.424 12:25:53 -- target/abort.sh@14 -- # nvmftestinit 00:12:00.424 12:25:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:00.424 12:25:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:00.424 12:25:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:00.424 12:25:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:00.424 12:25:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:00.424 12:25:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:00.424 12:25:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:00.424 12:25:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:00.424 12:25:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:00.424 12:25:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:00.424 12:25:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:00.424 12:25:53 -- common/autotest_common.sh@10 -- # set +x 00:12:02.345 12:25:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:02.345 12:25:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:02.346 12:25:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:02.346 12:25:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:02.346 12:25:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:02.346 12:25:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:02.346 12:25:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:02.346 12:25:55 -- nvmf/common.sh@294 -- # net_devs=() 00:12:02.346 12:25:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:02.346 12:25:55 -- nvmf/common.sh@295 -- # e810=() 00:12:02.346 12:25:55 -- nvmf/common.sh@295 -- # local -ga e810 00:12:02.346 12:25:55 -- nvmf/common.sh@296 -- # x722=() 00:12:02.346 12:25:55 -- nvmf/common.sh@296 -- # local -ga x722 00:12:02.346 12:25:55 -- nvmf/common.sh@297 -- # mlx=() 00:12:02.346 12:25:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:02.346 12:25:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:02.346 12:25:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:02.346 12:25:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:02.346 12:25:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:02.346 12:25:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:02.346 12:25:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:02.346 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:02.346 12:25:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:02.346 12:25:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:02.346 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:02.346 12:25:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:02.346 12:25:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:02.346 12:25:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.346 12:25:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:02.346 12:25:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.346 12:25:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:02.346 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:02.346 12:25:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.346 12:25:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:02.346 12:25:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:02.346 12:25:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:02.346 12:25:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:02.346 12:25:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:02.346 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:02.346 12:25:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:02.346 12:25:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:02.346 12:25:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:02.346 12:25:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:02.346 12:25:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:02.346 12:25:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:02.346 12:25:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:02.346 12:25:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:02.346 12:25:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:02.346 12:25:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:02.346 12:25:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:02.346 12:25:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:02.346 12:25:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:02.346 12:25:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:02.346 12:25:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:02.346 12:25:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:02.346 12:25:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:02.346 12:25:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:02.346 12:25:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:02.346 12:25:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:02.346 12:25:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:02.346 12:25:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:02.346 12:25:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:02.346 12:25:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:02.346 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:02.346 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:12:02.346 00:12:02.346 --- 10.0.0.2 ping statistics --- 00:12:02.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:02.346 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:12:02.346 12:25:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:02.346 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:02.346 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:12:02.346 00:12:02.346 --- 10.0.0.1 ping statistics --- 00:12:02.346 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:02.346 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:12:02.346 12:25:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:02.346 12:25:55 -- nvmf/common.sh@410 -- # return 0 00:12:02.346 12:25:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:02.346 12:25:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:02.346 12:25:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:02.346 12:25:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:02.346 12:25:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:02.346 12:25:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:02.346 12:25:55 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:02.346 12:25:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:02.346 12:25:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:02.346 12:25:55 -- common/autotest_common.sh@10 -- # set +x 00:12:02.346 12:25:55 -- nvmf/common.sh@469 -- # nvmfpid=1222170 00:12:02.346 12:25:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:02.346 12:25:55 -- nvmf/common.sh@470 -- # waitforlisten 1222170 00:12:02.346 12:25:55 -- common/autotest_common.sh@819 -- # '[' -z 1222170 ']' 00:12:02.346 12:25:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:02.346 12:25:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:02.346 12:25:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:02.346 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:02.346 12:25:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:02.346 12:25:55 -- common/autotest_common.sh@10 -- # set +x 00:12:02.346 [2024-07-12 12:25:55.969818] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:12:02.346 [2024-07-12 12:25:55.969927] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:02.346 EAL: No free 2048 kB hugepages reported on node 1 00:12:02.346 [2024-07-12 12:25:56.044695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:02.346 [2024-07-12 12:25:56.155096] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:02.346 [2024-07-12 12:25:56.155252] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:02.346 [2024-07-12 12:25:56.155270] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:02.346 [2024-07-12 12:25:56.155281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:02.346 [2024-07-12 12:25:56.155367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:02.346 [2024-07-12 12:25:56.155433] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:02.346 [2024-07-12 12:25:56.155437] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:03.279 12:25:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:03.279 12:25:56 -- common/autotest_common.sh@852 -- # return 0 00:12:03.279 12:25:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:03.279 12:25:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:03.279 12:25:56 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 12:25:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:03.279 12:25:56 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:03.279 12:25:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:56 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 [2024-07-12 12:25:56.999061] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:03.279 12:25:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:57 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 Malloc0 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:03.279 12:25:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:57 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 Delay0 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:03.279 12:25:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:57 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:03.279 12:25:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:57 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:03.279 12:25:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:57 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 [2024-07-12 12:25:57.065616] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:03.279 12:25:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:03.279 12:25:57 -- common/autotest_common.sh@10 -- # set +x 00:12:03.279 12:25:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:03.279 12:25:57 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:03.279 EAL: No free 2048 kB hugepages reported on node 1 00:12:03.279 [2024-07-12 12:25:57.160759] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:05.809 Initializing NVMe Controllers 00:12:05.809 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:05.809 controller IO queue size 128 less than required 00:12:05.809 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:05.809 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:05.809 Initialization complete. Launching workers. 00:12:05.809 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33862 00:12:05.809 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33923, failed to submit 62 00:12:05.809 success 33862, unsuccess 61, failed 0 00:12:05.809 12:25:59 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:05.809 12:25:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:05.809 12:25:59 -- common/autotest_common.sh@10 -- # set +x 00:12:05.809 12:25:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:05.809 12:25:59 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:05.809 12:25:59 -- target/abort.sh@38 -- # nvmftestfini 00:12:05.809 12:25:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:05.809 12:25:59 -- nvmf/common.sh@116 -- # sync 00:12:05.809 12:25:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:05.809 12:25:59 -- nvmf/common.sh@119 -- # set +e 00:12:05.809 12:25:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:05.809 12:25:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:05.809 rmmod nvme_tcp 00:12:05.809 rmmod nvme_fabrics 00:12:05.809 rmmod nvme_keyring 00:12:05.809 12:25:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:05.809 12:25:59 -- nvmf/common.sh@123 -- # set -e 00:12:05.809 12:25:59 -- nvmf/common.sh@124 -- # return 0 00:12:05.809 12:25:59 -- nvmf/common.sh@477 -- # '[' -n 1222170 ']' 00:12:05.809 12:25:59 -- nvmf/common.sh@478 -- # killprocess 1222170 00:12:05.809 12:25:59 -- common/autotest_common.sh@926 -- # '[' -z 1222170 ']' 00:12:05.809 12:25:59 -- common/autotest_common.sh@930 -- # kill -0 1222170 00:12:05.809 12:25:59 -- common/autotest_common.sh@931 -- # uname 00:12:05.809 12:25:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:05.809 12:25:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1222170 00:12:05.809 12:25:59 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:05.809 12:25:59 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:05.809 12:25:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1222170' 00:12:05.809 killing process with pid 1222170 00:12:05.809 12:25:59 -- common/autotest_common.sh@945 -- # kill 1222170 00:12:05.809 12:25:59 -- common/autotest_common.sh@950 -- # wait 1222170 00:12:05.809 12:25:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:05.809 12:25:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:05.809 12:25:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:05.809 12:25:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:05.809 12:25:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:05.809 12:25:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:05.809 12:25:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:05.809 12:25:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:08.347 12:26:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:08.347 00:12:08.347 real 0m7.944s 00:12:08.347 user 0m12.993s 00:12:08.347 sys 0m2.462s 00:12:08.347 12:26:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:08.347 12:26:01 -- common/autotest_common.sh@10 -- # set +x 00:12:08.347 ************************************ 00:12:08.347 END TEST nvmf_abort 00:12:08.347 ************************************ 00:12:08.347 12:26:01 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:08.347 12:26:01 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:08.347 12:26:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:08.347 12:26:01 -- common/autotest_common.sh@10 -- # set +x 00:12:08.347 ************************************ 00:12:08.347 START TEST nvmf_ns_hotplug_stress 00:12:08.347 ************************************ 00:12:08.347 12:26:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:08.347 * Looking for test storage... 00:12:08.347 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:08.347 12:26:01 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:08.347 12:26:01 -- nvmf/common.sh@7 -- # uname -s 00:12:08.347 12:26:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:08.347 12:26:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:08.347 12:26:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:08.347 12:26:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:08.347 12:26:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:08.348 12:26:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:08.348 12:26:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:08.348 12:26:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:08.348 12:26:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:08.348 12:26:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:08.348 12:26:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:08.348 12:26:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:08.348 12:26:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:08.348 12:26:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:08.348 12:26:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:08.348 12:26:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:08.348 12:26:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:08.348 12:26:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:08.348 12:26:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:08.348 12:26:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:08.348 12:26:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:08.348 12:26:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:08.348 12:26:01 -- paths/export.sh@5 -- # export PATH 00:12:08.348 12:26:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:08.348 12:26:01 -- nvmf/common.sh@46 -- # : 0 00:12:08.348 12:26:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:08.348 12:26:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:08.348 12:26:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:08.348 12:26:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:08.348 12:26:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:08.348 12:26:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:08.348 12:26:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:08.348 12:26:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:08.348 12:26:01 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:08.348 12:26:01 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:08.348 12:26:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:08.348 12:26:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:08.348 12:26:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:08.348 12:26:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:08.348 12:26:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:08.348 12:26:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:08.348 12:26:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:08.348 12:26:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:08.348 12:26:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:08.348 12:26:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:08.348 12:26:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:08.348 12:26:01 -- common/autotest_common.sh@10 -- # set +x 00:12:10.248 12:26:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:10.248 12:26:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:10.248 12:26:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:10.248 12:26:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:10.248 12:26:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:10.248 12:26:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:10.248 12:26:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:10.248 12:26:03 -- nvmf/common.sh@294 -- # net_devs=() 00:12:10.248 12:26:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:10.248 12:26:03 -- nvmf/common.sh@295 -- # e810=() 00:12:10.248 12:26:03 -- nvmf/common.sh@295 -- # local -ga e810 00:12:10.248 12:26:03 -- nvmf/common.sh@296 -- # x722=() 00:12:10.248 12:26:03 -- nvmf/common.sh@296 -- # local -ga x722 00:12:10.248 12:26:03 -- nvmf/common.sh@297 -- # mlx=() 00:12:10.248 12:26:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:10.248 12:26:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:10.248 12:26:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:10.248 12:26:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:10.248 12:26:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:10.248 12:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:10.248 12:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:10.248 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:10.248 12:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:10.248 12:26:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:10.248 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:10.248 12:26:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:10.248 12:26:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:10.248 12:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:10.248 12:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:10.248 12:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:10.248 12:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:10.249 12:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:10.249 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:10.249 12:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:10.249 12:26:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:10.249 12:26:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:10.249 12:26:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:10.249 12:26:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:10.249 12:26:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:10.249 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:10.249 12:26:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:10.249 12:26:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:10.249 12:26:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:10.249 12:26:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:10.249 12:26:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:10.249 12:26:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:10.249 12:26:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:10.249 12:26:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:10.249 12:26:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:10.249 12:26:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:10.249 12:26:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:10.249 12:26:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:10.249 12:26:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:10.249 12:26:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:10.249 12:26:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:10.249 12:26:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:10.249 12:26:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:10.249 12:26:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:10.249 12:26:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:10.249 12:26:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:10.249 12:26:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:10.249 12:26:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:10.249 12:26:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:10.249 12:26:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:10.249 12:26:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:10.249 12:26:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:10.249 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:10.249 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.122 ms 00:12:10.249 00:12:10.249 --- 10.0.0.2 ping statistics --- 00:12:10.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:10.249 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:12:10.249 12:26:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:10.249 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:10.249 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:12:10.249 00:12:10.249 --- 10.0.0.1 ping statistics --- 00:12:10.249 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:10.249 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:12:10.249 12:26:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:10.249 12:26:03 -- nvmf/common.sh@410 -- # return 0 00:12:10.249 12:26:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:10.249 12:26:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:10.249 12:26:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:10.249 12:26:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:10.249 12:26:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:10.249 12:26:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:10.249 12:26:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:10.249 12:26:04 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:10.249 12:26:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:10.249 12:26:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:10.249 12:26:04 -- common/autotest_common.sh@10 -- # set +x 00:12:10.249 12:26:04 -- nvmf/common.sh@469 -- # nvmfpid=1224546 00:12:10.249 12:26:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:10.249 12:26:04 -- nvmf/common.sh@470 -- # waitforlisten 1224546 00:12:10.249 12:26:04 -- common/autotest_common.sh@819 -- # '[' -z 1224546 ']' 00:12:10.249 12:26:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:10.249 12:26:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:10.249 12:26:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:10.249 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:10.249 12:26:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:10.249 12:26:04 -- common/autotest_common.sh@10 -- # set +x 00:12:10.249 [2024-07-12 12:26:04.072293] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:12:10.249 [2024-07-12 12:26:04.072387] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:10.249 EAL: No free 2048 kB hugepages reported on node 1 00:12:10.249 [2024-07-12 12:26:04.135942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:10.508 [2024-07-12 12:26:04.248794] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:10.508 [2024-07-12 12:26:04.248958] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:10.508 [2024-07-12 12:26:04.248978] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:10.508 [2024-07-12 12:26:04.248992] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:10.508 [2024-07-12 12:26:04.249056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:10.508 [2024-07-12 12:26:04.249114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:10.508 [2024-07-12 12:26:04.249117] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:11.442 12:26:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:11.442 12:26:05 -- common/autotest_common.sh@852 -- # return 0 00:12:11.442 12:26:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:11.442 12:26:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:11.442 12:26:05 -- common/autotest_common.sh@10 -- # set +x 00:12:11.442 12:26:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:11.442 12:26:05 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:11.442 12:26:05 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:11.442 [2024-07-12 12:26:05.334832] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:11.442 12:26:05 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:11.700 12:26:05 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:11.960 [2024-07-12 12:26:05.866143] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.218 12:26:05 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:12.501 12:26:06 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:12.758 Malloc0 00:12:12.758 12:26:06 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:13.016 Delay0 00:12:13.016 12:26:06 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:13.275 12:26:06 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:13.275 NULL1 00:12:13.534 12:26:07 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:13.534 12:26:07 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1224984 00:12:13.534 12:26:07 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:13.534 12:26:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:13.534 12:26:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:13.792 EAL: No free 2048 kB hugepages reported on node 1 00:12:13.792 12:26:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.050 12:26:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:14.050 12:26:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:14.307 true 00:12:14.307 12:26:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:14.307 12:26:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:14.565 12:26:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:14.823 12:26:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:14.823 12:26:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:15.081 true 00:12:15.081 12:26:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:15.081 12:26:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.015 Read completed with error (sct=0, sc=11) 00:12:16.015 12:26:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:16.015 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:16.015 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:16.015 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:16.272 12:26:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:16.272 12:26:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:16.529 true 00:12:16.529 12:26:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:16.529 12:26:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:16.786 12:26:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:17.044 12:26:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:17.044 12:26:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:17.301 true 00:12:17.301 12:26:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:17.301 12:26:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:18.267 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.267 12:26:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:18.267 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.267 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.267 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.524 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.524 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.524 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.525 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:18.525 12:26:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:18.525 12:26:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:18.781 true 00:12:18.781 12:26:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:18.781 12:26:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:19.714 12:26:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:19.714 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:19.714 12:26:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:19.714 12:26:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:19.970 true 00:12:19.970 12:26:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:19.970 12:26:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:20.227 12:26:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:20.484 12:26:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:20.484 12:26:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:20.741 true 00:12:20.741 12:26:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:20.741 12:26:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.673 12:26:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:21.931 12:26:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:21.931 12:26:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:22.189 true 00:12:22.189 12:26:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:22.189 12:26:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:22.447 12:26:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:22.705 12:26:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:22.705 12:26:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:22.963 true 00:12:22.963 12:26:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:22.963 12:26:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:23.901 12:26:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:23.901 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:23.901 12:26:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:23.901 12:26:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:24.159 true 00:12:24.159 12:26:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:24.159 12:26:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:24.417 12:26:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:24.674 12:26:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:24.674 12:26:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:24.932 true 00:12:24.932 12:26:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:24.932 12:26:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:25.866 12:26:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.124 12:26:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:26.124 12:26:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:26.383 true 00:12:26.383 12:26:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:26.383 12:26:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:26.641 12:26:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:26.899 12:26:20 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:26.899 12:26:20 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:27.157 true 00:12:27.157 12:26:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:27.157 12:26:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:28.093 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.093 12:26:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:28.093 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.093 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.093 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:28.093 12:26:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:28.093 12:26:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:28.351 true 00:12:28.351 12:26:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:28.351 12:26:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:28.609 12:26:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:28.866 12:26:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:28.866 12:26:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:29.124 true 00:12:29.124 12:26:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:29.124 12:26:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.056 12:26:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:30.056 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:30.313 12:26:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:30.313 12:26:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:30.570 true 00:12:30.570 12:26:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:30.570 12:26:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:30.827 12:26:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:31.084 12:26:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:31.084 12:26:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:31.342 true 00:12:31.342 12:26:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:31.342 12:26:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:32.276 12:26:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:32.534 12:26:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:12:32.534 12:26:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:12:32.792 true 00:12:32.792 12:26:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:32.792 12:26:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:33.050 12:26:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:33.308 12:26:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:12:33.308 12:26:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:12:33.567 true 00:12:33.567 12:26:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:33.567 12:26:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:34.503 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.503 12:26:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:34.503 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:34.760 12:26:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:12:34.760 12:26:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:12:34.760 true 00:12:34.760 12:26:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:34.760 12:26:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:35.017 12:26:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:35.274 12:26:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:12:35.274 12:26:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:12:35.533 true 00:12:35.533 12:26:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:35.533 12:26:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:36.509 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:36.510 12:26:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:36.767 12:26:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:12:36.767 12:26:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:12:37.024 true 00:12:37.024 12:26:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:37.024 12:26:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:37.282 12:26:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:37.540 12:26:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:12:37.540 12:26:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:12:37.540 true 00:12:37.799 12:26:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:37.799 12:26:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:38.737 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.737 12:26:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:38.737 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:38.994 12:26:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:12:38.994 12:26:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:12:39.251 true 00:12:39.251 12:26:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:39.251 12:26:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:39.251 12:26:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:39.507 12:26:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:12:39.507 12:26:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:12:39.764 true 00:12:39.764 12:26:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:39.764 12:26:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:40.694 12:26:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.951 12:26:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:12:40.951 12:26:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:12:41.208 true 00:12:41.208 12:26:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:41.209 12:26:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.465 12:26:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:41.723 12:26:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:12:41.723 12:26:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:12:41.980 true 00:12:41.980 12:26:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:41.980 12:26:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:42.912 12:26:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.912 12:26:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:12:42.912 12:26:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:12:43.169 true 00:12:43.169 12:26:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:43.169 12:26:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.427 12:26:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.685 12:26:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:12:43.685 12:26:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:12:43.943 true 00:12:43.943 12:26:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:43.943 12:26:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.876 Initializing NVMe Controllers 00:12:44.876 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:12:44.876 Controller IO queue size 128, less than required. 00:12:44.876 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:44.876 Controller IO queue size 128, less than required. 00:12:44.876 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:44.876 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:12:44.876 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:12:44.876 Initialization complete. Launching workers. 00:12:44.876 ======================================================== 00:12:44.876 Latency(us) 00:12:44.876 Device Information : IOPS MiB/s Average min max 00:12:44.876 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 843.32 0.41 84719.40 1805.30 1088256.26 00:12:44.876 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 12133.09 5.92 10518.73 1564.76 443616.74 00:12:44.876 ======================================================== 00:12:44.876 Total : 12976.41 6.34 15340.95 1564.76 1088256.26 00:12:44.876 00:12:44.876 12:26:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.134 12:26:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:12:45.134 12:26:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:12:45.392 true 00:12:45.392 12:26:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1224984 00:12:45.392 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1224984) - No such process 00:12:45.392 12:26:39 -- target/ns_hotplug_stress.sh@53 -- # wait 1224984 00:12:45.392 12:26:39 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.649 12:26:39 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:45.908 12:26:39 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:12:45.908 12:26:39 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:12:45.908 12:26:39 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:12:45.908 12:26:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:45.908 12:26:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:12:46.166 null0 00:12:46.166 12:26:39 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.166 12:26:39 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.166 12:26:39 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:12:46.424 null1 00:12:46.424 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.424 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.424 12:26:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:12:46.424 null2 00:12:46.682 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.682 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.682 12:26:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:12:46.682 null3 00:12:46.682 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.682 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.682 12:26:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:12:46.940 null4 00:12:46.940 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:46.940 12:26:40 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:46.940 12:26:40 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:12:47.197 null5 00:12:47.198 12:26:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:47.198 12:26:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:47.198 12:26:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:12:47.454 null6 00:12:47.454 12:26:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:47.454 12:26:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:47.454 12:26:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:12:47.711 null7 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@66 -- # wait 1229300 1229301 1229302 1229305 1229307 1229309 1229311 1229313 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:47.711 12:26:41 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:47.970 12:26:41 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.228 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:48.486 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:48.744 12:26:42 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.001 12:26:42 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.260 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.261 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:49.524 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:49.783 12:26:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:50.042 12:26:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.298 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:50.556 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:50.813 12:26:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:51.070 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:51.070 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.070 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:51.070 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:51.070 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:51.070 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:51.071 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:51.071 12:26:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.329 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:51.586 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:51.844 12:26:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:52.102 12:26:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.392 12:26:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:12:52.650 12:26:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:12:52.909 12:26:46 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:12:52.909 12:26:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:52.909 12:26:46 -- nvmf/common.sh@116 -- # sync 00:12:52.909 12:26:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:52.909 12:26:46 -- nvmf/common.sh@119 -- # set +e 00:12:52.909 12:26:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:52.909 12:26:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:52.909 rmmod nvme_tcp 00:12:52.909 rmmod nvme_fabrics 00:12:52.909 rmmod nvme_keyring 00:12:52.909 12:26:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:52.909 12:26:46 -- nvmf/common.sh@123 -- # set -e 00:12:52.909 12:26:46 -- nvmf/common.sh@124 -- # return 0 00:12:52.909 12:26:46 -- nvmf/common.sh@477 -- # '[' -n 1224546 ']' 00:12:52.909 12:26:46 -- nvmf/common.sh@478 -- # killprocess 1224546 00:12:52.909 12:26:46 -- common/autotest_common.sh@926 -- # '[' -z 1224546 ']' 00:12:52.909 12:26:46 -- common/autotest_common.sh@930 -- # kill -0 1224546 00:12:52.909 12:26:46 -- common/autotest_common.sh@931 -- # uname 00:12:52.909 12:26:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:12:52.909 12:26:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1224546 00:12:52.909 12:26:46 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:12:52.909 12:26:46 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:12:52.909 12:26:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1224546' 00:12:52.909 killing process with pid 1224546 00:12:52.909 12:26:46 -- common/autotest_common.sh@945 -- # kill 1224546 00:12:52.909 12:26:46 -- common/autotest_common.sh@950 -- # wait 1224546 00:12:53.476 12:26:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:53.476 12:26:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:53.476 12:26:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:53.476 12:26:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:53.476 12:26:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:53.476 12:26:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:53.476 12:26:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:53.476 12:26:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:55.379 12:26:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:55.379 00:12:55.379 real 0m47.403s 00:12:55.379 user 3m32.994s 00:12:55.379 sys 0m16.022s 00:12:55.379 12:26:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:12:55.379 12:26:49 -- common/autotest_common.sh@10 -- # set +x 00:12:55.379 ************************************ 00:12:55.379 END TEST nvmf_ns_hotplug_stress 00:12:55.379 ************************************ 00:12:55.379 12:26:49 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:55.379 12:26:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:12:55.379 12:26:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:12:55.379 12:26:49 -- common/autotest_common.sh@10 -- # set +x 00:12:55.379 ************************************ 00:12:55.379 START TEST nvmf_connect_stress 00:12:55.379 ************************************ 00:12:55.379 12:26:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:12:55.379 * Looking for test storage... 00:12:55.379 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:55.379 12:26:49 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:55.379 12:26:49 -- nvmf/common.sh@7 -- # uname -s 00:12:55.380 12:26:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:55.380 12:26:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:55.380 12:26:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:55.380 12:26:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:55.380 12:26:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:55.380 12:26:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:55.380 12:26:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:55.380 12:26:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:55.380 12:26:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:55.380 12:26:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:55.380 12:26:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:55.380 12:26:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:55.380 12:26:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:55.380 12:26:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:55.380 12:26:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:55.380 12:26:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:55.380 12:26:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:55.380 12:26:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:55.380 12:26:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:55.380 12:26:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.380 12:26:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.380 12:26:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.380 12:26:49 -- paths/export.sh@5 -- # export PATH 00:12:55.380 12:26:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:55.380 12:26:49 -- nvmf/common.sh@46 -- # : 0 00:12:55.380 12:26:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:55.380 12:26:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:55.380 12:26:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:55.380 12:26:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:55.380 12:26:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:55.380 12:26:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:55.380 12:26:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:55.380 12:26:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:55.380 12:26:49 -- target/connect_stress.sh@12 -- # nvmftestinit 00:12:55.380 12:26:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:55.380 12:26:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:55.380 12:26:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:55.380 12:26:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:55.380 12:26:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:55.380 12:26:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:55.380 12:26:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:55.380 12:26:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:55.380 12:26:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:55.380 12:26:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:55.380 12:26:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:55.380 12:26:49 -- common/autotest_common.sh@10 -- # set +x 00:12:57.282 12:26:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:57.282 12:26:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:57.282 12:26:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:57.282 12:26:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:57.282 12:26:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:57.282 12:26:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:57.282 12:26:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:57.282 12:26:51 -- nvmf/common.sh@294 -- # net_devs=() 00:12:57.282 12:26:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:57.282 12:26:51 -- nvmf/common.sh@295 -- # e810=() 00:12:57.282 12:26:51 -- nvmf/common.sh@295 -- # local -ga e810 00:12:57.282 12:26:51 -- nvmf/common.sh@296 -- # x722=() 00:12:57.282 12:26:51 -- nvmf/common.sh@296 -- # local -ga x722 00:12:57.282 12:26:51 -- nvmf/common.sh@297 -- # mlx=() 00:12:57.282 12:26:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:57.282 12:26:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:57.282 12:26:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:57.282 12:26:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:57.282 12:26:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:57.282 12:26:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:57.282 12:26:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:57.282 12:26:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:57.282 12:26:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:57.282 12:26:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:57.282 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:57.283 12:26:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:57.283 12:26:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:57.283 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:57.283 12:26:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:57.283 12:26:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:57.283 12:26:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.283 12:26:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:57.283 12:26:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.283 12:26:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:57.283 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:57.283 12:26:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.283 12:26:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:57.283 12:26:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:57.283 12:26:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:57.283 12:26:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:57.283 12:26:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:57.283 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:57.283 12:26:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:57.283 12:26:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:57.283 12:26:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:57.283 12:26:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:57.283 12:26:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:57.283 12:26:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:57.283 12:26:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:57.283 12:26:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:57.283 12:26:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:57.283 12:26:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:57.283 12:26:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:57.283 12:26:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:57.283 12:26:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:57.283 12:26:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:57.283 12:26:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:57.283 12:26:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:57.283 12:26:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:57.283 12:26:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:57.283 12:26:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:57.283 12:26:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:57.283 12:26:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:57.283 12:26:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:57.540 12:26:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:57.540 12:26:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:57.540 12:26:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:57.540 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:57.540 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.103 ms 00:12:57.540 00:12:57.540 --- 10.0.0.2 ping statistics --- 00:12:57.540 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:57.540 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:12:57.540 12:26:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:57.540 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:57.540 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:12:57.540 00:12:57.540 --- 10.0.0.1 ping statistics --- 00:12:57.540 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:57.540 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:12:57.540 12:26:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:57.541 12:26:51 -- nvmf/common.sh@410 -- # return 0 00:12:57.541 12:26:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:57.541 12:26:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:57.541 12:26:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:57.541 12:26:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:57.541 12:26:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:57.541 12:26:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:57.541 12:26:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:57.541 12:26:51 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:12:57.541 12:26:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:57.541 12:26:51 -- common/autotest_common.sh@712 -- # xtrace_disable 00:12:57.541 12:26:51 -- common/autotest_common.sh@10 -- # set +x 00:12:57.541 12:26:51 -- nvmf/common.sh@469 -- # nvmfpid=1232085 00:12:57.541 12:26:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:57.541 12:26:51 -- nvmf/common.sh@470 -- # waitforlisten 1232085 00:12:57.541 12:26:51 -- common/autotest_common.sh@819 -- # '[' -z 1232085 ']' 00:12:57.541 12:26:51 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:57.541 12:26:51 -- common/autotest_common.sh@824 -- # local max_retries=100 00:12:57.541 12:26:51 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:57.541 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:57.541 12:26:51 -- common/autotest_common.sh@828 -- # xtrace_disable 00:12:57.541 12:26:51 -- common/autotest_common.sh@10 -- # set +x 00:12:57.541 [2024-07-12 12:26:51.294630] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:12:57.541 [2024-07-12 12:26:51.294695] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:57.541 EAL: No free 2048 kB hugepages reported on node 1 00:12:57.541 [2024-07-12 12:26:51.359847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:57.798 [2024-07-12 12:26:51.474185] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:57.798 [2024-07-12 12:26:51.474356] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:57.798 [2024-07-12 12:26:51.474376] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:57.798 [2024-07-12 12:26:51.474391] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:57.798 [2024-07-12 12:26:51.474472] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:57.798 [2024-07-12 12:26:51.474588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:57.798 [2024-07-12 12:26:51.474591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:58.364 12:26:52 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:12:58.364 12:26:52 -- common/autotest_common.sh@852 -- # return 0 00:12:58.364 12:26:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:58.364 12:26:52 -- common/autotest_common.sh@718 -- # xtrace_disable 00:12:58.364 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:58.364 12:26:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:58.364 12:26:52 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:58.364 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:58.364 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:58.364 [2024-07-12 12:26:52.257464] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:58.364 12:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:58.364 12:26:52 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:58.364 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:58.364 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:58.364 12:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:58.364 12:26:52 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:58.364 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:58.364 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:58.622 [2024-07-12 12:26:52.295045] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:58.622 12:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:58.622 12:26:52 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:12:58.622 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:58.622 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:58.622 NULL1 00:12:58.622 12:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:58.622 12:26:52 -- target/connect_stress.sh@21 -- # PERF_PID=1232159 00:12:58.622 12:26:52 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:12:58.622 12:26:52 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:58.622 12:26:52 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # seq 1 20 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 EAL: No free 2048 kB hugepages reported on node 1 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:12:58.622 12:26:52 -- target/connect_stress.sh@28 -- # cat 00:12:58.622 12:26:52 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:12:58.622 12:26:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.622 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:58.622 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:58.880 12:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:58.880 12:26:52 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:12:58.880 12:26:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:58.880 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:58.880 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:59.138 12:26:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.138 12:26:52 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:12:59.138 12:26:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.138 12:26:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.138 12:26:52 -- common/autotest_common.sh@10 -- # set +x 00:12:59.701 12:26:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.701 12:26:53 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:12:59.701 12:26:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.701 12:26:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.701 12:26:53 -- common/autotest_common.sh@10 -- # set +x 00:12:59.958 12:26:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:12:59.958 12:26:53 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:12:59.958 12:26:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:12:59.958 12:26:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:12:59.958 12:26:53 -- common/autotest_common.sh@10 -- # set +x 00:13:00.216 12:26:53 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.216 12:26:53 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:00.216 12:26:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.216 12:26:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.216 12:26:53 -- common/autotest_common.sh@10 -- # set +x 00:13:00.473 12:26:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.473 12:26:54 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:00.473 12:26:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.473 12:26:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.473 12:26:54 -- common/autotest_common.sh@10 -- # set +x 00:13:00.731 12:26:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:00.731 12:26:54 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:00.731 12:26:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:00.731 12:26:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:00.731 12:26:54 -- common/autotest_common.sh@10 -- # set +x 00:13:01.296 12:26:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:01.296 12:26:54 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:01.296 12:26:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.296 12:26:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:01.296 12:26:54 -- common/autotest_common.sh@10 -- # set +x 00:13:01.554 12:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:01.554 12:26:55 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:01.554 12:26:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.554 12:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:01.554 12:26:55 -- common/autotest_common.sh@10 -- # set +x 00:13:01.811 12:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:01.811 12:26:55 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:01.811 12:26:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:01.812 12:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:01.812 12:26:55 -- common/autotest_common.sh@10 -- # set +x 00:13:02.069 12:26:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.069 12:26:55 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:02.069 12:26:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.069 12:26:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.069 12:26:55 -- common/autotest_common.sh@10 -- # set +x 00:13:02.327 12:26:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.327 12:26:56 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:02.327 12:26:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.327 12:26:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.327 12:26:56 -- common/autotest_common.sh@10 -- # set +x 00:13:02.892 12:26:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:02.892 12:26:56 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:02.892 12:26:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:02.893 12:26:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:02.893 12:26:56 -- common/autotest_common.sh@10 -- # set +x 00:13:03.150 12:26:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:03.150 12:26:56 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:03.150 12:26:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.150 12:26:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:03.150 12:26:56 -- common/autotest_common.sh@10 -- # set +x 00:13:03.408 12:26:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:03.408 12:26:57 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:03.408 12:26:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.408 12:26:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:03.408 12:26:57 -- common/autotest_common.sh@10 -- # set +x 00:13:03.666 12:26:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:03.666 12:26:57 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:03.666 12:26:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.666 12:26:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:03.666 12:26:57 -- common/autotest_common.sh@10 -- # set +x 00:13:03.924 12:26:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:03.924 12:26:57 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:03.924 12:26:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:03.924 12:26:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:03.924 12:26:57 -- common/autotest_common.sh@10 -- # set +x 00:13:04.489 12:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:04.489 12:26:58 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:04.489 12:26:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.489 12:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:04.489 12:26:58 -- common/autotest_common.sh@10 -- # set +x 00:13:04.746 12:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:04.746 12:26:58 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:04.746 12:26:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:04.746 12:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:04.746 12:26:58 -- common/autotest_common.sh@10 -- # set +x 00:13:05.004 12:26:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.004 12:26:58 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:05.004 12:26:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.004 12:26:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.004 12:26:58 -- common/autotest_common.sh@10 -- # set +x 00:13:05.262 12:26:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.262 12:26:59 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:05.262 12:26:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.262 12:26:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.262 12:26:59 -- common/autotest_common.sh@10 -- # set +x 00:13:05.520 12:26:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:05.520 12:26:59 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:05.520 12:26:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:05.520 12:26:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:05.520 12:26:59 -- common/autotest_common.sh@10 -- # set +x 00:13:06.085 12:26:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.085 12:26:59 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:06.085 12:26:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.085 12:26:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.085 12:26:59 -- common/autotest_common.sh@10 -- # set +x 00:13:06.342 12:27:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.342 12:27:00 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:06.342 12:27:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.342 12:27:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.342 12:27:00 -- common/autotest_common.sh@10 -- # set +x 00:13:06.598 12:27:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.598 12:27:00 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:06.598 12:27:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.598 12:27:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.598 12:27:00 -- common/autotest_common.sh@10 -- # set +x 00:13:06.855 12:27:00 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:06.855 12:27:00 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:06.855 12:27:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:06.855 12:27:00 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:06.855 12:27:00 -- common/autotest_common.sh@10 -- # set +x 00:13:07.112 12:27:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:07.112 12:27:01 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:07.112 12:27:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.112 12:27:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:07.112 12:27:01 -- common/autotest_common.sh@10 -- # set +x 00:13:07.677 12:27:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:07.677 12:27:01 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:07.677 12:27:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.677 12:27:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:07.677 12:27:01 -- common/autotest_common.sh@10 -- # set +x 00:13:07.935 12:27:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:07.935 12:27:01 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:07.935 12:27:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:07.935 12:27:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:07.935 12:27:01 -- common/autotest_common.sh@10 -- # set +x 00:13:08.192 12:27:01 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.192 12:27:01 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:08.192 12:27:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.192 12:27:01 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.192 12:27:01 -- common/autotest_common.sh@10 -- # set +x 00:13:08.449 12:27:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.449 12:27:02 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:08.449 12:27:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:08.449 12:27:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:08.449 12:27:02 -- common/autotest_common.sh@10 -- # set +x 00:13:08.706 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:08.963 12:27:02 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:08.963 12:27:02 -- target/connect_stress.sh@34 -- # kill -0 1232159 00:13:08.963 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1232159) - No such process 00:13:08.963 12:27:02 -- target/connect_stress.sh@38 -- # wait 1232159 00:13:08.963 12:27:02 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:08.963 12:27:02 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:08.963 12:27:02 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:08.963 12:27:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:08.963 12:27:02 -- nvmf/common.sh@116 -- # sync 00:13:08.963 12:27:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:08.963 12:27:02 -- nvmf/common.sh@119 -- # set +e 00:13:08.963 12:27:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:08.963 12:27:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:08.963 rmmod nvme_tcp 00:13:08.963 rmmod nvme_fabrics 00:13:08.963 rmmod nvme_keyring 00:13:08.963 12:27:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:08.963 12:27:02 -- nvmf/common.sh@123 -- # set -e 00:13:08.963 12:27:02 -- nvmf/common.sh@124 -- # return 0 00:13:08.963 12:27:02 -- nvmf/common.sh@477 -- # '[' -n 1232085 ']' 00:13:08.963 12:27:02 -- nvmf/common.sh@478 -- # killprocess 1232085 00:13:08.963 12:27:02 -- common/autotest_common.sh@926 -- # '[' -z 1232085 ']' 00:13:08.963 12:27:02 -- common/autotest_common.sh@930 -- # kill -0 1232085 00:13:08.963 12:27:02 -- common/autotest_common.sh@931 -- # uname 00:13:08.963 12:27:02 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:08.963 12:27:02 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1232085 00:13:08.963 12:27:02 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:08.963 12:27:02 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:08.963 12:27:02 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1232085' 00:13:08.963 killing process with pid 1232085 00:13:08.963 12:27:02 -- common/autotest_common.sh@945 -- # kill 1232085 00:13:08.963 12:27:02 -- common/autotest_common.sh@950 -- # wait 1232085 00:13:09.221 12:27:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:09.221 12:27:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:09.221 12:27:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:09.221 12:27:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:09.221 12:27:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:09.221 12:27:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.221 12:27:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.221 12:27:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.131 12:27:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:11.131 00:13:11.131 real 0m15.853s 00:13:11.131 user 0m40.463s 00:13:11.131 sys 0m5.763s 00:13:11.131 12:27:05 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:11.131 12:27:05 -- common/autotest_common.sh@10 -- # set +x 00:13:11.131 ************************************ 00:13:11.131 END TEST nvmf_connect_stress 00:13:11.131 ************************************ 00:13:11.131 12:27:05 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:11.131 12:27:05 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:11.131 12:27:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:11.389 12:27:05 -- common/autotest_common.sh@10 -- # set +x 00:13:11.389 ************************************ 00:13:11.389 START TEST nvmf_fused_ordering 00:13:11.389 ************************************ 00:13:11.389 12:27:05 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:11.389 * Looking for test storage... 00:13:11.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:11.389 12:27:05 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:11.389 12:27:05 -- nvmf/common.sh@7 -- # uname -s 00:13:11.389 12:27:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:11.389 12:27:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:11.389 12:27:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:11.389 12:27:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:11.389 12:27:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:11.389 12:27:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:11.389 12:27:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:11.389 12:27:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:11.389 12:27:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:11.389 12:27:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:11.389 12:27:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.389 12:27:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.389 12:27:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:11.389 12:27:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:11.389 12:27:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:11.389 12:27:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:11.389 12:27:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:11.389 12:27:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:11.389 12:27:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:11.389 12:27:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.389 12:27:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.389 12:27:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.389 12:27:05 -- paths/export.sh@5 -- # export PATH 00:13:11.389 12:27:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.389 12:27:05 -- nvmf/common.sh@46 -- # : 0 00:13:11.389 12:27:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:11.389 12:27:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:11.389 12:27:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:11.389 12:27:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:11.389 12:27:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:11.389 12:27:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:11.389 12:27:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:11.389 12:27:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:11.389 12:27:05 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:11.389 12:27:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:11.389 12:27:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:11.389 12:27:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:11.389 12:27:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:11.389 12:27:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:11.389 12:27:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.389 12:27:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.389 12:27:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.389 12:27:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:11.389 12:27:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:11.389 12:27:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:11.389 12:27:05 -- common/autotest_common.sh@10 -- # set +x 00:13:13.289 12:27:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:13.289 12:27:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:13.289 12:27:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:13.289 12:27:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:13.289 12:27:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:13.289 12:27:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:13.289 12:27:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:13.289 12:27:07 -- nvmf/common.sh@294 -- # net_devs=() 00:13:13.289 12:27:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:13.289 12:27:07 -- nvmf/common.sh@295 -- # e810=() 00:13:13.289 12:27:07 -- nvmf/common.sh@295 -- # local -ga e810 00:13:13.289 12:27:07 -- nvmf/common.sh@296 -- # x722=() 00:13:13.289 12:27:07 -- nvmf/common.sh@296 -- # local -ga x722 00:13:13.289 12:27:07 -- nvmf/common.sh@297 -- # mlx=() 00:13:13.289 12:27:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:13.289 12:27:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:13.289 12:27:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:13.289 12:27:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:13.289 12:27:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:13.289 12:27:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.289 12:27:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:13.289 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:13.289 12:27:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.289 12:27:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:13.289 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:13.289 12:27:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:13.289 12:27:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.289 12:27:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.289 12:27:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.289 12:27:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.289 12:27:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:13.289 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:13.289 12:27:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.289 12:27:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.289 12:27:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.289 12:27:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.289 12:27:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.289 12:27:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:13.289 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:13.289 12:27:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.289 12:27:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:13.289 12:27:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:13.289 12:27:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:13.289 12:27:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:13.290 12:27:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:13.290 12:27:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:13.290 12:27:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:13.290 12:27:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:13.290 12:27:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:13.290 12:27:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:13.290 12:27:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:13.290 12:27:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:13.290 12:27:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:13.290 12:27:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:13.290 12:27:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:13.290 12:27:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:13.290 12:27:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:13.290 12:27:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:13.290 12:27:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:13.290 12:27:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:13.290 12:27:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:13.290 12:27:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:13.290 12:27:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:13.290 12:27:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:13.290 12:27:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:13.290 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:13.290 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:13:13.290 00:13:13.290 --- 10.0.0.2 ping statistics --- 00:13:13.290 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.290 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:13:13.290 12:27:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:13.290 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:13.290 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:13:13.290 00:13:13.290 --- 10.0.0.1 ping statistics --- 00:13:13.290 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.290 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:13:13.290 12:27:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:13.290 12:27:07 -- nvmf/common.sh@410 -- # return 0 00:13:13.290 12:27:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:13.290 12:27:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:13.290 12:27:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:13.290 12:27:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:13.290 12:27:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:13.290 12:27:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:13.290 12:27:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:13.290 12:27:07 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:13.290 12:27:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:13.290 12:27:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:13.290 12:27:07 -- common/autotest_common.sh@10 -- # set +x 00:13:13.548 12:27:07 -- nvmf/common.sh@469 -- # nvmfpid=1235553 00:13:13.548 12:27:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:13.548 12:27:07 -- nvmf/common.sh@470 -- # waitforlisten 1235553 00:13:13.548 12:27:07 -- common/autotest_common.sh@819 -- # '[' -z 1235553 ']' 00:13:13.548 12:27:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:13.548 12:27:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:13.548 12:27:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:13.548 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:13.548 12:27:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:13.548 12:27:07 -- common/autotest_common.sh@10 -- # set +x 00:13:13.548 [2024-07-12 12:27:07.248046] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:13.548 [2024-07-12 12:27:07.248123] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:13.548 EAL: No free 2048 kB hugepages reported on node 1 00:13:13.548 [2024-07-12 12:27:07.311766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:13.548 [2024-07-12 12:27:07.424778] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:13.548 [2024-07-12 12:27:07.424972] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:13.548 [2024-07-12 12:27:07.424993] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:13.548 [2024-07-12 12:27:07.425006] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:13.548 [2024-07-12 12:27:07.425046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:14.481 12:27:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:14.481 12:27:08 -- common/autotest_common.sh@852 -- # return 0 00:13:14.481 12:27:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:14.481 12:27:08 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 12:27:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:14.482 12:27:08 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:14.482 12:27:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 [2024-07-12 12:27:08.234280] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:14.482 12:27:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.482 12:27:08 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:14.482 12:27:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 12:27:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.482 12:27:08 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:14.482 12:27:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 [2024-07-12 12:27:08.250466] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:14.482 12:27:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.482 12:27:08 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:14.482 12:27:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 NULL1 00:13:14.482 12:27:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.482 12:27:08 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:14.482 12:27:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 12:27:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.482 12:27:08 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:14.482 12:27:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:14.482 12:27:08 -- common/autotest_common.sh@10 -- # set +x 00:13:14.482 12:27:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:14.482 12:27:08 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:14.482 [2024-07-12 12:27:08.294829] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:14.482 [2024-07-12 12:27:08.294879] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1236070 ] 00:13:14.482 EAL: No free 2048 kB hugepages reported on node 1 00:13:15.047 Attached to nqn.2016-06.io.spdk:cnode1 00:13:15.047 Namespace ID: 1 size: 1GB 00:13:15.047 fused_ordering(0) 00:13:15.047 fused_ordering(1) 00:13:15.047 fused_ordering(2) 00:13:15.047 fused_ordering(3) 00:13:15.047 fused_ordering(4) 00:13:15.047 fused_ordering(5) 00:13:15.047 fused_ordering(6) 00:13:15.047 fused_ordering(7) 00:13:15.047 fused_ordering(8) 00:13:15.047 fused_ordering(9) 00:13:15.047 fused_ordering(10) 00:13:15.047 fused_ordering(11) 00:13:15.047 fused_ordering(12) 00:13:15.047 fused_ordering(13) 00:13:15.047 fused_ordering(14) 00:13:15.048 fused_ordering(15) 00:13:15.048 fused_ordering(16) 00:13:15.048 fused_ordering(17) 00:13:15.048 fused_ordering(18) 00:13:15.048 fused_ordering(19) 00:13:15.048 fused_ordering(20) 00:13:15.048 fused_ordering(21) 00:13:15.048 fused_ordering(22) 00:13:15.048 fused_ordering(23) 00:13:15.048 fused_ordering(24) 00:13:15.048 fused_ordering(25) 00:13:15.048 fused_ordering(26) 00:13:15.048 fused_ordering(27) 00:13:15.048 fused_ordering(28) 00:13:15.048 fused_ordering(29) 00:13:15.048 fused_ordering(30) 00:13:15.048 fused_ordering(31) 00:13:15.048 fused_ordering(32) 00:13:15.048 fused_ordering(33) 00:13:15.048 fused_ordering(34) 00:13:15.048 fused_ordering(35) 00:13:15.048 fused_ordering(36) 00:13:15.048 fused_ordering(37) 00:13:15.048 fused_ordering(38) 00:13:15.048 fused_ordering(39) 00:13:15.048 fused_ordering(40) 00:13:15.048 fused_ordering(41) 00:13:15.048 fused_ordering(42) 00:13:15.048 fused_ordering(43) 00:13:15.048 fused_ordering(44) 00:13:15.048 fused_ordering(45) 00:13:15.048 fused_ordering(46) 00:13:15.048 fused_ordering(47) 00:13:15.048 fused_ordering(48) 00:13:15.048 fused_ordering(49) 00:13:15.048 fused_ordering(50) 00:13:15.048 fused_ordering(51) 00:13:15.048 fused_ordering(52) 00:13:15.048 fused_ordering(53) 00:13:15.048 fused_ordering(54) 00:13:15.048 fused_ordering(55) 00:13:15.048 fused_ordering(56) 00:13:15.048 fused_ordering(57) 00:13:15.048 fused_ordering(58) 00:13:15.048 fused_ordering(59) 00:13:15.048 fused_ordering(60) 00:13:15.048 fused_ordering(61) 00:13:15.048 fused_ordering(62) 00:13:15.048 fused_ordering(63) 00:13:15.048 fused_ordering(64) 00:13:15.048 fused_ordering(65) 00:13:15.048 fused_ordering(66) 00:13:15.048 fused_ordering(67) 00:13:15.048 fused_ordering(68) 00:13:15.048 fused_ordering(69) 00:13:15.048 fused_ordering(70) 00:13:15.048 fused_ordering(71) 00:13:15.048 fused_ordering(72) 00:13:15.048 fused_ordering(73) 00:13:15.048 fused_ordering(74) 00:13:15.048 fused_ordering(75) 00:13:15.048 fused_ordering(76) 00:13:15.048 fused_ordering(77) 00:13:15.048 fused_ordering(78) 00:13:15.048 fused_ordering(79) 00:13:15.048 fused_ordering(80) 00:13:15.048 fused_ordering(81) 00:13:15.048 fused_ordering(82) 00:13:15.048 fused_ordering(83) 00:13:15.048 fused_ordering(84) 00:13:15.048 fused_ordering(85) 00:13:15.048 fused_ordering(86) 00:13:15.048 fused_ordering(87) 00:13:15.048 fused_ordering(88) 00:13:15.048 fused_ordering(89) 00:13:15.048 fused_ordering(90) 00:13:15.048 fused_ordering(91) 00:13:15.048 fused_ordering(92) 00:13:15.048 fused_ordering(93) 00:13:15.048 fused_ordering(94) 00:13:15.048 fused_ordering(95) 00:13:15.048 fused_ordering(96) 00:13:15.048 fused_ordering(97) 00:13:15.048 fused_ordering(98) 00:13:15.048 fused_ordering(99) 00:13:15.048 fused_ordering(100) 00:13:15.048 fused_ordering(101) 00:13:15.048 fused_ordering(102) 00:13:15.048 fused_ordering(103) 00:13:15.048 fused_ordering(104) 00:13:15.048 fused_ordering(105) 00:13:15.048 fused_ordering(106) 00:13:15.048 fused_ordering(107) 00:13:15.048 fused_ordering(108) 00:13:15.048 fused_ordering(109) 00:13:15.048 fused_ordering(110) 00:13:15.048 fused_ordering(111) 00:13:15.048 fused_ordering(112) 00:13:15.048 fused_ordering(113) 00:13:15.048 fused_ordering(114) 00:13:15.048 fused_ordering(115) 00:13:15.048 fused_ordering(116) 00:13:15.048 fused_ordering(117) 00:13:15.048 fused_ordering(118) 00:13:15.048 fused_ordering(119) 00:13:15.048 fused_ordering(120) 00:13:15.048 fused_ordering(121) 00:13:15.048 fused_ordering(122) 00:13:15.048 fused_ordering(123) 00:13:15.048 fused_ordering(124) 00:13:15.048 fused_ordering(125) 00:13:15.048 fused_ordering(126) 00:13:15.048 fused_ordering(127) 00:13:15.048 fused_ordering(128) 00:13:15.048 fused_ordering(129) 00:13:15.048 fused_ordering(130) 00:13:15.048 fused_ordering(131) 00:13:15.048 fused_ordering(132) 00:13:15.048 fused_ordering(133) 00:13:15.048 fused_ordering(134) 00:13:15.048 fused_ordering(135) 00:13:15.048 fused_ordering(136) 00:13:15.048 fused_ordering(137) 00:13:15.048 fused_ordering(138) 00:13:15.048 fused_ordering(139) 00:13:15.048 fused_ordering(140) 00:13:15.048 fused_ordering(141) 00:13:15.048 fused_ordering(142) 00:13:15.048 fused_ordering(143) 00:13:15.048 fused_ordering(144) 00:13:15.048 fused_ordering(145) 00:13:15.048 fused_ordering(146) 00:13:15.048 fused_ordering(147) 00:13:15.048 fused_ordering(148) 00:13:15.048 fused_ordering(149) 00:13:15.048 fused_ordering(150) 00:13:15.048 fused_ordering(151) 00:13:15.048 fused_ordering(152) 00:13:15.048 fused_ordering(153) 00:13:15.048 fused_ordering(154) 00:13:15.048 fused_ordering(155) 00:13:15.048 fused_ordering(156) 00:13:15.048 fused_ordering(157) 00:13:15.048 fused_ordering(158) 00:13:15.048 fused_ordering(159) 00:13:15.048 fused_ordering(160) 00:13:15.048 fused_ordering(161) 00:13:15.048 fused_ordering(162) 00:13:15.048 fused_ordering(163) 00:13:15.048 fused_ordering(164) 00:13:15.048 fused_ordering(165) 00:13:15.048 fused_ordering(166) 00:13:15.048 fused_ordering(167) 00:13:15.048 fused_ordering(168) 00:13:15.048 fused_ordering(169) 00:13:15.048 fused_ordering(170) 00:13:15.048 fused_ordering(171) 00:13:15.048 fused_ordering(172) 00:13:15.048 fused_ordering(173) 00:13:15.048 fused_ordering(174) 00:13:15.048 fused_ordering(175) 00:13:15.048 fused_ordering(176) 00:13:15.048 fused_ordering(177) 00:13:15.048 fused_ordering(178) 00:13:15.048 fused_ordering(179) 00:13:15.048 fused_ordering(180) 00:13:15.048 fused_ordering(181) 00:13:15.048 fused_ordering(182) 00:13:15.048 fused_ordering(183) 00:13:15.048 fused_ordering(184) 00:13:15.048 fused_ordering(185) 00:13:15.048 fused_ordering(186) 00:13:15.048 fused_ordering(187) 00:13:15.048 fused_ordering(188) 00:13:15.048 fused_ordering(189) 00:13:15.048 fused_ordering(190) 00:13:15.048 fused_ordering(191) 00:13:15.048 fused_ordering(192) 00:13:15.048 fused_ordering(193) 00:13:15.048 fused_ordering(194) 00:13:15.048 fused_ordering(195) 00:13:15.048 fused_ordering(196) 00:13:15.048 fused_ordering(197) 00:13:15.048 fused_ordering(198) 00:13:15.048 fused_ordering(199) 00:13:15.048 fused_ordering(200) 00:13:15.048 fused_ordering(201) 00:13:15.048 fused_ordering(202) 00:13:15.048 fused_ordering(203) 00:13:15.048 fused_ordering(204) 00:13:15.048 fused_ordering(205) 00:13:15.307 fused_ordering(206) 00:13:15.307 fused_ordering(207) 00:13:15.307 fused_ordering(208) 00:13:15.307 fused_ordering(209) 00:13:15.307 fused_ordering(210) 00:13:15.307 fused_ordering(211) 00:13:15.307 fused_ordering(212) 00:13:15.307 fused_ordering(213) 00:13:15.307 fused_ordering(214) 00:13:15.307 fused_ordering(215) 00:13:15.307 fused_ordering(216) 00:13:15.307 fused_ordering(217) 00:13:15.307 fused_ordering(218) 00:13:15.307 fused_ordering(219) 00:13:15.307 fused_ordering(220) 00:13:15.307 fused_ordering(221) 00:13:15.307 fused_ordering(222) 00:13:15.307 fused_ordering(223) 00:13:15.307 fused_ordering(224) 00:13:15.307 fused_ordering(225) 00:13:15.307 fused_ordering(226) 00:13:15.307 fused_ordering(227) 00:13:15.307 fused_ordering(228) 00:13:15.307 fused_ordering(229) 00:13:15.307 fused_ordering(230) 00:13:15.307 fused_ordering(231) 00:13:15.307 fused_ordering(232) 00:13:15.307 fused_ordering(233) 00:13:15.307 fused_ordering(234) 00:13:15.307 fused_ordering(235) 00:13:15.307 fused_ordering(236) 00:13:15.307 fused_ordering(237) 00:13:15.307 fused_ordering(238) 00:13:15.307 fused_ordering(239) 00:13:15.307 fused_ordering(240) 00:13:15.307 fused_ordering(241) 00:13:15.307 fused_ordering(242) 00:13:15.307 fused_ordering(243) 00:13:15.307 fused_ordering(244) 00:13:15.307 fused_ordering(245) 00:13:15.307 fused_ordering(246) 00:13:15.307 fused_ordering(247) 00:13:15.307 fused_ordering(248) 00:13:15.307 fused_ordering(249) 00:13:15.307 fused_ordering(250) 00:13:15.307 fused_ordering(251) 00:13:15.307 fused_ordering(252) 00:13:15.307 fused_ordering(253) 00:13:15.307 fused_ordering(254) 00:13:15.307 fused_ordering(255) 00:13:15.307 fused_ordering(256) 00:13:15.307 fused_ordering(257) 00:13:15.307 fused_ordering(258) 00:13:15.307 fused_ordering(259) 00:13:15.307 fused_ordering(260) 00:13:15.307 fused_ordering(261) 00:13:15.307 fused_ordering(262) 00:13:15.307 fused_ordering(263) 00:13:15.307 fused_ordering(264) 00:13:15.307 fused_ordering(265) 00:13:15.307 fused_ordering(266) 00:13:15.307 fused_ordering(267) 00:13:15.307 fused_ordering(268) 00:13:15.307 fused_ordering(269) 00:13:15.307 fused_ordering(270) 00:13:15.307 fused_ordering(271) 00:13:15.307 fused_ordering(272) 00:13:15.307 fused_ordering(273) 00:13:15.307 fused_ordering(274) 00:13:15.307 fused_ordering(275) 00:13:15.307 fused_ordering(276) 00:13:15.307 fused_ordering(277) 00:13:15.307 fused_ordering(278) 00:13:15.307 fused_ordering(279) 00:13:15.307 fused_ordering(280) 00:13:15.307 fused_ordering(281) 00:13:15.307 fused_ordering(282) 00:13:15.307 fused_ordering(283) 00:13:15.307 fused_ordering(284) 00:13:15.307 fused_ordering(285) 00:13:15.307 fused_ordering(286) 00:13:15.307 fused_ordering(287) 00:13:15.307 fused_ordering(288) 00:13:15.307 fused_ordering(289) 00:13:15.307 fused_ordering(290) 00:13:15.307 fused_ordering(291) 00:13:15.307 fused_ordering(292) 00:13:15.307 fused_ordering(293) 00:13:15.307 fused_ordering(294) 00:13:15.307 fused_ordering(295) 00:13:15.307 fused_ordering(296) 00:13:15.307 fused_ordering(297) 00:13:15.307 fused_ordering(298) 00:13:15.307 fused_ordering(299) 00:13:15.307 fused_ordering(300) 00:13:15.307 fused_ordering(301) 00:13:15.307 fused_ordering(302) 00:13:15.307 fused_ordering(303) 00:13:15.307 fused_ordering(304) 00:13:15.307 fused_ordering(305) 00:13:15.307 fused_ordering(306) 00:13:15.307 fused_ordering(307) 00:13:15.307 fused_ordering(308) 00:13:15.307 fused_ordering(309) 00:13:15.307 fused_ordering(310) 00:13:15.307 fused_ordering(311) 00:13:15.307 fused_ordering(312) 00:13:15.307 fused_ordering(313) 00:13:15.307 fused_ordering(314) 00:13:15.307 fused_ordering(315) 00:13:15.307 fused_ordering(316) 00:13:15.307 fused_ordering(317) 00:13:15.307 fused_ordering(318) 00:13:15.307 fused_ordering(319) 00:13:15.307 fused_ordering(320) 00:13:15.307 fused_ordering(321) 00:13:15.307 fused_ordering(322) 00:13:15.307 fused_ordering(323) 00:13:15.307 fused_ordering(324) 00:13:15.307 fused_ordering(325) 00:13:15.307 fused_ordering(326) 00:13:15.307 fused_ordering(327) 00:13:15.307 fused_ordering(328) 00:13:15.307 fused_ordering(329) 00:13:15.307 fused_ordering(330) 00:13:15.307 fused_ordering(331) 00:13:15.307 fused_ordering(332) 00:13:15.307 fused_ordering(333) 00:13:15.307 fused_ordering(334) 00:13:15.307 fused_ordering(335) 00:13:15.307 fused_ordering(336) 00:13:15.307 fused_ordering(337) 00:13:15.307 fused_ordering(338) 00:13:15.307 fused_ordering(339) 00:13:15.307 fused_ordering(340) 00:13:15.307 fused_ordering(341) 00:13:15.307 fused_ordering(342) 00:13:15.307 fused_ordering(343) 00:13:15.307 fused_ordering(344) 00:13:15.307 fused_ordering(345) 00:13:15.307 fused_ordering(346) 00:13:15.307 fused_ordering(347) 00:13:15.307 fused_ordering(348) 00:13:15.307 fused_ordering(349) 00:13:15.307 fused_ordering(350) 00:13:15.307 fused_ordering(351) 00:13:15.307 fused_ordering(352) 00:13:15.307 fused_ordering(353) 00:13:15.307 fused_ordering(354) 00:13:15.307 fused_ordering(355) 00:13:15.307 fused_ordering(356) 00:13:15.307 fused_ordering(357) 00:13:15.307 fused_ordering(358) 00:13:15.307 fused_ordering(359) 00:13:15.307 fused_ordering(360) 00:13:15.307 fused_ordering(361) 00:13:15.307 fused_ordering(362) 00:13:15.307 fused_ordering(363) 00:13:15.307 fused_ordering(364) 00:13:15.307 fused_ordering(365) 00:13:15.307 fused_ordering(366) 00:13:15.307 fused_ordering(367) 00:13:15.307 fused_ordering(368) 00:13:15.307 fused_ordering(369) 00:13:15.307 fused_ordering(370) 00:13:15.307 fused_ordering(371) 00:13:15.307 fused_ordering(372) 00:13:15.307 fused_ordering(373) 00:13:15.307 fused_ordering(374) 00:13:15.307 fused_ordering(375) 00:13:15.307 fused_ordering(376) 00:13:15.307 fused_ordering(377) 00:13:15.307 fused_ordering(378) 00:13:15.307 fused_ordering(379) 00:13:15.307 fused_ordering(380) 00:13:15.307 fused_ordering(381) 00:13:15.307 fused_ordering(382) 00:13:15.307 fused_ordering(383) 00:13:15.307 fused_ordering(384) 00:13:15.307 fused_ordering(385) 00:13:15.307 fused_ordering(386) 00:13:15.307 fused_ordering(387) 00:13:15.307 fused_ordering(388) 00:13:15.307 fused_ordering(389) 00:13:15.307 fused_ordering(390) 00:13:15.307 fused_ordering(391) 00:13:15.307 fused_ordering(392) 00:13:15.307 fused_ordering(393) 00:13:15.307 fused_ordering(394) 00:13:15.307 fused_ordering(395) 00:13:15.307 fused_ordering(396) 00:13:15.307 fused_ordering(397) 00:13:15.307 fused_ordering(398) 00:13:15.307 fused_ordering(399) 00:13:15.307 fused_ordering(400) 00:13:15.307 fused_ordering(401) 00:13:15.307 fused_ordering(402) 00:13:15.307 fused_ordering(403) 00:13:15.307 fused_ordering(404) 00:13:15.307 fused_ordering(405) 00:13:15.307 fused_ordering(406) 00:13:15.307 fused_ordering(407) 00:13:15.307 fused_ordering(408) 00:13:15.307 fused_ordering(409) 00:13:15.307 fused_ordering(410) 00:13:15.873 fused_ordering(411) 00:13:15.873 fused_ordering(412) 00:13:15.873 fused_ordering(413) 00:13:15.873 fused_ordering(414) 00:13:15.873 fused_ordering(415) 00:13:15.873 fused_ordering(416) 00:13:15.873 fused_ordering(417) 00:13:15.873 fused_ordering(418) 00:13:15.873 fused_ordering(419) 00:13:15.873 fused_ordering(420) 00:13:15.873 fused_ordering(421) 00:13:15.873 fused_ordering(422) 00:13:15.873 fused_ordering(423) 00:13:15.873 fused_ordering(424) 00:13:15.873 fused_ordering(425) 00:13:15.873 fused_ordering(426) 00:13:15.873 fused_ordering(427) 00:13:15.873 fused_ordering(428) 00:13:15.873 fused_ordering(429) 00:13:15.873 fused_ordering(430) 00:13:15.873 fused_ordering(431) 00:13:15.873 fused_ordering(432) 00:13:15.873 fused_ordering(433) 00:13:15.873 fused_ordering(434) 00:13:15.873 fused_ordering(435) 00:13:15.873 fused_ordering(436) 00:13:15.873 fused_ordering(437) 00:13:15.873 fused_ordering(438) 00:13:15.873 fused_ordering(439) 00:13:15.873 fused_ordering(440) 00:13:15.873 fused_ordering(441) 00:13:15.873 fused_ordering(442) 00:13:15.873 fused_ordering(443) 00:13:15.873 fused_ordering(444) 00:13:15.873 fused_ordering(445) 00:13:15.873 fused_ordering(446) 00:13:15.873 fused_ordering(447) 00:13:15.873 fused_ordering(448) 00:13:15.873 fused_ordering(449) 00:13:15.873 fused_ordering(450) 00:13:15.873 fused_ordering(451) 00:13:15.873 fused_ordering(452) 00:13:15.873 fused_ordering(453) 00:13:15.873 fused_ordering(454) 00:13:15.873 fused_ordering(455) 00:13:15.873 fused_ordering(456) 00:13:15.873 fused_ordering(457) 00:13:15.873 fused_ordering(458) 00:13:15.873 fused_ordering(459) 00:13:15.873 fused_ordering(460) 00:13:15.873 fused_ordering(461) 00:13:15.873 fused_ordering(462) 00:13:15.873 fused_ordering(463) 00:13:15.873 fused_ordering(464) 00:13:15.873 fused_ordering(465) 00:13:15.873 fused_ordering(466) 00:13:15.873 fused_ordering(467) 00:13:15.873 fused_ordering(468) 00:13:15.873 fused_ordering(469) 00:13:15.873 fused_ordering(470) 00:13:15.873 fused_ordering(471) 00:13:15.873 fused_ordering(472) 00:13:15.873 fused_ordering(473) 00:13:15.873 fused_ordering(474) 00:13:15.873 fused_ordering(475) 00:13:15.873 fused_ordering(476) 00:13:15.873 fused_ordering(477) 00:13:15.873 fused_ordering(478) 00:13:15.873 fused_ordering(479) 00:13:15.873 fused_ordering(480) 00:13:15.873 fused_ordering(481) 00:13:15.873 fused_ordering(482) 00:13:15.873 fused_ordering(483) 00:13:15.873 fused_ordering(484) 00:13:15.873 fused_ordering(485) 00:13:15.873 fused_ordering(486) 00:13:15.873 fused_ordering(487) 00:13:15.873 fused_ordering(488) 00:13:15.873 fused_ordering(489) 00:13:15.873 fused_ordering(490) 00:13:15.873 fused_ordering(491) 00:13:15.873 fused_ordering(492) 00:13:15.873 fused_ordering(493) 00:13:15.873 fused_ordering(494) 00:13:15.873 fused_ordering(495) 00:13:15.873 fused_ordering(496) 00:13:15.873 fused_ordering(497) 00:13:15.873 fused_ordering(498) 00:13:15.873 fused_ordering(499) 00:13:15.873 fused_ordering(500) 00:13:15.873 fused_ordering(501) 00:13:15.873 fused_ordering(502) 00:13:15.873 fused_ordering(503) 00:13:15.873 fused_ordering(504) 00:13:15.873 fused_ordering(505) 00:13:15.873 fused_ordering(506) 00:13:15.873 fused_ordering(507) 00:13:15.873 fused_ordering(508) 00:13:15.873 fused_ordering(509) 00:13:15.873 fused_ordering(510) 00:13:15.873 fused_ordering(511) 00:13:15.873 fused_ordering(512) 00:13:15.873 fused_ordering(513) 00:13:15.873 fused_ordering(514) 00:13:15.873 fused_ordering(515) 00:13:15.873 fused_ordering(516) 00:13:15.873 fused_ordering(517) 00:13:15.874 fused_ordering(518) 00:13:15.874 fused_ordering(519) 00:13:15.874 fused_ordering(520) 00:13:15.874 fused_ordering(521) 00:13:15.874 fused_ordering(522) 00:13:15.874 fused_ordering(523) 00:13:15.874 fused_ordering(524) 00:13:15.874 fused_ordering(525) 00:13:15.874 fused_ordering(526) 00:13:15.874 fused_ordering(527) 00:13:15.874 fused_ordering(528) 00:13:15.874 fused_ordering(529) 00:13:15.874 fused_ordering(530) 00:13:15.874 fused_ordering(531) 00:13:15.874 fused_ordering(532) 00:13:15.874 fused_ordering(533) 00:13:15.874 fused_ordering(534) 00:13:15.874 fused_ordering(535) 00:13:15.874 fused_ordering(536) 00:13:15.874 fused_ordering(537) 00:13:15.874 fused_ordering(538) 00:13:15.874 fused_ordering(539) 00:13:15.874 fused_ordering(540) 00:13:15.874 fused_ordering(541) 00:13:15.874 fused_ordering(542) 00:13:15.874 fused_ordering(543) 00:13:15.874 fused_ordering(544) 00:13:15.874 fused_ordering(545) 00:13:15.874 fused_ordering(546) 00:13:15.874 fused_ordering(547) 00:13:15.874 fused_ordering(548) 00:13:15.874 fused_ordering(549) 00:13:15.874 fused_ordering(550) 00:13:15.874 fused_ordering(551) 00:13:15.874 fused_ordering(552) 00:13:15.874 fused_ordering(553) 00:13:15.874 fused_ordering(554) 00:13:15.874 fused_ordering(555) 00:13:15.874 fused_ordering(556) 00:13:15.874 fused_ordering(557) 00:13:15.874 fused_ordering(558) 00:13:15.874 fused_ordering(559) 00:13:15.874 fused_ordering(560) 00:13:15.874 fused_ordering(561) 00:13:15.874 fused_ordering(562) 00:13:15.874 fused_ordering(563) 00:13:15.874 fused_ordering(564) 00:13:15.874 fused_ordering(565) 00:13:15.874 fused_ordering(566) 00:13:15.874 fused_ordering(567) 00:13:15.874 fused_ordering(568) 00:13:15.874 fused_ordering(569) 00:13:15.874 fused_ordering(570) 00:13:15.874 fused_ordering(571) 00:13:15.874 fused_ordering(572) 00:13:15.874 fused_ordering(573) 00:13:15.874 fused_ordering(574) 00:13:15.874 fused_ordering(575) 00:13:15.874 fused_ordering(576) 00:13:15.874 fused_ordering(577) 00:13:15.874 fused_ordering(578) 00:13:15.874 fused_ordering(579) 00:13:15.874 fused_ordering(580) 00:13:15.874 fused_ordering(581) 00:13:15.874 fused_ordering(582) 00:13:15.874 fused_ordering(583) 00:13:15.874 fused_ordering(584) 00:13:15.874 fused_ordering(585) 00:13:15.874 fused_ordering(586) 00:13:15.874 fused_ordering(587) 00:13:15.874 fused_ordering(588) 00:13:15.874 fused_ordering(589) 00:13:15.874 fused_ordering(590) 00:13:15.874 fused_ordering(591) 00:13:15.874 fused_ordering(592) 00:13:15.874 fused_ordering(593) 00:13:15.874 fused_ordering(594) 00:13:15.874 fused_ordering(595) 00:13:15.874 fused_ordering(596) 00:13:15.874 fused_ordering(597) 00:13:15.874 fused_ordering(598) 00:13:15.874 fused_ordering(599) 00:13:15.874 fused_ordering(600) 00:13:15.874 fused_ordering(601) 00:13:15.874 fused_ordering(602) 00:13:15.874 fused_ordering(603) 00:13:15.874 fused_ordering(604) 00:13:15.874 fused_ordering(605) 00:13:15.874 fused_ordering(606) 00:13:15.874 fused_ordering(607) 00:13:15.874 fused_ordering(608) 00:13:15.874 fused_ordering(609) 00:13:15.874 fused_ordering(610) 00:13:15.874 fused_ordering(611) 00:13:15.874 fused_ordering(612) 00:13:15.874 fused_ordering(613) 00:13:15.874 fused_ordering(614) 00:13:15.874 fused_ordering(615) 00:13:16.440 fused_ordering(616) 00:13:16.440 fused_ordering(617) 00:13:16.440 fused_ordering(618) 00:13:16.440 fused_ordering(619) 00:13:16.440 fused_ordering(620) 00:13:16.440 fused_ordering(621) 00:13:16.440 fused_ordering(622) 00:13:16.440 fused_ordering(623) 00:13:16.440 fused_ordering(624) 00:13:16.440 fused_ordering(625) 00:13:16.440 fused_ordering(626) 00:13:16.440 fused_ordering(627) 00:13:16.440 fused_ordering(628) 00:13:16.440 fused_ordering(629) 00:13:16.440 fused_ordering(630) 00:13:16.440 fused_ordering(631) 00:13:16.440 fused_ordering(632) 00:13:16.440 fused_ordering(633) 00:13:16.440 fused_ordering(634) 00:13:16.440 fused_ordering(635) 00:13:16.440 fused_ordering(636) 00:13:16.440 fused_ordering(637) 00:13:16.440 fused_ordering(638) 00:13:16.440 fused_ordering(639) 00:13:16.440 fused_ordering(640) 00:13:16.440 fused_ordering(641) 00:13:16.440 fused_ordering(642) 00:13:16.440 fused_ordering(643) 00:13:16.440 fused_ordering(644) 00:13:16.440 fused_ordering(645) 00:13:16.440 fused_ordering(646) 00:13:16.440 fused_ordering(647) 00:13:16.440 fused_ordering(648) 00:13:16.440 fused_ordering(649) 00:13:16.440 fused_ordering(650) 00:13:16.440 fused_ordering(651) 00:13:16.440 fused_ordering(652) 00:13:16.440 fused_ordering(653) 00:13:16.440 fused_ordering(654) 00:13:16.440 fused_ordering(655) 00:13:16.440 fused_ordering(656) 00:13:16.440 fused_ordering(657) 00:13:16.440 fused_ordering(658) 00:13:16.440 fused_ordering(659) 00:13:16.440 fused_ordering(660) 00:13:16.440 fused_ordering(661) 00:13:16.440 fused_ordering(662) 00:13:16.440 fused_ordering(663) 00:13:16.440 fused_ordering(664) 00:13:16.440 fused_ordering(665) 00:13:16.440 fused_ordering(666) 00:13:16.440 fused_ordering(667) 00:13:16.440 fused_ordering(668) 00:13:16.440 fused_ordering(669) 00:13:16.440 fused_ordering(670) 00:13:16.440 fused_ordering(671) 00:13:16.440 fused_ordering(672) 00:13:16.440 fused_ordering(673) 00:13:16.440 fused_ordering(674) 00:13:16.440 fused_ordering(675) 00:13:16.440 fused_ordering(676) 00:13:16.440 fused_ordering(677) 00:13:16.440 fused_ordering(678) 00:13:16.440 fused_ordering(679) 00:13:16.440 fused_ordering(680) 00:13:16.440 fused_ordering(681) 00:13:16.440 fused_ordering(682) 00:13:16.440 fused_ordering(683) 00:13:16.440 fused_ordering(684) 00:13:16.440 fused_ordering(685) 00:13:16.440 fused_ordering(686) 00:13:16.440 fused_ordering(687) 00:13:16.440 fused_ordering(688) 00:13:16.440 fused_ordering(689) 00:13:16.440 fused_ordering(690) 00:13:16.440 fused_ordering(691) 00:13:16.440 fused_ordering(692) 00:13:16.440 fused_ordering(693) 00:13:16.440 fused_ordering(694) 00:13:16.440 fused_ordering(695) 00:13:16.440 fused_ordering(696) 00:13:16.440 fused_ordering(697) 00:13:16.440 fused_ordering(698) 00:13:16.440 fused_ordering(699) 00:13:16.440 fused_ordering(700) 00:13:16.440 fused_ordering(701) 00:13:16.440 fused_ordering(702) 00:13:16.440 fused_ordering(703) 00:13:16.440 fused_ordering(704) 00:13:16.440 fused_ordering(705) 00:13:16.440 fused_ordering(706) 00:13:16.440 fused_ordering(707) 00:13:16.440 fused_ordering(708) 00:13:16.440 fused_ordering(709) 00:13:16.440 fused_ordering(710) 00:13:16.440 fused_ordering(711) 00:13:16.440 fused_ordering(712) 00:13:16.440 fused_ordering(713) 00:13:16.440 fused_ordering(714) 00:13:16.440 fused_ordering(715) 00:13:16.440 fused_ordering(716) 00:13:16.440 fused_ordering(717) 00:13:16.440 fused_ordering(718) 00:13:16.440 fused_ordering(719) 00:13:16.440 fused_ordering(720) 00:13:16.440 fused_ordering(721) 00:13:16.440 fused_ordering(722) 00:13:16.440 fused_ordering(723) 00:13:16.440 fused_ordering(724) 00:13:16.440 fused_ordering(725) 00:13:16.440 fused_ordering(726) 00:13:16.440 fused_ordering(727) 00:13:16.440 fused_ordering(728) 00:13:16.440 fused_ordering(729) 00:13:16.440 fused_ordering(730) 00:13:16.440 fused_ordering(731) 00:13:16.440 fused_ordering(732) 00:13:16.440 fused_ordering(733) 00:13:16.440 fused_ordering(734) 00:13:16.440 fused_ordering(735) 00:13:16.440 fused_ordering(736) 00:13:16.440 fused_ordering(737) 00:13:16.440 fused_ordering(738) 00:13:16.440 fused_ordering(739) 00:13:16.440 fused_ordering(740) 00:13:16.440 fused_ordering(741) 00:13:16.440 fused_ordering(742) 00:13:16.440 fused_ordering(743) 00:13:16.440 fused_ordering(744) 00:13:16.440 fused_ordering(745) 00:13:16.440 fused_ordering(746) 00:13:16.440 fused_ordering(747) 00:13:16.440 fused_ordering(748) 00:13:16.440 fused_ordering(749) 00:13:16.440 fused_ordering(750) 00:13:16.440 fused_ordering(751) 00:13:16.440 fused_ordering(752) 00:13:16.440 fused_ordering(753) 00:13:16.440 fused_ordering(754) 00:13:16.440 fused_ordering(755) 00:13:16.440 fused_ordering(756) 00:13:16.440 fused_ordering(757) 00:13:16.440 fused_ordering(758) 00:13:16.440 fused_ordering(759) 00:13:16.440 fused_ordering(760) 00:13:16.440 fused_ordering(761) 00:13:16.440 fused_ordering(762) 00:13:16.440 fused_ordering(763) 00:13:16.440 fused_ordering(764) 00:13:16.440 fused_ordering(765) 00:13:16.440 fused_ordering(766) 00:13:16.440 fused_ordering(767) 00:13:16.440 fused_ordering(768) 00:13:16.440 fused_ordering(769) 00:13:16.440 fused_ordering(770) 00:13:16.440 fused_ordering(771) 00:13:16.440 fused_ordering(772) 00:13:16.440 fused_ordering(773) 00:13:16.440 fused_ordering(774) 00:13:16.440 fused_ordering(775) 00:13:16.440 fused_ordering(776) 00:13:16.440 fused_ordering(777) 00:13:16.440 fused_ordering(778) 00:13:16.440 fused_ordering(779) 00:13:16.440 fused_ordering(780) 00:13:16.440 fused_ordering(781) 00:13:16.441 fused_ordering(782) 00:13:16.441 fused_ordering(783) 00:13:16.441 fused_ordering(784) 00:13:16.441 fused_ordering(785) 00:13:16.441 fused_ordering(786) 00:13:16.441 fused_ordering(787) 00:13:16.441 fused_ordering(788) 00:13:16.441 fused_ordering(789) 00:13:16.441 fused_ordering(790) 00:13:16.441 fused_ordering(791) 00:13:16.441 fused_ordering(792) 00:13:16.441 fused_ordering(793) 00:13:16.441 fused_ordering(794) 00:13:16.441 fused_ordering(795) 00:13:16.441 fused_ordering(796) 00:13:16.441 fused_ordering(797) 00:13:16.441 fused_ordering(798) 00:13:16.441 fused_ordering(799) 00:13:16.441 fused_ordering(800) 00:13:16.441 fused_ordering(801) 00:13:16.441 fused_ordering(802) 00:13:16.441 fused_ordering(803) 00:13:16.441 fused_ordering(804) 00:13:16.441 fused_ordering(805) 00:13:16.441 fused_ordering(806) 00:13:16.441 fused_ordering(807) 00:13:16.441 fused_ordering(808) 00:13:16.441 fused_ordering(809) 00:13:16.441 fused_ordering(810) 00:13:16.441 fused_ordering(811) 00:13:16.441 fused_ordering(812) 00:13:16.441 fused_ordering(813) 00:13:16.441 fused_ordering(814) 00:13:16.441 fused_ordering(815) 00:13:16.441 fused_ordering(816) 00:13:16.441 fused_ordering(817) 00:13:16.441 fused_ordering(818) 00:13:16.441 fused_ordering(819) 00:13:16.441 fused_ordering(820) 00:13:17.013 fused_ordering(821) 00:13:17.013 fused_ordering(822) 00:13:17.013 fused_ordering(823) 00:13:17.013 fused_ordering(824) 00:13:17.013 fused_ordering(825) 00:13:17.013 fused_ordering(826) 00:13:17.013 fused_ordering(827) 00:13:17.013 fused_ordering(828) 00:13:17.013 fused_ordering(829) 00:13:17.013 fused_ordering(830) 00:13:17.013 fused_ordering(831) 00:13:17.013 fused_ordering(832) 00:13:17.013 fused_ordering(833) 00:13:17.013 fused_ordering(834) 00:13:17.013 fused_ordering(835) 00:13:17.013 fused_ordering(836) 00:13:17.013 fused_ordering(837) 00:13:17.013 fused_ordering(838) 00:13:17.013 fused_ordering(839) 00:13:17.013 fused_ordering(840) 00:13:17.013 fused_ordering(841) 00:13:17.013 fused_ordering(842) 00:13:17.013 fused_ordering(843) 00:13:17.013 fused_ordering(844) 00:13:17.013 fused_ordering(845) 00:13:17.013 fused_ordering(846) 00:13:17.013 fused_ordering(847) 00:13:17.013 fused_ordering(848) 00:13:17.013 fused_ordering(849) 00:13:17.013 fused_ordering(850) 00:13:17.013 fused_ordering(851) 00:13:17.013 fused_ordering(852) 00:13:17.013 fused_ordering(853) 00:13:17.013 fused_ordering(854) 00:13:17.013 fused_ordering(855) 00:13:17.013 fused_ordering(856) 00:13:17.013 fused_ordering(857) 00:13:17.013 fused_ordering(858) 00:13:17.013 fused_ordering(859) 00:13:17.013 fused_ordering(860) 00:13:17.013 fused_ordering(861) 00:13:17.013 fused_ordering(862) 00:13:17.013 fused_ordering(863) 00:13:17.013 fused_ordering(864) 00:13:17.013 fused_ordering(865) 00:13:17.013 fused_ordering(866) 00:13:17.013 fused_ordering(867) 00:13:17.013 fused_ordering(868) 00:13:17.013 fused_ordering(869) 00:13:17.013 fused_ordering(870) 00:13:17.013 fused_ordering(871) 00:13:17.013 fused_ordering(872) 00:13:17.013 fused_ordering(873) 00:13:17.013 fused_ordering(874) 00:13:17.013 fused_ordering(875) 00:13:17.013 fused_ordering(876) 00:13:17.013 fused_ordering(877) 00:13:17.013 fused_ordering(878) 00:13:17.013 fused_ordering(879) 00:13:17.013 fused_ordering(880) 00:13:17.013 fused_ordering(881) 00:13:17.013 fused_ordering(882) 00:13:17.013 fused_ordering(883) 00:13:17.013 fused_ordering(884) 00:13:17.013 fused_ordering(885) 00:13:17.013 fused_ordering(886) 00:13:17.013 fused_ordering(887) 00:13:17.013 fused_ordering(888) 00:13:17.013 fused_ordering(889) 00:13:17.013 fused_ordering(890) 00:13:17.013 fused_ordering(891) 00:13:17.013 fused_ordering(892) 00:13:17.013 fused_ordering(893) 00:13:17.013 fused_ordering(894) 00:13:17.013 fused_ordering(895) 00:13:17.013 fused_ordering(896) 00:13:17.013 fused_ordering(897) 00:13:17.013 fused_ordering(898) 00:13:17.013 fused_ordering(899) 00:13:17.013 fused_ordering(900) 00:13:17.013 fused_ordering(901) 00:13:17.013 fused_ordering(902) 00:13:17.013 fused_ordering(903) 00:13:17.013 fused_ordering(904) 00:13:17.013 fused_ordering(905) 00:13:17.013 fused_ordering(906) 00:13:17.013 fused_ordering(907) 00:13:17.013 fused_ordering(908) 00:13:17.013 fused_ordering(909) 00:13:17.013 fused_ordering(910) 00:13:17.013 fused_ordering(911) 00:13:17.013 fused_ordering(912) 00:13:17.013 fused_ordering(913) 00:13:17.013 fused_ordering(914) 00:13:17.013 fused_ordering(915) 00:13:17.013 fused_ordering(916) 00:13:17.013 fused_ordering(917) 00:13:17.013 fused_ordering(918) 00:13:17.013 fused_ordering(919) 00:13:17.013 fused_ordering(920) 00:13:17.013 fused_ordering(921) 00:13:17.013 fused_ordering(922) 00:13:17.013 fused_ordering(923) 00:13:17.013 fused_ordering(924) 00:13:17.013 fused_ordering(925) 00:13:17.013 fused_ordering(926) 00:13:17.013 fused_ordering(927) 00:13:17.013 fused_ordering(928) 00:13:17.013 fused_ordering(929) 00:13:17.013 fused_ordering(930) 00:13:17.013 fused_ordering(931) 00:13:17.013 fused_ordering(932) 00:13:17.013 fused_ordering(933) 00:13:17.013 fused_ordering(934) 00:13:17.013 fused_ordering(935) 00:13:17.013 fused_ordering(936) 00:13:17.013 fused_ordering(937) 00:13:17.013 fused_ordering(938) 00:13:17.013 fused_ordering(939) 00:13:17.013 fused_ordering(940) 00:13:17.013 fused_ordering(941) 00:13:17.013 fused_ordering(942) 00:13:17.013 fused_ordering(943) 00:13:17.013 fused_ordering(944) 00:13:17.013 fused_ordering(945) 00:13:17.013 fused_ordering(946) 00:13:17.013 fused_ordering(947) 00:13:17.013 fused_ordering(948) 00:13:17.013 fused_ordering(949) 00:13:17.013 fused_ordering(950) 00:13:17.013 fused_ordering(951) 00:13:17.013 fused_ordering(952) 00:13:17.013 fused_ordering(953) 00:13:17.013 fused_ordering(954) 00:13:17.013 fused_ordering(955) 00:13:17.013 fused_ordering(956) 00:13:17.013 fused_ordering(957) 00:13:17.013 fused_ordering(958) 00:13:17.013 fused_ordering(959) 00:13:17.013 fused_ordering(960) 00:13:17.013 fused_ordering(961) 00:13:17.013 fused_ordering(962) 00:13:17.013 fused_ordering(963) 00:13:17.013 fused_ordering(964) 00:13:17.013 fused_ordering(965) 00:13:17.013 fused_ordering(966) 00:13:17.013 fused_ordering(967) 00:13:17.013 fused_ordering(968) 00:13:17.013 fused_ordering(969) 00:13:17.013 fused_ordering(970) 00:13:17.013 fused_ordering(971) 00:13:17.013 fused_ordering(972) 00:13:17.013 fused_ordering(973) 00:13:17.013 fused_ordering(974) 00:13:17.013 fused_ordering(975) 00:13:17.013 fused_ordering(976) 00:13:17.013 fused_ordering(977) 00:13:17.013 fused_ordering(978) 00:13:17.013 fused_ordering(979) 00:13:17.013 fused_ordering(980) 00:13:17.013 fused_ordering(981) 00:13:17.013 fused_ordering(982) 00:13:17.013 fused_ordering(983) 00:13:17.013 fused_ordering(984) 00:13:17.013 fused_ordering(985) 00:13:17.013 fused_ordering(986) 00:13:17.013 fused_ordering(987) 00:13:17.013 fused_ordering(988) 00:13:17.013 fused_ordering(989) 00:13:17.013 fused_ordering(990) 00:13:17.013 fused_ordering(991) 00:13:17.013 fused_ordering(992) 00:13:17.013 fused_ordering(993) 00:13:17.013 fused_ordering(994) 00:13:17.013 fused_ordering(995) 00:13:17.013 fused_ordering(996) 00:13:17.013 fused_ordering(997) 00:13:17.013 fused_ordering(998) 00:13:17.013 fused_ordering(999) 00:13:17.013 fused_ordering(1000) 00:13:17.013 fused_ordering(1001) 00:13:17.013 fused_ordering(1002) 00:13:17.013 fused_ordering(1003) 00:13:17.013 fused_ordering(1004) 00:13:17.013 fused_ordering(1005) 00:13:17.013 fused_ordering(1006) 00:13:17.013 fused_ordering(1007) 00:13:17.013 fused_ordering(1008) 00:13:17.013 fused_ordering(1009) 00:13:17.013 fused_ordering(1010) 00:13:17.013 fused_ordering(1011) 00:13:17.013 fused_ordering(1012) 00:13:17.013 fused_ordering(1013) 00:13:17.013 fused_ordering(1014) 00:13:17.013 fused_ordering(1015) 00:13:17.013 fused_ordering(1016) 00:13:17.013 fused_ordering(1017) 00:13:17.013 fused_ordering(1018) 00:13:17.013 fused_ordering(1019) 00:13:17.013 fused_ordering(1020) 00:13:17.013 fused_ordering(1021) 00:13:17.013 fused_ordering(1022) 00:13:17.013 fused_ordering(1023) 00:13:17.013 12:27:10 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:17.013 12:27:10 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:17.013 12:27:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:17.013 12:27:10 -- nvmf/common.sh@116 -- # sync 00:13:17.013 12:27:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:17.013 12:27:10 -- nvmf/common.sh@119 -- # set +e 00:13:17.013 12:27:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:17.013 12:27:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:17.013 rmmod nvme_tcp 00:13:17.013 rmmod nvme_fabrics 00:13:17.013 rmmod nvme_keyring 00:13:17.013 12:27:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:17.013 12:27:10 -- nvmf/common.sh@123 -- # set -e 00:13:17.013 12:27:10 -- nvmf/common.sh@124 -- # return 0 00:13:17.013 12:27:10 -- nvmf/common.sh@477 -- # '[' -n 1235553 ']' 00:13:17.013 12:27:10 -- nvmf/common.sh@478 -- # killprocess 1235553 00:13:17.013 12:27:10 -- common/autotest_common.sh@926 -- # '[' -z 1235553 ']' 00:13:17.013 12:27:10 -- common/autotest_common.sh@930 -- # kill -0 1235553 00:13:17.013 12:27:10 -- common/autotest_common.sh@931 -- # uname 00:13:17.013 12:27:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:17.013 12:27:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1235553 00:13:17.273 12:27:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:17.274 12:27:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:17.274 12:27:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1235553' 00:13:17.274 killing process with pid 1235553 00:13:17.274 12:27:10 -- common/autotest_common.sh@945 -- # kill 1235553 00:13:17.274 12:27:10 -- common/autotest_common.sh@950 -- # wait 1235553 00:13:17.532 12:27:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:17.532 12:27:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:17.532 12:27:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:17.532 12:27:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:17.532 12:27:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:17.532 12:27:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:17.532 12:27:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:17.532 12:27:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.436 12:27:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:19.436 00:13:19.436 real 0m8.202s 00:13:19.436 user 0m6.125s 00:13:19.436 sys 0m3.175s 00:13:19.436 12:27:13 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:19.436 12:27:13 -- common/autotest_common.sh@10 -- # set +x 00:13:19.436 ************************************ 00:13:19.436 END TEST nvmf_fused_ordering 00:13:19.436 ************************************ 00:13:19.436 12:27:13 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:19.436 12:27:13 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:19.436 12:27:13 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:19.436 12:27:13 -- common/autotest_common.sh@10 -- # set +x 00:13:19.436 ************************************ 00:13:19.436 START TEST nvmf_delete_subsystem 00:13:19.436 ************************************ 00:13:19.436 12:27:13 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:19.436 * Looking for test storage... 00:13:19.436 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:19.436 12:27:13 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:19.436 12:27:13 -- nvmf/common.sh@7 -- # uname -s 00:13:19.436 12:27:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:19.436 12:27:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:19.436 12:27:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:19.436 12:27:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:19.436 12:27:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:19.436 12:27:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:19.436 12:27:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:19.436 12:27:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:19.436 12:27:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:19.436 12:27:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:19.436 12:27:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.436 12:27:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:19.436 12:27:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:19.436 12:27:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:19.436 12:27:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:19.436 12:27:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:19.436 12:27:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:19.436 12:27:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:19.436 12:27:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:19.436 12:27:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.436 12:27:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.436 12:27:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.436 12:27:13 -- paths/export.sh@5 -- # export PATH 00:13:19.436 12:27:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:19.436 12:27:13 -- nvmf/common.sh@46 -- # : 0 00:13:19.436 12:27:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:19.436 12:27:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:19.436 12:27:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:19.436 12:27:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:19.436 12:27:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:19.436 12:27:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:19.436 12:27:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:19.436 12:27:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:19.436 12:27:13 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:19.436 12:27:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:19.436 12:27:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:19.436 12:27:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:19.436 12:27:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:19.436 12:27:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:19.436 12:27:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:19.436 12:27:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:19.436 12:27:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:19.436 12:27:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:19.436 12:27:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:19.436 12:27:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:19.436 12:27:13 -- common/autotest_common.sh@10 -- # set +x 00:13:21.341 12:27:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:21.341 12:27:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:21.341 12:27:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:21.341 12:27:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:21.341 12:27:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:21.341 12:27:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:21.341 12:27:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:21.341 12:27:15 -- nvmf/common.sh@294 -- # net_devs=() 00:13:21.341 12:27:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:21.341 12:27:15 -- nvmf/common.sh@295 -- # e810=() 00:13:21.341 12:27:15 -- nvmf/common.sh@295 -- # local -ga e810 00:13:21.341 12:27:15 -- nvmf/common.sh@296 -- # x722=() 00:13:21.341 12:27:15 -- nvmf/common.sh@296 -- # local -ga x722 00:13:21.341 12:27:15 -- nvmf/common.sh@297 -- # mlx=() 00:13:21.341 12:27:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:21.341 12:27:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:21.341 12:27:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:21.341 12:27:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:21.341 12:27:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:21.341 12:27:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.341 12:27:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:21.341 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:21.341 12:27:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:21.341 12:27:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:21.341 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:21.341 12:27:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:21.341 12:27:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:21.341 12:27:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.341 12:27:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.341 12:27:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.341 12:27:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.341 12:27:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:21.341 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:21.341 12:27:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.342 12:27:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:21.342 12:27:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:21.342 12:27:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:21.342 12:27:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:21.342 12:27:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:21.342 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:21.342 12:27:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:21.342 12:27:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:21.342 12:27:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:21.342 12:27:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:21.342 12:27:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:21.342 12:27:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:21.342 12:27:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:21.342 12:27:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:21.342 12:27:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:21.342 12:27:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:21.342 12:27:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:21.342 12:27:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:21.342 12:27:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:21.342 12:27:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:21.342 12:27:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:21.342 12:27:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:21.342 12:27:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:21.342 12:27:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:21.342 12:27:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:21.342 12:27:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:21.342 12:27:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:21.342 12:27:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:21.342 12:27:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:21.600 12:27:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:21.600 12:27:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:21.600 12:27:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:21.600 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:21.601 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.114 ms 00:13:21.601 00:13:21.601 --- 10.0.0.2 ping statistics --- 00:13:21.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.601 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:13:21.601 12:27:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:21.601 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:21.601 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:13:21.601 00:13:21.601 --- 10.0.0.1 ping statistics --- 00:13:21.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:21.601 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:13:21.601 12:27:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:21.601 12:27:15 -- nvmf/common.sh@410 -- # return 0 00:13:21.601 12:27:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:21.601 12:27:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:21.601 12:27:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:21.601 12:27:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:21.601 12:27:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:21.601 12:27:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:21.601 12:27:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:21.601 12:27:15 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:21.601 12:27:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:21.601 12:27:15 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:21.601 12:27:15 -- common/autotest_common.sh@10 -- # set +x 00:13:21.601 12:27:15 -- nvmf/common.sh@469 -- # nvmfpid=1238432 00:13:21.601 12:27:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:21.601 12:27:15 -- nvmf/common.sh@470 -- # waitforlisten 1238432 00:13:21.601 12:27:15 -- common/autotest_common.sh@819 -- # '[' -z 1238432 ']' 00:13:21.601 12:27:15 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:21.601 12:27:15 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:21.601 12:27:15 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:21.601 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:21.601 12:27:15 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:21.601 12:27:15 -- common/autotest_common.sh@10 -- # set +x 00:13:21.601 [2024-07-12 12:27:15.355357] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:21.601 [2024-07-12 12:27:15.355429] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:21.601 EAL: No free 2048 kB hugepages reported on node 1 00:13:21.601 [2024-07-12 12:27:15.420228] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:21.860 [2024-07-12 12:27:15.537678] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:21.860 [2024-07-12 12:27:15.537843] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:21.860 [2024-07-12 12:27:15.537883] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:21.860 [2024-07-12 12:27:15.537899] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:21.860 [2024-07-12 12:27:15.537955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:21.860 [2024-07-12 12:27:15.537962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:22.428 12:27:16 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:22.428 12:27:16 -- common/autotest_common.sh@852 -- # return 0 00:13:22.428 12:27:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:22.428 12:27:16 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:22.428 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.428 12:27:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:22.428 12:27:16 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:22.428 12:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.428 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.428 [2024-07-12 12:27:16.304266] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:22.428 12:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.428 12:27:16 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:22.428 12:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.428 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.428 12:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.428 12:27:16 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:22.428 12:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.428 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.428 [2024-07-12 12:27:16.320504] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:22.428 12:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.428 12:27:16 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:22.428 12:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.429 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.429 NULL1 00:13:22.429 12:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.429 12:27:16 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:22.429 12:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.429 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.429 Delay0 00:13:22.429 12:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.429 12:27:16 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.429 12:27:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:22.429 12:27:16 -- common/autotest_common.sh@10 -- # set +x 00:13:22.687 12:27:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:22.687 12:27:16 -- target/delete_subsystem.sh@28 -- # perf_pid=1238590 00:13:22.687 12:27:16 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:22.687 12:27:16 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:22.687 EAL: No free 2048 kB hugepages reported on node 1 00:13:22.687 [2024-07-12 12:27:16.395117] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:24.584 12:27:18 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:24.584 12:27:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:24.584 12:27:18 -- common/autotest_common.sh@10 -- # set +x 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.584 [2024-07-12 12:27:18.476621] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf6e10 is same with the state(5) to be set 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 Read completed with error (sct=0, sc=8) 00:13:24.584 starting I/O failed: -6 00:13:24.584 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 [2024-07-12 12:27:18.477395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf79b0 is same with the state(5) to be set 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 Write completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 Read completed with error (sct=0, sc=8) 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:24.585 starting I/O failed: -6 00:13:25.973 [2024-07-12 12:27:19.453934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d165a0 is same with the state(5) to be set 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 [2024-07-12 12:27:19.479008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf7c60 is same with the state(5) to be set 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 [2024-07-12 12:27:19.480132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fa7e000c1d0 is same with the state(5) to be set 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 [2024-07-12 12:27:19.480410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7fa7e000bf20 is same with the state(5) to be set 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Write completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 Read completed with error (sct=0, sc=8) 00:13:25.973 [2024-07-12 12:27:19.480610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cf6f90 is same with the state(5) to be set 00:13:25.973 [2024-07-12 12:27:19.481909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d165a0 (9): Bad file descriptor 00:13:25.973 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:25.973 12:27:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:25.973 12:27:19 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:25.973 12:27:19 -- target/delete_subsystem.sh@35 -- # kill -0 1238590 00:13:25.973 12:27:19 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:25.973 Initializing NVMe Controllers 00:13:25.973 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:25.973 Controller IO queue size 128, less than required. 00:13:25.973 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:25.973 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:25.973 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:25.973 Initialization complete. Launching workers. 00:13:25.973 ======================================================== 00:13:25.973 Latency(us) 00:13:25.973 Device Information : IOPS MiB/s Average min max 00:13:25.973 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 169.25 0.08 897187.34 732.76 1012832.33 00:13:25.973 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 176.69 0.09 955045.02 548.90 2004973.65 00:13:25.973 ======================================================== 00:13:25.973 Total : 345.94 0.17 926738.75 548.90 2004973.65 00:13:25.973 00:13:26.231 12:27:19 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:26.231 12:27:19 -- target/delete_subsystem.sh@35 -- # kill -0 1238590 00:13:26.231 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1238590) - No such process 00:13:26.231 12:27:19 -- target/delete_subsystem.sh@45 -- # NOT wait 1238590 00:13:26.231 12:27:19 -- common/autotest_common.sh@640 -- # local es=0 00:13:26.231 12:27:19 -- common/autotest_common.sh@642 -- # valid_exec_arg wait 1238590 00:13:26.231 12:27:19 -- common/autotest_common.sh@628 -- # local arg=wait 00:13:26.231 12:27:19 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:26.231 12:27:19 -- common/autotest_common.sh@632 -- # type -t wait 00:13:26.231 12:27:19 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:13:26.231 12:27:19 -- common/autotest_common.sh@643 -- # wait 1238590 00:13:26.231 12:27:19 -- common/autotest_common.sh@643 -- # es=1 00:13:26.231 12:27:19 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:13:26.231 12:27:19 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:13:26.231 12:27:19 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:13:26.231 12:27:19 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:26.231 12:27:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:26.231 12:27:19 -- common/autotest_common.sh@10 -- # set +x 00:13:26.231 12:27:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:26.231 12:27:19 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.231 12:27:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:26.231 12:27:19 -- common/autotest_common.sh@10 -- # set +x 00:13:26.231 [2024-07-12 12:27:19.999387] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.231 12:27:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:26.231 12:27:20 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.231 12:27:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:26.231 12:27:20 -- common/autotest_common.sh@10 -- # set +x 00:13:26.231 12:27:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:26.231 12:27:20 -- target/delete_subsystem.sh@54 -- # perf_pid=1239007 00:13:26.231 12:27:20 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:26.231 12:27:20 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:26.231 12:27:20 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:26.231 12:27:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:26.231 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.231 [2024-07-12 12:27:20.056580] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:26.795 12:27:20 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:26.795 12:27:20 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:26.795 12:27:20 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:27.358 12:27:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.358 12:27:21 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:27.358 12:27:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:27.613 12:27:21 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:27.613 12:27:21 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:27.613 12:27:21 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.177 12:27:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.177 12:27:22 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:28.177 12:27:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:28.740 12:27:22 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:28.740 12:27:22 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:28.740 12:27:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:29.316 12:27:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:29.316 12:27:23 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:29.316 12:27:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:29.579 Initializing NVMe Controllers 00:13:29.579 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:29.579 Controller IO queue size 128, less than required. 00:13:29.579 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:29.579 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:29.579 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:29.579 Initialization complete. Launching workers. 00:13:29.579 ======================================================== 00:13:29.579 Latency(us) 00:13:29.579 Device Information : IOPS MiB/s Average min max 00:13:29.579 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003024.77 1000156.59 1009856.26 00:13:29.579 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004363.49 1000191.73 1011332.97 00:13:29.579 ======================================================== 00:13:29.579 Total : 256.00 0.12 1003694.13 1000156.59 1011332.97 00:13:29.579 00:13:29.861 12:27:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:29.861 12:27:23 -- target/delete_subsystem.sh@57 -- # kill -0 1239007 00:13:29.861 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1239007) - No such process 00:13:29.861 12:27:23 -- target/delete_subsystem.sh@67 -- # wait 1239007 00:13:29.861 12:27:23 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:29.861 12:27:23 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:29.861 12:27:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:29.861 12:27:23 -- nvmf/common.sh@116 -- # sync 00:13:29.861 12:27:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:29.861 12:27:23 -- nvmf/common.sh@119 -- # set +e 00:13:29.861 12:27:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:29.861 12:27:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:29.861 rmmod nvme_tcp 00:13:29.861 rmmod nvme_fabrics 00:13:29.861 rmmod nvme_keyring 00:13:29.861 12:27:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:29.861 12:27:23 -- nvmf/common.sh@123 -- # set -e 00:13:29.861 12:27:23 -- nvmf/common.sh@124 -- # return 0 00:13:29.861 12:27:23 -- nvmf/common.sh@477 -- # '[' -n 1238432 ']' 00:13:29.861 12:27:23 -- nvmf/common.sh@478 -- # killprocess 1238432 00:13:29.861 12:27:23 -- common/autotest_common.sh@926 -- # '[' -z 1238432 ']' 00:13:29.861 12:27:23 -- common/autotest_common.sh@930 -- # kill -0 1238432 00:13:29.861 12:27:23 -- common/autotest_common.sh@931 -- # uname 00:13:29.861 12:27:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:29.861 12:27:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1238432 00:13:29.861 12:27:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:29.861 12:27:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:29.861 12:27:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1238432' 00:13:29.862 killing process with pid 1238432 00:13:29.862 12:27:23 -- common/autotest_common.sh@945 -- # kill 1238432 00:13:29.862 12:27:23 -- common/autotest_common.sh@950 -- # wait 1238432 00:13:30.121 12:27:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:30.121 12:27:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:30.121 12:27:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:30.121 12:27:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:30.121 12:27:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:30.121 12:27:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.121 12:27:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.121 12:27:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.018 12:27:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:32.276 00:13:32.276 real 0m12.654s 00:13:32.276 user 0m28.893s 00:13:32.276 sys 0m2.896s 00:13:32.276 12:27:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:32.276 12:27:25 -- common/autotest_common.sh@10 -- # set +x 00:13:32.276 ************************************ 00:13:32.276 END TEST nvmf_delete_subsystem 00:13:32.276 ************************************ 00:13:32.276 12:27:25 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:13:32.276 12:27:25 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:32.276 12:27:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:32.276 12:27:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:32.276 12:27:25 -- common/autotest_common.sh@10 -- # set +x 00:13:32.276 ************************************ 00:13:32.276 START TEST nvmf_nvme_cli 00:13:32.276 ************************************ 00:13:32.276 12:27:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:13:32.276 * Looking for test storage... 00:13:32.276 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:32.276 12:27:26 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:32.277 12:27:26 -- nvmf/common.sh@7 -- # uname -s 00:13:32.277 12:27:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:32.277 12:27:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:32.277 12:27:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:32.277 12:27:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:32.277 12:27:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:32.277 12:27:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:32.277 12:27:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:32.277 12:27:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:32.277 12:27:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:32.277 12:27:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:32.277 12:27:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.277 12:27:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.277 12:27:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:32.277 12:27:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:32.277 12:27:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:32.277 12:27:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:32.277 12:27:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:32.277 12:27:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:32.277 12:27:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:32.277 12:27:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.277 12:27:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.277 12:27:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.277 12:27:26 -- paths/export.sh@5 -- # export PATH 00:13:32.277 12:27:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.277 12:27:26 -- nvmf/common.sh@46 -- # : 0 00:13:32.277 12:27:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:32.277 12:27:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:32.277 12:27:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:32.277 12:27:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:32.277 12:27:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:32.277 12:27:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:32.277 12:27:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:32.277 12:27:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:32.277 12:27:26 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:32.277 12:27:26 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:32.277 12:27:26 -- target/nvme_cli.sh@14 -- # devs=() 00:13:32.277 12:27:26 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:13:32.277 12:27:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:32.277 12:27:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:32.277 12:27:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:32.277 12:27:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:32.277 12:27:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:32.277 12:27:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.277 12:27:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.277 12:27:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.277 12:27:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:32.277 12:27:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:32.277 12:27:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:32.277 12:27:26 -- common/autotest_common.sh@10 -- # set +x 00:13:34.177 12:27:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:34.177 12:27:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:34.177 12:27:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:34.177 12:27:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:34.177 12:27:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:34.177 12:27:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:34.177 12:27:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:34.177 12:27:27 -- nvmf/common.sh@294 -- # net_devs=() 00:13:34.177 12:27:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:34.177 12:27:27 -- nvmf/common.sh@295 -- # e810=() 00:13:34.177 12:27:27 -- nvmf/common.sh@295 -- # local -ga e810 00:13:34.177 12:27:27 -- nvmf/common.sh@296 -- # x722=() 00:13:34.177 12:27:27 -- nvmf/common.sh@296 -- # local -ga x722 00:13:34.177 12:27:27 -- nvmf/common.sh@297 -- # mlx=() 00:13:34.177 12:27:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:34.177 12:27:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:34.177 12:27:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:34.177 12:27:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:34.177 12:27:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:34.177 12:27:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:34.177 12:27:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:34.177 12:27:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:34.177 12:27:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.178 12:27:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:34.178 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:34.178 12:27:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.178 12:27:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:34.178 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:34.178 12:27:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:34.178 12:27:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.178 12:27:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.178 12:27:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.178 12:27:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.178 12:27:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:34.178 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:34.178 12:27:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.178 12:27:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.178 12:27:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.178 12:27:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.178 12:27:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.178 12:27:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:34.178 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:34.178 12:27:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.178 12:27:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:34.178 12:27:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:34.178 12:27:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:34.178 12:27:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:34.178 12:27:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:34.178 12:27:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:34.178 12:27:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:34.178 12:27:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:34.178 12:27:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:34.178 12:27:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:34.178 12:27:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:34.178 12:27:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:34.178 12:27:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:34.178 12:27:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:34.178 12:27:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:34.178 12:27:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:34.178 12:27:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:34.178 12:27:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:34.178 12:27:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:34.178 12:27:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:34.178 12:27:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:34.178 12:27:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:34.178 12:27:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:34.178 12:27:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:34.178 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:34.178 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:13:34.178 00:13:34.178 --- 10.0.0.2 ping statistics --- 00:13:34.178 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:34.178 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:13:34.178 12:27:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:34.178 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:34.178 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:13:34.178 00:13:34.178 --- 10.0.0.1 ping statistics --- 00:13:34.178 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:34.178 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:13:34.178 12:27:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:34.178 12:27:28 -- nvmf/common.sh@410 -- # return 0 00:13:34.178 12:27:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:34.178 12:27:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:34.178 12:27:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:34.178 12:27:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:34.178 12:27:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:34.178 12:27:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:34.178 12:27:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:34.178 12:27:28 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:13:34.178 12:27:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:34.178 12:27:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:34.178 12:27:28 -- common/autotest_common.sh@10 -- # set +x 00:13:34.178 12:27:28 -- nvmf/common.sh@469 -- # nvmfpid=1241367 00:13:34.178 12:27:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:34.178 12:27:28 -- nvmf/common.sh@470 -- # waitforlisten 1241367 00:13:34.178 12:27:28 -- common/autotest_common.sh@819 -- # '[' -z 1241367 ']' 00:13:34.178 12:27:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:34.178 12:27:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:34.178 12:27:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:34.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:34.178 12:27:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:34.178 12:27:28 -- common/autotest_common.sh@10 -- # set +x 00:13:34.436 [2024-07-12 12:27:28.132018] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:34.436 [2024-07-12 12:27:28.132105] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:34.436 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.436 [2024-07-12 12:27:28.198962] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:34.436 [2024-07-12 12:27:28.306598] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:34.436 [2024-07-12 12:27:28.306755] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:34.436 [2024-07-12 12:27:28.306771] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:34.436 [2024-07-12 12:27:28.306782] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:34.436 [2024-07-12 12:27:28.306872] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:34.436 [2024-07-12 12:27:28.306943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:34.436 [2024-07-12 12:27:28.306914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:34.436 [2024-07-12 12:27:28.306956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:35.369 12:27:29 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:35.369 12:27:29 -- common/autotest_common.sh@852 -- # return 0 00:13:35.369 12:27:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:35.369 12:27:29 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:35.369 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.369 12:27:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:35.369 12:27:29 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 [2024-07-12 12:27:29.141487] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 Malloc0 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 Malloc1 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 [2024-07-12 12:27:29.224666] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:35.370 12:27:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:35.370 12:27:29 -- common/autotest_common.sh@10 -- # set +x 00:13:35.370 12:27:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:35.370 12:27:29 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:13:35.627 00:13:35.627 Discovery Log Number of Records 2, Generation counter 2 00:13:35.627 =====Discovery Log Entry 0====== 00:13:35.627 trtype: tcp 00:13:35.627 adrfam: ipv4 00:13:35.627 subtype: current discovery subsystem 00:13:35.627 treq: not required 00:13:35.627 portid: 0 00:13:35.627 trsvcid: 4420 00:13:35.627 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:13:35.627 traddr: 10.0.0.2 00:13:35.627 eflags: explicit discovery connections, duplicate discovery information 00:13:35.627 sectype: none 00:13:35.627 =====Discovery Log Entry 1====== 00:13:35.627 trtype: tcp 00:13:35.627 adrfam: ipv4 00:13:35.627 subtype: nvme subsystem 00:13:35.627 treq: not required 00:13:35.627 portid: 0 00:13:35.627 trsvcid: 4420 00:13:35.627 subnqn: nqn.2016-06.io.spdk:cnode1 00:13:35.627 traddr: 10.0.0.2 00:13:35.627 eflags: none 00:13:35.627 sectype: none 00:13:35.627 12:27:29 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:13:35.627 12:27:29 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:13:35.627 12:27:29 -- nvmf/common.sh@510 -- # local dev _ 00:13:35.627 12:27:29 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:35.627 12:27:29 -- nvmf/common.sh@509 -- # nvme list 00:13:35.627 12:27:29 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:35.627 12:27:29 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:35.627 12:27:29 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:35.627 12:27:29 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:35.628 12:27:29 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:13:35.628 12:27:29 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:36.192 12:27:30 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:13:36.192 12:27:30 -- common/autotest_common.sh@1177 -- # local i=0 00:13:36.192 12:27:30 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:13:36.192 12:27:30 -- common/autotest_common.sh@1179 -- # [[ -n 2 ]] 00:13:36.192 12:27:30 -- common/autotest_common.sh@1180 -- # nvme_device_counter=2 00:13:36.192 12:27:30 -- common/autotest_common.sh@1184 -- # sleep 2 00:13:38.089 12:27:32 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:13:38.346 12:27:32 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:13:38.346 12:27:32 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:13:38.346 12:27:32 -- common/autotest_common.sh@1186 -- # nvme_devices=2 00:13:38.346 12:27:32 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:13:38.346 12:27:32 -- common/autotest_common.sh@1187 -- # return 0 00:13:38.346 12:27:32 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:13:38.346 12:27:32 -- nvmf/common.sh@510 -- # local dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@509 -- # nvme list 00:13:38.346 12:27:32 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:38.346 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:38.346 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:38.346 12:27:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:38.346 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:38.346 12:27:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:38.346 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.346 12:27:32 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:13:38.346 /dev/nvme0n1 ]] 00:13:38.346 12:27:32 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:13:38.346 12:27:32 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:13:38.346 12:27:32 -- nvmf/common.sh@510 -- # local dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.346 12:27:32 -- nvmf/common.sh@509 -- # nvme list 00:13:38.604 12:27:32 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:13:38.604 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.604 12:27:32 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:13:38.604 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.604 12:27:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:13:38.604 12:27:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:13:38.604 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.604 12:27:32 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:13:38.604 12:27:32 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:13:38.604 12:27:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:13:38.604 12:27:32 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:13:38.604 12:27:32 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:38.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:38.862 12:27:32 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:38.862 12:27:32 -- common/autotest_common.sh@1198 -- # local i=0 00:13:38.862 12:27:32 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:13:38.862 12:27:32 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:38.862 12:27:32 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:13:38.862 12:27:32 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:38.862 12:27:32 -- common/autotest_common.sh@1210 -- # return 0 00:13:38.862 12:27:32 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:13:38.862 12:27:32 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:38.862 12:27:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:38.863 12:27:32 -- common/autotest_common.sh@10 -- # set +x 00:13:38.863 12:27:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:38.863 12:27:32 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:38.863 12:27:32 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:13:38.863 12:27:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:38.863 12:27:32 -- nvmf/common.sh@116 -- # sync 00:13:38.863 12:27:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:38.863 12:27:32 -- nvmf/common.sh@119 -- # set +e 00:13:38.863 12:27:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:38.863 12:27:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:38.863 rmmod nvme_tcp 00:13:38.863 rmmod nvme_fabrics 00:13:38.863 rmmod nvme_keyring 00:13:38.863 12:27:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:38.863 12:27:32 -- nvmf/common.sh@123 -- # set -e 00:13:38.863 12:27:32 -- nvmf/common.sh@124 -- # return 0 00:13:38.863 12:27:32 -- nvmf/common.sh@477 -- # '[' -n 1241367 ']' 00:13:38.863 12:27:32 -- nvmf/common.sh@478 -- # killprocess 1241367 00:13:38.863 12:27:32 -- common/autotest_common.sh@926 -- # '[' -z 1241367 ']' 00:13:38.863 12:27:32 -- common/autotest_common.sh@930 -- # kill -0 1241367 00:13:38.863 12:27:32 -- common/autotest_common.sh@931 -- # uname 00:13:38.863 12:27:32 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:38.863 12:27:32 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1241367 00:13:38.863 12:27:32 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:13:38.863 12:27:32 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:13:38.863 12:27:32 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1241367' 00:13:38.863 killing process with pid 1241367 00:13:38.863 12:27:32 -- common/autotest_common.sh@945 -- # kill 1241367 00:13:38.863 12:27:32 -- common/autotest_common.sh@950 -- # wait 1241367 00:13:39.121 12:27:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:39.121 12:27:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:39.121 12:27:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:39.121 12:27:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:39.121 12:27:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:39.121 12:27:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.121 12:27:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.121 12:27:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:41.649 12:27:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:41.649 00:13:41.649 real 0m9.056s 00:13:41.649 user 0m19.118s 00:13:41.649 sys 0m2.172s 00:13:41.649 12:27:35 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:41.649 12:27:35 -- common/autotest_common.sh@10 -- # set +x 00:13:41.649 ************************************ 00:13:41.649 END TEST nvmf_nvme_cli 00:13:41.649 ************************************ 00:13:41.649 12:27:35 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:13:41.649 12:27:35 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:41.649 12:27:35 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:41.650 12:27:35 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:41.650 12:27:35 -- common/autotest_common.sh@10 -- # set +x 00:13:41.650 ************************************ 00:13:41.650 START TEST nvmf_host_management 00:13:41.650 ************************************ 00:13:41.650 12:27:35 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:13:41.650 * Looking for test storage... 00:13:41.650 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:41.650 12:27:35 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:41.650 12:27:35 -- nvmf/common.sh@7 -- # uname -s 00:13:41.650 12:27:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:41.650 12:27:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:41.650 12:27:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:41.650 12:27:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:41.650 12:27:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:41.650 12:27:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:41.650 12:27:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:41.650 12:27:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:41.650 12:27:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:41.650 12:27:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:41.650 12:27:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:41.650 12:27:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:41.650 12:27:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:41.650 12:27:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:41.650 12:27:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:41.650 12:27:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:41.650 12:27:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:41.650 12:27:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:41.650 12:27:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:41.650 12:27:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.650 12:27:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.650 12:27:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.650 12:27:35 -- paths/export.sh@5 -- # export PATH 00:13:41.650 12:27:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:41.650 12:27:35 -- nvmf/common.sh@46 -- # : 0 00:13:41.650 12:27:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:41.650 12:27:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:41.650 12:27:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:41.650 12:27:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:41.650 12:27:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:41.650 12:27:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:41.650 12:27:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:41.650 12:27:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:41.650 12:27:35 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:41.650 12:27:35 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:41.650 12:27:35 -- target/host_management.sh@104 -- # nvmftestinit 00:13:41.650 12:27:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:41.650 12:27:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:41.650 12:27:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:41.650 12:27:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:41.650 12:27:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:41.650 12:27:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:41.650 12:27:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:41.650 12:27:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:41.650 12:27:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:41.650 12:27:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:41.650 12:27:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:41.650 12:27:35 -- common/autotest_common.sh@10 -- # set +x 00:13:43.550 12:27:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:43.550 12:27:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:43.550 12:27:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:43.550 12:27:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:43.550 12:27:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:43.550 12:27:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:43.550 12:27:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:43.550 12:27:37 -- nvmf/common.sh@294 -- # net_devs=() 00:13:43.550 12:27:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:43.550 12:27:37 -- nvmf/common.sh@295 -- # e810=() 00:13:43.550 12:27:37 -- nvmf/common.sh@295 -- # local -ga e810 00:13:43.550 12:27:37 -- nvmf/common.sh@296 -- # x722=() 00:13:43.550 12:27:37 -- nvmf/common.sh@296 -- # local -ga x722 00:13:43.550 12:27:37 -- nvmf/common.sh@297 -- # mlx=() 00:13:43.550 12:27:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:43.550 12:27:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:43.550 12:27:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:43.550 12:27:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:43.551 12:27:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:43.551 12:27:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:43.551 12:27:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:43.551 12:27:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:43.551 12:27:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:43.551 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:43.551 12:27:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:43.551 12:27:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:43.551 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:43.551 12:27:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:43.551 12:27:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:43.551 12:27:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:43.551 12:27:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:43.551 12:27:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:43.551 12:27:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:43.551 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:43.551 12:27:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:43.551 12:27:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:43.551 12:27:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:43.551 12:27:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:43.551 12:27:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:43.551 12:27:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:43.551 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:43.551 12:27:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:43.551 12:27:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:43.551 12:27:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:43.551 12:27:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:43.551 12:27:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:43.551 12:27:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:43.551 12:27:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:43.551 12:27:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:43.551 12:27:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:43.551 12:27:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:43.551 12:27:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:43.551 12:27:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:43.551 12:27:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:43.551 12:27:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:43.551 12:27:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:43.551 12:27:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:43.551 12:27:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:43.551 12:27:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:43.551 12:27:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:43.551 12:27:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:43.551 12:27:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:43.551 12:27:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:43.551 12:27:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:43.551 12:27:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:43.551 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:43.551 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:13:43.551 00:13:43.551 --- 10.0.0.2 ping statistics --- 00:13:43.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:43.551 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:13:43.551 12:27:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:43.551 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:43.551 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:13:43.551 00:13:43.551 --- 10.0.0.1 ping statistics --- 00:13:43.551 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:43.551 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:13:43.551 12:27:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:43.551 12:27:37 -- nvmf/common.sh@410 -- # return 0 00:13:43.551 12:27:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:43.551 12:27:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:43.551 12:27:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:43.551 12:27:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:43.551 12:27:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:43.551 12:27:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:43.551 12:27:37 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:13:43.551 12:27:37 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:13:43.551 12:27:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:43.551 12:27:37 -- common/autotest_common.sh@10 -- # set +x 00:13:43.551 ************************************ 00:13:43.551 START TEST nvmf_host_management 00:13:43.551 ************************************ 00:13:43.551 12:27:37 -- common/autotest_common.sh@1104 -- # nvmf_host_management 00:13:43.551 12:27:37 -- target/host_management.sh@69 -- # starttarget 00:13:43.551 12:27:37 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:13:43.551 12:27:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:43.551 12:27:37 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:43.551 12:27:37 -- common/autotest_common.sh@10 -- # set +x 00:13:43.551 12:27:37 -- nvmf/common.sh@469 -- # nvmfpid=1243908 00:13:43.551 12:27:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:13:43.551 12:27:37 -- nvmf/common.sh@470 -- # waitforlisten 1243908 00:13:43.551 12:27:37 -- common/autotest_common.sh@819 -- # '[' -z 1243908 ']' 00:13:43.551 12:27:37 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:43.551 12:27:37 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:43.551 12:27:37 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:43.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:43.551 12:27:37 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:43.551 12:27:37 -- common/autotest_common.sh@10 -- # set +x 00:13:43.551 [2024-07-12 12:27:37.223733] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:43.551 [2024-07-12 12:27:37.223799] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:43.551 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.551 [2024-07-12 12:27:37.293717] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:43.552 [2024-07-12 12:27:37.413123] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:43.552 [2024-07-12 12:27:37.413293] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:43.552 [2024-07-12 12:27:37.413313] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:43.552 [2024-07-12 12:27:37.413327] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:43.552 [2024-07-12 12:27:37.413421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:43.552 [2024-07-12 12:27:37.413538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:43.552 [2024-07-12 12:27:37.413605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:43.552 [2024-07-12 12:27:37.413607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:44.484 12:27:38 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:44.484 12:27:38 -- common/autotest_common.sh@852 -- # return 0 00:13:44.484 12:27:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:44.484 12:27:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:44.484 12:27:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.484 12:27:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:44.484 12:27:38 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:44.484 12:27:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.484 12:27:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.484 [2024-07-12 12:27:38.222365] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:44.484 12:27:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.484 12:27:38 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:13:44.484 12:27:38 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:44.484 12:27:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.484 12:27:38 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:44.484 12:27:38 -- target/host_management.sh@23 -- # cat 00:13:44.484 12:27:38 -- target/host_management.sh@30 -- # rpc_cmd 00:13:44.484 12:27:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:44.484 12:27:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.484 Malloc0 00:13:44.484 [2024-07-12 12:27:38.281419] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:44.484 12:27:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:44.484 12:27:38 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:13:44.484 12:27:38 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:44.484 12:27:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.484 12:27:38 -- target/host_management.sh@73 -- # perfpid=1244089 00:13:44.484 12:27:38 -- target/host_management.sh@74 -- # waitforlisten 1244089 /var/tmp/bdevperf.sock 00:13:44.484 12:27:38 -- common/autotest_common.sh@819 -- # '[' -z 1244089 ']' 00:13:44.484 12:27:38 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:44.484 12:27:38 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:13:44.484 12:27:38 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:13:44.484 12:27:38 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:44.484 12:27:38 -- nvmf/common.sh@520 -- # config=() 00:13:44.484 12:27:38 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:44.484 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:44.484 12:27:38 -- nvmf/common.sh@520 -- # local subsystem config 00:13:44.484 12:27:38 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:44.484 12:27:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:44.484 12:27:38 -- common/autotest_common.sh@10 -- # set +x 00:13:44.484 12:27:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:44.484 { 00:13:44.484 "params": { 00:13:44.484 "name": "Nvme$subsystem", 00:13:44.484 "trtype": "$TEST_TRANSPORT", 00:13:44.484 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:44.484 "adrfam": "ipv4", 00:13:44.484 "trsvcid": "$NVMF_PORT", 00:13:44.484 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:44.484 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:44.484 "hdgst": ${hdgst:-false}, 00:13:44.484 "ddgst": ${ddgst:-false} 00:13:44.484 }, 00:13:44.484 "method": "bdev_nvme_attach_controller" 00:13:44.484 } 00:13:44.484 EOF 00:13:44.484 )") 00:13:44.484 12:27:38 -- nvmf/common.sh@542 -- # cat 00:13:44.484 12:27:38 -- nvmf/common.sh@544 -- # jq . 00:13:44.484 12:27:38 -- nvmf/common.sh@545 -- # IFS=, 00:13:44.484 12:27:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:44.484 "params": { 00:13:44.484 "name": "Nvme0", 00:13:44.484 "trtype": "tcp", 00:13:44.484 "traddr": "10.0.0.2", 00:13:44.484 "adrfam": "ipv4", 00:13:44.484 "trsvcid": "4420", 00:13:44.484 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:44.484 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:44.484 "hdgst": false, 00:13:44.484 "ddgst": false 00:13:44.484 }, 00:13:44.484 "method": "bdev_nvme_attach_controller" 00:13:44.484 }' 00:13:44.484 [2024-07-12 12:27:38.347481] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:44.484 [2024-07-12 12:27:38.347556] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1244089 ] 00:13:44.484 EAL: No free 2048 kB hugepages reported on node 1 00:13:44.741 [2024-07-12 12:27:38.410075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:44.741 [2024-07-12 12:27:38.518736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:44.999 Running I/O for 10 seconds... 00:13:45.567 12:27:39 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:45.567 12:27:39 -- common/autotest_common.sh@852 -- # return 0 00:13:45.567 12:27:39 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:13:45.567 12:27:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:45.567 12:27:39 -- common/autotest_common.sh@10 -- # set +x 00:13:45.567 12:27:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:45.567 12:27:39 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:45.567 12:27:39 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:13:45.567 12:27:39 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:13:45.567 12:27:39 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:13:45.567 12:27:39 -- target/host_management.sh@52 -- # local ret=1 00:13:45.567 12:27:39 -- target/host_management.sh@53 -- # local i 00:13:45.567 12:27:39 -- target/host_management.sh@54 -- # (( i = 10 )) 00:13:45.567 12:27:39 -- target/host_management.sh@54 -- # (( i != 0 )) 00:13:45.567 12:27:39 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:13:45.567 12:27:39 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:13:45.567 12:27:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:45.567 12:27:39 -- common/autotest_common.sh@10 -- # set +x 00:13:45.567 12:27:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:45.567 12:27:39 -- target/host_management.sh@55 -- # read_io_count=2558 00:13:45.567 12:27:39 -- target/host_management.sh@58 -- # '[' 2558 -ge 100 ']' 00:13:45.567 12:27:39 -- target/host_management.sh@59 -- # ret=0 00:13:45.567 12:27:39 -- target/host_management.sh@60 -- # break 00:13:45.567 12:27:39 -- target/host_management.sh@64 -- # return 0 00:13:45.567 12:27:39 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:45.567 12:27:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:45.567 12:27:39 -- common/autotest_common.sh@10 -- # set +x 00:13:45.567 [2024-07-12 12:27:39.394586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394673] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394718] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394733] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394749] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394762] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394774] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394786] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394801] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394813] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394838] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394853] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394872] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394904] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394921] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394933] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394948] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394973] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.394992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395007] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395019] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395031] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395046] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395059] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395071] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e7a480 is same with the state(5) to be set 00:13:45.567 [2024-07-12 12:27:39.395290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:86656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.567 [2024-07-12 12:27:39.395341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.567 [2024-07-12 12:27:39.395373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:86784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.567 [2024-07-12 12:27:39.395389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:87168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:87296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:87424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:87552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:87808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:87936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:88064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:88192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:88320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:88448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:88576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:88704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:88832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:88960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:89088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:89216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:89344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:89472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.395973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:82688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.395992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:89600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:89728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:82816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:82944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:83200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:83328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:83456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:89856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:89984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:90112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:90240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:83584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:90368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:90496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:83968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:90624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:90752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:90880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:84224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:91008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:84352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:91136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.568 [2024-07-12 12:27:39.396634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.568 [2024-07-12 12:27:39.396649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:91264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:91392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:84480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:91520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:91648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:91776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:91904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:84864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:84992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:85120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:85376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.396971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.396986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:85504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:85632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:85888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:92032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:92160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:92288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:86272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:86400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:86528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:13:45.569 [2024-07-12 12:27:39.397237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:13:45.569 [2024-07-12 12:27:39.397252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1516b50 is same with the state(5) to be set 00:13:45.569 [2024-07-12 12:27:39.397331] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1516b50 was disconnected and freed. reset controller. 00:13:45.569 12:27:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:45.569 12:27:39 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:13:45.569 12:27:39 -- common/autotest_common.sh@551 -- # xtrace_disable 00:13:45.569 12:27:39 -- common/autotest_common.sh@10 -- # set +x 00:13:45.569 [2024-07-12 12:27:39.398490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:13:45.569 task offset: 86656 on job bdev=Nvme0n1 fails 00:13:45.569 00:13:45.569 Latency(us) 00:13:45.569 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:45.569 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:45.569 Job: Nvme0n1 ended in about 0.70 seconds with error 00:13:45.569 Verification LBA range: start 0x0 length 0x400 00:13:45.569 Nvme0n1 : 0.70 3859.25 241.20 91.28 0.00 15965.73 4538.97 24855.13 00:13:45.569 =================================================================================================================== 00:13:45.569 Total : 3859.25 241.20 91.28 0.00 15965.73 4538.97 24855.13 00:13:45.569 [2024-07-12 12:27:39.400424] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:13:45.569 [2024-07-12 12:27:39.400457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1519400 (9): Bad file descriptor 00:13:45.569 12:27:39 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:13:45.569 12:27:39 -- target/host_management.sh@87 -- # sleep 1 00:13:45.569 [2024-07-12 12:27:39.407673] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:13:46.501 12:27:40 -- target/host_management.sh@91 -- # kill -9 1244089 00:13:46.501 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1244089) - No such process 00:13:46.501 12:27:40 -- target/host_management.sh@91 -- # true 00:13:46.501 12:27:40 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:13:46.501 12:27:40 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:13:46.501 12:27:40 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:13:46.501 12:27:40 -- nvmf/common.sh@520 -- # config=() 00:13:46.501 12:27:40 -- nvmf/common.sh@520 -- # local subsystem config 00:13:46.501 12:27:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:13:46.501 12:27:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:13:46.501 { 00:13:46.501 "params": { 00:13:46.501 "name": "Nvme$subsystem", 00:13:46.501 "trtype": "$TEST_TRANSPORT", 00:13:46.501 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:46.501 "adrfam": "ipv4", 00:13:46.501 "trsvcid": "$NVMF_PORT", 00:13:46.501 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:46.501 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:46.501 "hdgst": ${hdgst:-false}, 00:13:46.501 "ddgst": ${ddgst:-false} 00:13:46.501 }, 00:13:46.501 "method": "bdev_nvme_attach_controller" 00:13:46.501 } 00:13:46.501 EOF 00:13:46.501 )") 00:13:46.501 12:27:40 -- nvmf/common.sh@542 -- # cat 00:13:46.501 12:27:40 -- nvmf/common.sh@544 -- # jq . 00:13:46.501 12:27:40 -- nvmf/common.sh@545 -- # IFS=, 00:13:46.501 12:27:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:13:46.501 "params": { 00:13:46.501 "name": "Nvme0", 00:13:46.501 "trtype": "tcp", 00:13:46.501 "traddr": "10.0.0.2", 00:13:46.501 "adrfam": "ipv4", 00:13:46.501 "trsvcid": "4420", 00:13:46.501 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:13:46.501 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:13:46.501 "hdgst": false, 00:13:46.501 "ddgst": false 00:13:46.501 }, 00:13:46.501 "method": "bdev_nvme_attach_controller" 00:13:46.501 }' 00:13:46.759 [2024-07-12 12:27:40.451988] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:46.759 [2024-07-12 12:27:40.452069] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1244371 ] 00:13:46.759 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.759 [2024-07-12 12:27:40.512758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:46.759 [2024-07-12 12:27:40.624213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:47.016 Running I/O for 1 seconds... 00:13:48.388 00:13:48.388 Latency(us) 00:13:48.388 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:48.388 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:13:48.388 Verification LBA range: start 0x0 length 0x400 00:13:48.388 Nvme0n1 : 1.01 3997.98 249.87 0.00 0.00 15762.90 867.75 24563.86 00:13:48.388 =================================================================================================================== 00:13:48.388 Total : 3997.98 249.87 0.00 0.00 15762.90 867.75 24563.86 00:13:48.388 12:27:42 -- target/host_management.sh@101 -- # stoptarget 00:13:48.388 12:27:42 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:13:48.388 12:27:42 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:13:48.388 12:27:42 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:13:48.388 12:27:42 -- target/host_management.sh@40 -- # nvmftestfini 00:13:48.388 12:27:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:48.388 12:27:42 -- nvmf/common.sh@116 -- # sync 00:13:48.388 12:27:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:48.388 12:27:42 -- nvmf/common.sh@119 -- # set +e 00:13:48.388 12:27:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:48.388 12:27:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:48.388 rmmod nvme_tcp 00:13:48.388 rmmod nvme_fabrics 00:13:48.388 rmmod nvme_keyring 00:13:48.388 12:27:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:48.388 12:27:42 -- nvmf/common.sh@123 -- # set -e 00:13:48.388 12:27:42 -- nvmf/common.sh@124 -- # return 0 00:13:48.388 12:27:42 -- nvmf/common.sh@477 -- # '[' -n 1243908 ']' 00:13:48.388 12:27:42 -- nvmf/common.sh@478 -- # killprocess 1243908 00:13:48.388 12:27:42 -- common/autotest_common.sh@926 -- # '[' -z 1243908 ']' 00:13:48.388 12:27:42 -- common/autotest_common.sh@930 -- # kill -0 1243908 00:13:48.388 12:27:42 -- common/autotest_common.sh@931 -- # uname 00:13:48.388 12:27:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:13:48.388 12:27:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1243908 00:13:48.388 12:27:42 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:13:48.388 12:27:42 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:13:48.388 12:27:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1243908' 00:13:48.388 killing process with pid 1243908 00:13:48.388 12:27:42 -- common/autotest_common.sh@945 -- # kill 1243908 00:13:48.388 12:27:42 -- common/autotest_common.sh@950 -- # wait 1243908 00:13:48.646 [2024-07-12 12:27:42.558719] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:13:48.905 12:27:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:48.905 12:27:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:48.905 12:27:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:48.905 12:27:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:48.905 12:27:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:48.905 12:27:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.905 12:27:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:48.905 12:27:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.810 12:27:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:50.810 00:13:50.810 real 0m7.441s 00:13:50.810 user 0m22.930s 00:13:50.810 sys 0m1.535s 00:13:50.810 12:27:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:50.810 12:27:44 -- common/autotest_common.sh@10 -- # set +x 00:13:50.810 ************************************ 00:13:50.810 END TEST nvmf_host_management 00:13:50.810 ************************************ 00:13:50.810 12:27:44 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:13:50.810 00:13:50.810 real 0m9.595s 00:13:50.810 user 0m23.683s 00:13:50.810 sys 0m2.957s 00:13:50.810 12:27:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:13:50.810 12:27:44 -- common/autotest_common.sh@10 -- # set +x 00:13:50.810 ************************************ 00:13:50.810 END TEST nvmf_host_management 00:13:50.810 ************************************ 00:13:50.810 12:27:44 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:50.810 12:27:44 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:13:50.810 12:27:44 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:13:50.810 12:27:44 -- common/autotest_common.sh@10 -- # set +x 00:13:50.810 ************************************ 00:13:50.810 START TEST nvmf_lvol 00:13:50.810 ************************************ 00:13:50.810 12:27:44 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:13:50.810 * Looking for test storage... 00:13:51.107 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:51.107 12:27:44 -- nvmf/common.sh@7 -- # uname -s 00:13:51.107 12:27:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.107 12:27:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.107 12:27:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.107 12:27:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.107 12:27:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.107 12:27:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.107 12:27:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.107 12:27:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.107 12:27:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.107 12:27:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.107 12:27:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.107 12:27:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.107 12:27:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.107 12:27:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.107 12:27:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:51.107 12:27:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:51.107 12:27:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.107 12:27:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.107 12:27:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.107 12:27:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.107 12:27:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.107 12:27:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.107 12:27:44 -- paths/export.sh@5 -- # export PATH 00:13:51.107 12:27:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.107 12:27:44 -- nvmf/common.sh@46 -- # : 0 00:13:51.107 12:27:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:51.107 12:27:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:51.107 12:27:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:51.107 12:27:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.107 12:27:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.107 12:27:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:51.107 12:27:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:51.107 12:27:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:51.107 12:27:44 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:13:51.107 12:27:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:51.107 12:27:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:51.107 12:27:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:51.107 12:27:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:51.107 12:27:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:51.107 12:27:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.107 12:27:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.107 12:27:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.107 12:27:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:51.107 12:27:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:51.107 12:27:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:51.107 12:27:44 -- common/autotest_common.sh@10 -- # set +x 00:13:53.020 12:27:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:53.020 12:27:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:53.020 12:27:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:53.020 12:27:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:53.020 12:27:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:53.020 12:27:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:53.020 12:27:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:53.020 12:27:46 -- nvmf/common.sh@294 -- # net_devs=() 00:13:53.020 12:27:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:53.020 12:27:46 -- nvmf/common.sh@295 -- # e810=() 00:13:53.020 12:27:46 -- nvmf/common.sh@295 -- # local -ga e810 00:13:53.020 12:27:46 -- nvmf/common.sh@296 -- # x722=() 00:13:53.020 12:27:46 -- nvmf/common.sh@296 -- # local -ga x722 00:13:53.020 12:27:46 -- nvmf/common.sh@297 -- # mlx=() 00:13:53.020 12:27:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:53.020 12:27:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:53.020 12:27:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:53.020 12:27:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:53.020 12:27:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:53.020 12:27:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.020 12:27:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:53.020 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:53.020 12:27:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.020 12:27:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:53.020 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:53.020 12:27:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.020 12:27:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:53.020 12:27:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:53.021 12:27:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:53.021 12:27:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.021 12:27:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.021 12:27:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.021 12:27:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.021 12:27:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:53.021 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:53.021 12:27:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.021 12:27:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.021 12:27:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.021 12:27:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.021 12:27:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.021 12:27:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:53.021 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:53.021 12:27:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.021 12:27:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:53.021 12:27:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:53.021 12:27:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:53.021 12:27:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:53.021 12:27:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:53.021 12:27:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:53.021 12:27:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:53.021 12:27:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:53.021 12:27:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:53.021 12:27:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:53.021 12:27:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:53.021 12:27:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:53.021 12:27:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:53.021 12:27:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:53.021 12:27:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:53.021 12:27:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:53.021 12:27:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:53.021 12:27:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:53.021 12:27:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:53.021 12:27:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:53.021 12:27:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:53.021 12:27:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:53.021 12:27:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:53.021 12:27:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:53.021 12:27:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:53.021 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:53.021 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:13:53.021 00:13:53.021 --- 10.0.0.2 ping statistics --- 00:13:53.021 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.021 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:13:53.021 12:27:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:53.021 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:53.021 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:13:53.021 00:13:53.021 --- 10.0.0.1 ping statistics --- 00:13:53.021 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.021 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:13:53.021 12:27:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:53.021 12:27:46 -- nvmf/common.sh@410 -- # return 0 00:13:53.021 12:27:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:53.021 12:27:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:53.021 12:27:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:53.021 12:27:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:53.021 12:27:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:53.021 12:27:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:53.021 12:27:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:53.021 12:27:46 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:13:53.021 12:27:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:53.021 12:27:46 -- common/autotest_common.sh@712 -- # xtrace_disable 00:13:53.021 12:27:46 -- common/autotest_common.sh@10 -- # set +x 00:13:53.021 12:27:46 -- nvmf/common.sh@469 -- # nvmfpid=1246613 00:13:53.021 12:27:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:13:53.021 12:27:46 -- nvmf/common.sh@470 -- # waitforlisten 1246613 00:13:53.021 12:27:46 -- common/autotest_common.sh@819 -- # '[' -z 1246613 ']' 00:13:53.021 12:27:46 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:53.021 12:27:46 -- common/autotest_common.sh@824 -- # local max_retries=100 00:13:53.021 12:27:46 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:53.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:53.021 12:27:46 -- common/autotest_common.sh@828 -- # xtrace_disable 00:13:53.021 12:27:46 -- common/autotest_common.sh@10 -- # set +x 00:13:53.021 [2024-07-12 12:27:46.910162] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:13:53.021 [2024-07-12 12:27:46.910260] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:53.279 EAL: No free 2048 kB hugepages reported on node 1 00:13:53.279 [2024-07-12 12:27:46.974394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:53.279 [2024-07-12 12:27:47.079222] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:53.279 [2024-07-12 12:27:47.079365] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:53.279 [2024-07-12 12:27:47.079382] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:53.279 [2024-07-12 12:27:47.079395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:53.279 [2024-07-12 12:27:47.079452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:53.279 [2024-07-12 12:27:47.079511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:53.279 [2024-07-12 12:27:47.079514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:54.216 12:27:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:13:54.216 12:27:47 -- common/autotest_common.sh@852 -- # return 0 00:13:54.216 12:27:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:54.216 12:27:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:13:54.216 12:27:47 -- common/autotest_common.sh@10 -- # set +x 00:13:54.216 12:27:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:54.216 12:27:47 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:54.474 [2024-07-12 12:27:48.148303] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:54.474 12:27:48 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:54.733 12:27:48 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:13:54.733 12:27:48 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:13:54.991 12:27:48 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:13:54.991 12:27:48 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:13:55.251 12:27:48 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:13:55.510 12:27:49 -- target/nvmf_lvol.sh@29 -- # lvs=1f77dc54-d93f-417f-a149-de867b23067d 00:13:55.510 12:27:49 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1f77dc54-d93f-417f-a149-de867b23067d lvol 20 00:13:55.510 12:27:49 -- target/nvmf_lvol.sh@32 -- # lvol=436697be-4ca7-4f3e-adc1-f842c0fb6653 00:13:55.510 12:27:49 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:55.768 12:27:49 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 436697be-4ca7-4f3e-adc1-f842c0fb6653 00:13:56.026 12:27:49 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:56.283 [2024-07-12 12:27:50.127814] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:56.283 12:27:50 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:56.540 12:27:50 -- target/nvmf_lvol.sh@42 -- # perf_pid=1247053 00:13:56.540 12:27:50 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:13:56.540 12:27:50 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:13:56.540 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.477 12:27:51 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 436697be-4ca7-4f3e-adc1-f842c0fb6653 MY_SNAPSHOT 00:13:57.735 12:27:51 -- target/nvmf_lvol.sh@47 -- # snapshot=49de9c40-6a72-4fc8-8b79-4f3a5abaa8ae 00:13:57.735 12:27:51 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 436697be-4ca7-4f3e-adc1-f842c0fb6653 30 00:13:58.303 12:27:51 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 49de9c40-6a72-4fc8-8b79-4f3a5abaa8ae MY_CLONE 00:13:58.303 12:27:52 -- target/nvmf_lvol.sh@49 -- # clone=7ea94385-8d34-40a3-afbe-49dc15371597 00:13:58.303 12:27:52 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 7ea94385-8d34-40a3-afbe-49dc15371597 00:13:58.870 12:27:52 -- target/nvmf_lvol.sh@53 -- # wait 1247053 00:14:06.989 Initializing NVMe Controllers 00:14:06.989 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:06.989 Controller IO queue size 128, less than required. 00:14:06.989 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:06.989 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:06.989 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:06.989 Initialization complete. Launching workers. 00:14:06.989 ======================================================== 00:14:06.989 Latency(us) 00:14:06.989 Device Information : IOPS MiB/s Average min max 00:14:06.989 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10920.00 42.66 11724.17 1413.89 62454.75 00:14:06.989 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10815.60 42.25 11842.80 2042.84 70058.77 00:14:06.989 ======================================================== 00:14:06.989 Total : 21735.60 84.90 11783.20 1413.89 70058.77 00:14:06.989 00:14:06.989 12:28:00 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:07.246 12:28:01 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 436697be-4ca7-4f3e-adc1-f842c0fb6653 00:14:07.503 12:28:01 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 1f77dc54-d93f-417f-a149-de867b23067d 00:14:07.760 12:28:01 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:07.760 12:28:01 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:07.760 12:28:01 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:07.760 12:28:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:07.760 12:28:01 -- nvmf/common.sh@116 -- # sync 00:14:07.760 12:28:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:07.760 12:28:01 -- nvmf/common.sh@119 -- # set +e 00:14:07.760 12:28:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:07.760 12:28:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:07.760 rmmod nvme_tcp 00:14:07.760 rmmod nvme_fabrics 00:14:07.760 rmmod nvme_keyring 00:14:08.019 12:28:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:08.019 12:28:01 -- nvmf/common.sh@123 -- # set -e 00:14:08.019 12:28:01 -- nvmf/common.sh@124 -- # return 0 00:14:08.019 12:28:01 -- nvmf/common.sh@477 -- # '[' -n 1246613 ']' 00:14:08.019 12:28:01 -- nvmf/common.sh@478 -- # killprocess 1246613 00:14:08.019 12:28:01 -- common/autotest_common.sh@926 -- # '[' -z 1246613 ']' 00:14:08.019 12:28:01 -- common/autotest_common.sh@930 -- # kill -0 1246613 00:14:08.019 12:28:01 -- common/autotest_common.sh@931 -- # uname 00:14:08.019 12:28:01 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:08.019 12:28:01 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1246613 00:14:08.019 12:28:01 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:08.019 12:28:01 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:08.019 12:28:01 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1246613' 00:14:08.019 killing process with pid 1246613 00:14:08.019 12:28:01 -- common/autotest_common.sh@945 -- # kill 1246613 00:14:08.019 12:28:01 -- common/autotest_common.sh@950 -- # wait 1246613 00:14:08.278 12:28:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:08.278 12:28:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:08.278 12:28:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:08.278 12:28:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:08.278 12:28:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:08.278 12:28:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.278 12:28:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.278 12:28:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.180 12:28:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:10.180 00:14:10.180 real 0m19.415s 00:14:10.180 user 1m6.358s 00:14:10.180 sys 0m5.451s 00:14:10.180 12:28:04 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:10.180 12:28:04 -- common/autotest_common.sh@10 -- # set +x 00:14:10.180 ************************************ 00:14:10.180 END TEST nvmf_lvol 00:14:10.180 ************************************ 00:14:10.437 12:28:04 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:10.437 12:28:04 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:10.437 12:28:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:10.437 12:28:04 -- common/autotest_common.sh@10 -- # set +x 00:14:10.437 ************************************ 00:14:10.437 START TEST nvmf_lvs_grow 00:14:10.437 ************************************ 00:14:10.437 12:28:04 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:10.437 * Looking for test storage... 00:14:10.437 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:10.437 12:28:04 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:10.437 12:28:04 -- nvmf/common.sh@7 -- # uname -s 00:14:10.437 12:28:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:10.437 12:28:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:10.437 12:28:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:10.437 12:28:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:10.437 12:28:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:10.437 12:28:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:10.437 12:28:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:10.437 12:28:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:10.437 12:28:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:10.437 12:28:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:10.437 12:28:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.437 12:28:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.437 12:28:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:10.437 12:28:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:10.437 12:28:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:10.437 12:28:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:10.437 12:28:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:10.437 12:28:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:10.437 12:28:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:10.437 12:28:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.437 12:28:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.437 12:28:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.437 12:28:04 -- paths/export.sh@5 -- # export PATH 00:14:10.437 12:28:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.437 12:28:04 -- nvmf/common.sh@46 -- # : 0 00:14:10.437 12:28:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:10.437 12:28:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:10.437 12:28:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:10.437 12:28:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:10.437 12:28:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:10.437 12:28:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:10.437 12:28:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:10.437 12:28:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:10.437 12:28:04 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:10.437 12:28:04 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:10.437 12:28:04 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:10.437 12:28:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:10.437 12:28:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:10.437 12:28:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:10.437 12:28:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:10.437 12:28:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:10.437 12:28:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.437 12:28:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.437 12:28:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.437 12:28:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:10.437 12:28:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:10.437 12:28:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:10.437 12:28:04 -- common/autotest_common.sh@10 -- # set +x 00:14:12.373 12:28:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:12.373 12:28:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:12.373 12:28:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:12.373 12:28:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:12.373 12:28:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:12.373 12:28:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:12.373 12:28:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:12.373 12:28:06 -- nvmf/common.sh@294 -- # net_devs=() 00:14:12.373 12:28:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:12.373 12:28:06 -- nvmf/common.sh@295 -- # e810=() 00:14:12.373 12:28:06 -- nvmf/common.sh@295 -- # local -ga e810 00:14:12.373 12:28:06 -- nvmf/common.sh@296 -- # x722=() 00:14:12.373 12:28:06 -- nvmf/common.sh@296 -- # local -ga x722 00:14:12.373 12:28:06 -- nvmf/common.sh@297 -- # mlx=() 00:14:12.373 12:28:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:12.373 12:28:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:12.373 12:28:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:12.373 12:28:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:12.373 12:28:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:12.373 12:28:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:12.373 12:28:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:12.373 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:12.373 12:28:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:12.373 12:28:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:12.373 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:12.373 12:28:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:12.373 12:28:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:12.373 12:28:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.373 12:28:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:12.373 12:28:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.373 12:28:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:12.373 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:12.373 12:28:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.373 12:28:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:12.373 12:28:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.373 12:28:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:12.373 12:28:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.373 12:28:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:12.373 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:12.373 12:28:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.373 12:28:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:12.373 12:28:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:12.373 12:28:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:12.373 12:28:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:12.373 12:28:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:12.373 12:28:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:12.373 12:28:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:12.373 12:28:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:12.373 12:28:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:12.373 12:28:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:12.373 12:28:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:12.373 12:28:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:12.373 12:28:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:12.373 12:28:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:12.373 12:28:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:12.373 12:28:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:12.373 12:28:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:12.373 12:28:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:12.373 12:28:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:12.373 12:28:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:12.373 12:28:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:12.373 12:28:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:12.373 12:28:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:12.373 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:12.373 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.171 ms 00:14:12.373 00:14:12.373 --- 10.0.0.2 ping statistics --- 00:14:12.373 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.373 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:14:12.373 12:28:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:12.373 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:12.373 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:14:12.373 00:14:12.373 --- 10.0.0.1 ping statistics --- 00:14:12.373 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.373 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:14:12.373 12:28:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:12.373 12:28:06 -- nvmf/common.sh@410 -- # return 0 00:14:12.373 12:28:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:12.373 12:28:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:12.373 12:28:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:12.373 12:28:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:12.373 12:28:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:12.373 12:28:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:12.373 12:28:06 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:12.373 12:28:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:12.373 12:28:06 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:12.373 12:28:06 -- common/autotest_common.sh@10 -- # set +x 00:14:12.373 12:28:06 -- nvmf/common.sh@469 -- # nvmfpid=1250363 00:14:12.373 12:28:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:12.373 12:28:06 -- nvmf/common.sh@470 -- # waitforlisten 1250363 00:14:12.373 12:28:06 -- common/autotest_common.sh@819 -- # '[' -z 1250363 ']' 00:14:12.373 12:28:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:12.373 12:28:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:12.373 12:28:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:12.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:12.373 12:28:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:12.373 12:28:06 -- common/autotest_common.sh@10 -- # set +x 00:14:12.373 [2024-07-12 12:28:06.246380] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:12.374 [2024-07-12 12:28:06.246457] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:12.374 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.633 [2024-07-12 12:28:06.311411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:12.633 [2024-07-12 12:28:06.425019] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:12.633 [2024-07-12 12:28:06.425183] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:12.633 [2024-07-12 12:28:06.425202] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:12.633 [2024-07-12 12:28:06.425216] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:12.633 [2024-07-12 12:28:06.425249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:13.569 12:28:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:13.569 12:28:07 -- common/autotest_common.sh@852 -- # return 0 00:14:13.569 12:28:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:13.569 12:28:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:13.569 12:28:07 -- common/autotest_common.sh@10 -- # set +x 00:14:13.569 12:28:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:13.569 [2024-07-12 12:28:07.468007] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:13.569 12:28:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:14:13.569 12:28:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:13.569 12:28:07 -- common/autotest_common.sh@10 -- # set +x 00:14:13.569 ************************************ 00:14:13.569 START TEST lvs_grow_clean 00:14:13.569 ************************************ 00:14:13.569 12:28:07 -- common/autotest_common.sh@1104 -- # lvs_grow 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.569 12:28:07 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:13.827 12:28:07 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:13.827 12:28:07 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:13.827 12:28:07 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:14.085 12:28:07 -- target/nvmf_lvs_grow.sh@28 -- # lvs=aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:14.085 12:28:07 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:14.085 12:28:07 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:14.344 12:28:08 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:14.344 12:28:08 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:14.344 12:28:08 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc lvol 150 00:14:14.601 12:28:08 -- target/nvmf_lvs_grow.sh@33 -- # lvol=5494b6ad-c1b1-4433-9790-b1459e14cb9a 00:14:14.601 12:28:08 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:14.601 12:28:08 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:14.922 [2024-07-12 12:28:08.677963] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:14.922 [2024-07-12 12:28:08.678053] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:14.922 true 00:14:14.922 12:28:08 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:14.922 12:28:08 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:15.196 12:28:08 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:15.196 12:28:08 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:15.453 12:28:09 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 5494b6ad-c1b1-4433-9790-b1459e14cb9a 00:14:15.711 12:28:09 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:15.711 [2024-07-12 12:28:09.628939] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:15.969 12:28:09 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:15.969 12:28:09 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1250815 00:14:15.969 12:28:09 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:15.969 12:28:09 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:15.969 12:28:09 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1250815 /var/tmp/bdevperf.sock 00:14:15.969 12:28:09 -- common/autotest_common.sh@819 -- # '[' -z 1250815 ']' 00:14:15.969 12:28:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:15.969 12:28:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:15.969 12:28:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:15.969 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:15.969 12:28:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:15.969 12:28:09 -- common/autotest_common.sh@10 -- # set +x 00:14:16.227 [2024-07-12 12:28:09.916503] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:16.227 [2024-07-12 12:28:09.916591] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1250815 ] 00:14:16.227 EAL: No free 2048 kB hugepages reported on node 1 00:14:16.227 [2024-07-12 12:28:09.978379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:16.227 [2024-07-12 12:28:10.097378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:17.162 12:28:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:17.162 12:28:10 -- common/autotest_common.sh@852 -- # return 0 00:14:17.162 12:28:10 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:17.419 Nvme0n1 00:14:17.419 12:28:11 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:17.676 [ 00:14:17.676 { 00:14:17.676 "name": "Nvme0n1", 00:14:17.676 "aliases": [ 00:14:17.676 "5494b6ad-c1b1-4433-9790-b1459e14cb9a" 00:14:17.676 ], 00:14:17.676 "product_name": "NVMe disk", 00:14:17.676 "block_size": 4096, 00:14:17.676 "num_blocks": 38912, 00:14:17.676 "uuid": "5494b6ad-c1b1-4433-9790-b1459e14cb9a", 00:14:17.676 "assigned_rate_limits": { 00:14:17.676 "rw_ios_per_sec": 0, 00:14:17.676 "rw_mbytes_per_sec": 0, 00:14:17.676 "r_mbytes_per_sec": 0, 00:14:17.676 "w_mbytes_per_sec": 0 00:14:17.676 }, 00:14:17.676 "claimed": false, 00:14:17.676 "zoned": false, 00:14:17.676 "supported_io_types": { 00:14:17.676 "read": true, 00:14:17.676 "write": true, 00:14:17.676 "unmap": true, 00:14:17.676 "write_zeroes": true, 00:14:17.676 "flush": true, 00:14:17.676 "reset": true, 00:14:17.676 "compare": true, 00:14:17.676 "compare_and_write": true, 00:14:17.676 "abort": true, 00:14:17.676 "nvme_admin": true, 00:14:17.676 "nvme_io": true 00:14:17.676 }, 00:14:17.676 "driver_specific": { 00:14:17.676 "nvme": [ 00:14:17.676 { 00:14:17.676 "trid": { 00:14:17.676 "trtype": "TCP", 00:14:17.676 "adrfam": "IPv4", 00:14:17.676 "traddr": "10.0.0.2", 00:14:17.676 "trsvcid": "4420", 00:14:17.676 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:17.676 }, 00:14:17.676 "ctrlr_data": { 00:14:17.676 "cntlid": 1, 00:14:17.676 "vendor_id": "0x8086", 00:14:17.676 "model_number": "SPDK bdev Controller", 00:14:17.676 "serial_number": "SPDK0", 00:14:17.676 "firmware_revision": "24.01.1", 00:14:17.676 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:17.676 "oacs": { 00:14:17.676 "security": 0, 00:14:17.676 "format": 0, 00:14:17.676 "firmware": 0, 00:14:17.676 "ns_manage": 0 00:14:17.676 }, 00:14:17.676 "multi_ctrlr": true, 00:14:17.676 "ana_reporting": false 00:14:17.676 }, 00:14:17.676 "vs": { 00:14:17.676 "nvme_version": "1.3" 00:14:17.676 }, 00:14:17.676 "ns_data": { 00:14:17.676 "id": 1, 00:14:17.676 "can_share": true 00:14:17.676 } 00:14:17.676 } 00:14:17.676 ], 00:14:17.676 "mp_policy": "active_passive" 00:14:17.676 } 00:14:17.676 } 00:14:17.677 ] 00:14:17.677 12:28:11 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1251084 00:14:17.677 12:28:11 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:17.677 12:28:11 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:17.948 Running I/O for 10 seconds... 00:14:18.887 Latency(us) 00:14:18.887 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:18.887 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:18.887 Nvme0n1 : 1.00 14763.00 57.67 0.00 0.00 0.00 0.00 0.00 00:14:18.887 =================================================================================================================== 00:14:18.887 Total : 14763.00 57.67 0.00 0.00 0.00 0.00 0.00 00:14:18.887 00:14:19.822 12:28:13 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:19.822 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:19.822 Nvme0n1 : 2.00 14915.50 58.26 0.00 0.00 0.00 0.00 0.00 00:14:19.822 =================================================================================================================== 00:14:19.822 Total : 14915.50 58.26 0.00 0.00 0.00 0.00 0.00 00:14:19.822 00:14:20.080 true 00:14:20.080 12:28:13 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:20.080 12:28:13 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:20.338 12:28:14 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:20.338 12:28:14 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:20.338 12:28:14 -- target/nvmf_lvs_grow.sh@65 -- # wait 1251084 00:14:20.903 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:20.903 Nvme0n1 : 3.00 15046.33 58.77 0.00 0.00 0.00 0.00 0.00 00:14:20.903 =================================================================================================================== 00:14:20.903 Total : 15046.33 58.77 0.00 0.00 0.00 0.00 0.00 00:14:20.903 00:14:21.840 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:21.840 Nvme0n1 : 4.00 15113.50 59.04 0.00 0.00 0.00 0.00 0.00 00:14:21.840 =================================================================================================================== 00:14:21.840 Total : 15113.50 59.04 0.00 0.00 0.00 0.00 0.00 00:14:21.840 00:14:22.776 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:22.776 Nvme0n1 : 5.00 15155.20 59.20 0.00 0.00 0.00 0.00 0.00 00:14:22.776 =================================================================================================================== 00:14:22.776 Total : 15155.20 59.20 0.00 0.00 0.00 0.00 0.00 00:14:22.776 00:14:23.714 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:23.714 Nvme0n1 : 6.00 15202.00 59.38 0.00 0.00 0.00 0.00 0.00 00:14:23.714 =================================================================================================================== 00:14:23.714 Total : 15202.00 59.38 0.00 0.00 0.00 0.00 0.00 00:14:23.714 00:14:25.091 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:25.091 Nvme0n1 : 7.00 15248.57 59.56 0.00 0.00 0.00 0.00 0.00 00:14:25.091 =================================================================================================================== 00:14:25.091 Total : 15248.57 59.56 0.00 0.00 0.00 0.00 0.00 00:14:25.091 00:14:26.027 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.027 Nvme0n1 : 8.00 15282.00 59.70 0.00 0.00 0.00 0.00 0.00 00:14:26.027 =================================================================================================================== 00:14:26.028 Total : 15282.00 59.70 0.00 0.00 0.00 0.00 0.00 00:14:26.028 00:14:26.964 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:26.964 Nvme0n1 : 9.00 15308.11 59.80 0.00 0.00 0.00 0.00 0.00 00:14:26.964 =================================================================================================================== 00:14:26.964 Total : 15308.11 59.80 0.00 0.00 0.00 0.00 0.00 00:14:26.964 00:14:27.901 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.901 Nvme0n1 : 10.00 15334.10 59.90 0.00 0.00 0.00 0.00 0.00 00:14:27.901 =================================================================================================================== 00:14:27.901 Total : 15334.10 59.90 0.00 0.00 0.00 0.00 0.00 00:14:27.901 00:14:27.901 00:14:27.901 Latency(us) 00:14:27.901 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:27.901 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:27.901 Nvme0n1 : 10.01 15339.07 59.92 0.00 0.00 8340.24 4611.79 15825.73 00:14:27.901 =================================================================================================================== 00:14:27.901 Total : 15339.07 59.92 0.00 0.00 8340.24 4611.79 15825.73 00:14:27.901 0 00:14:27.901 12:28:21 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1250815 00:14:27.901 12:28:21 -- common/autotest_common.sh@926 -- # '[' -z 1250815 ']' 00:14:27.901 12:28:21 -- common/autotest_common.sh@930 -- # kill -0 1250815 00:14:27.901 12:28:21 -- common/autotest_common.sh@931 -- # uname 00:14:27.901 12:28:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:27.901 12:28:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1250815 00:14:27.901 12:28:21 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:27.901 12:28:21 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:27.901 12:28:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1250815' 00:14:27.902 killing process with pid 1250815 00:14:27.902 12:28:21 -- common/autotest_common.sh@945 -- # kill 1250815 00:14:27.902 Received shutdown signal, test time was about 10.000000 seconds 00:14:27.902 00:14:27.902 Latency(us) 00:14:27.902 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:27.902 =================================================================================================================== 00:14:27.902 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:27.902 12:28:21 -- common/autotest_common.sh@950 -- # wait 1250815 00:14:28.159 12:28:21 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:28.419 12:28:22 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:28.419 12:28:22 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:28.678 12:28:22 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:28.678 12:28:22 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:28.678 12:28:22 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:28.937 [2024-07-12 12:28:22.653635] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:28.937 12:28:22 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:28.937 12:28:22 -- common/autotest_common.sh@640 -- # local es=0 00:14:28.937 12:28:22 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:28.937 12:28:22 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.937 12:28:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:28.937 12:28:22 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.937 12:28:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:28.937 12:28:22 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.937 12:28:22 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:28.937 12:28:22 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:28.937 12:28:22 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:28.937 12:28:22 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:29.195 request: 00:14:29.195 { 00:14:29.195 "uuid": "aef655b4-cbd3-4745-8890-a2d9e9ba97cc", 00:14:29.195 "method": "bdev_lvol_get_lvstores", 00:14:29.195 "req_id": 1 00:14:29.195 } 00:14:29.195 Got JSON-RPC error response 00:14:29.195 response: 00:14:29.195 { 00:14:29.195 "code": -19, 00:14:29.195 "message": "No such device" 00:14:29.195 } 00:14:29.195 12:28:22 -- common/autotest_common.sh@643 -- # es=1 00:14:29.195 12:28:22 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:29.195 12:28:22 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:29.195 12:28:22 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:29.195 12:28:22 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:29.452 aio_bdev 00:14:29.452 12:28:23 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 5494b6ad-c1b1-4433-9790-b1459e14cb9a 00:14:29.452 12:28:23 -- common/autotest_common.sh@887 -- # local bdev_name=5494b6ad-c1b1-4433-9790-b1459e14cb9a 00:14:29.452 12:28:23 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:29.452 12:28:23 -- common/autotest_common.sh@889 -- # local i 00:14:29.452 12:28:23 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:29.452 12:28:23 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:29.452 12:28:23 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:29.710 12:28:23 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 5494b6ad-c1b1-4433-9790-b1459e14cb9a -t 2000 00:14:29.968 [ 00:14:29.968 { 00:14:29.968 "name": "5494b6ad-c1b1-4433-9790-b1459e14cb9a", 00:14:29.968 "aliases": [ 00:14:29.968 "lvs/lvol" 00:14:29.968 ], 00:14:29.968 "product_name": "Logical Volume", 00:14:29.968 "block_size": 4096, 00:14:29.968 "num_blocks": 38912, 00:14:29.968 "uuid": "5494b6ad-c1b1-4433-9790-b1459e14cb9a", 00:14:29.968 "assigned_rate_limits": { 00:14:29.968 "rw_ios_per_sec": 0, 00:14:29.968 "rw_mbytes_per_sec": 0, 00:14:29.968 "r_mbytes_per_sec": 0, 00:14:29.968 "w_mbytes_per_sec": 0 00:14:29.968 }, 00:14:29.968 "claimed": false, 00:14:29.968 "zoned": false, 00:14:29.968 "supported_io_types": { 00:14:29.968 "read": true, 00:14:29.968 "write": true, 00:14:29.968 "unmap": true, 00:14:29.968 "write_zeroes": true, 00:14:29.968 "flush": false, 00:14:29.968 "reset": true, 00:14:29.968 "compare": false, 00:14:29.968 "compare_and_write": false, 00:14:29.968 "abort": false, 00:14:29.968 "nvme_admin": false, 00:14:29.968 "nvme_io": false 00:14:29.968 }, 00:14:29.968 "driver_specific": { 00:14:29.968 "lvol": { 00:14:29.968 "lvol_store_uuid": "aef655b4-cbd3-4745-8890-a2d9e9ba97cc", 00:14:29.968 "base_bdev": "aio_bdev", 00:14:29.968 "thin_provision": false, 00:14:29.968 "snapshot": false, 00:14:29.968 "clone": false, 00:14:29.968 "esnap_clone": false 00:14:29.968 } 00:14:29.968 } 00:14:29.968 } 00:14:29.968 ] 00:14:29.968 12:28:23 -- common/autotest_common.sh@895 -- # return 0 00:14:29.968 12:28:23 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:29.968 12:28:23 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:30.226 12:28:23 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:30.226 12:28:23 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:30.226 12:28:23 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:30.484 12:28:24 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:30.484 12:28:24 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 5494b6ad-c1b1-4433-9790-b1459e14cb9a 00:14:30.742 12:28:24 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u aef655b4-cbd3-4745-8890-a2d9e9ba97cc 00:14:30.742 12:28:24 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:31.001 12:28:24 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.001 00:14:31.001 real 0m17.429s 00:14:31.001 user 0m17.195s 00:14:31.001 sys 0m1.816s 00:14:31.001 12:28:24 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:31.001 12:28:24 -- common/autotest_common.sh@10 -- # set +x 00:14:31.001 ************************************ 00:14:31.001 END TEST lvs_grow_clean 00:14:31.001 ************************************ 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:14:31.266 12:28:24 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:31.266 12:28:24 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:31.266 12:28:24 -- common/autotest_common.sh@10 -- # set +x 00:14:31.266 ************************************ 00:14:31.266 START TEST lvs_grow_dirty 00:14:31.266 ************************************ 00:14:31.266 12:28:24 -- common/autotest_common.sh@1104 -- # lvs_grow dirty 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:31.266 12:28:24 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:31.559 12:28:25 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:31.560 12:28:25 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:31.560 12:28:25 -- target/nvmf_lvs_grow.sh@28 -- # lvs=f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:31.821 12:28:25 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:31.821 12:28:25 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:31.822 12:28:25 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:31.822 12:28:25 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:31.822 12:28:25 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u f3e480d3-f045-48e5-add0-1a2f2db30cbc lvol 150 00:14:32.079 12:28:25 -- target/nvmf_lvs_grow.sh@33 -- # lvol=44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:32.079 12:28:25 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:32.079 12:28:25 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:32.337 [2024-07-12 12:28:26.204124] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:32.337 [2024-07-12 12:28:26.204253] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:32.337 true 00:14:32.337 12:28:26 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:32.337 12:28:26 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:32.595 12:28:26 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:32.595 12:28:26 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:32.855 12:28:26 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:33.114 12:28:26 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:33.371 12:28:27 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:33.628 12:28:27 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1253051 00:14:33.628 12:28:27 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:33.628 12:28:27 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:33.628 12:28:27 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1253051 /var/tmp/bdevperf.sock 00:14:33.628 12:28:27 -- common/autotest_common.sh@819 -- # '[' -z 1253051 ']' 00:14:33.628 12:28:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:33.628 12:28:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:33.628 12:28:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:33.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:33.628 12:28:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:33.628 12:28:27 -- common/autotest_common.sh@10 -- # set +x 00:14:33.628 [2024-07-12 12:28:27.442255] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:33.628 [2024-07-12 12:28:27.442336] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1253051 ] 00:14:33.628 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.628 [2024-07-12 12:28:27.503355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:33.887 [2024-07-12 12:28:27.617492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:34.823 12:28:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:34.823 12:28:28 -- common/autotest_common.sh@852 -- # return 0 00:14:34.823 12:28:28 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:35.081 Nvme0n1 00:14:35.081 12:28:28 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:35.081 [ 00:14:35.081 { 00:14:35.081 "name": "Nvme0n1", 00:14:35.081 "aliases": [ 00:14:35.081 "44b1447f-59c2-400e-ac8b-e309d24cb5f8" 00:14:35.081 ], 00:14:35.081 "product_name": "NVMe disk", 00:14:35.081 "block_size": 4096, 00:14:35.081 "num_blocks": 38912, 00:14:35.081 "uuid": "44b1447f-59c2-400e-ac8b-e309d24cb5f8", 00:14:35.081 "assigned_rate_limits": { 00:14:35.081 "rw_ios_per_sec": 0, 00:14:35.081 "rw_mbytes_per_sec": 0, 00:14:35.081 "r_mbytes_per_sec": 0, 00:14:35.081 "w_mbytes_per_sec": 0 00:14:35.081 }, 00:14:35.081 "claimed": false, 00:14:35.081 "zoned": false, 00:14:35.081 "supported_io_types": { 00:14:35.081 "read": true, 00:14:35.081 "write": true, 00:14:35.081 "unmap": true, 00:14:35.081 "write_zeroes": true, 00:14:35.081 "flush": true, 00:14:35.081 "reset": true, 00:14:35.081 "compare": true, 00:14:35.081 "compare_and_write": true, 00:14:35.081 "abort": true, 00:14:35.081 "nvme_admin": true, 00:14:35.081 "nvme_io": true 00:14:35.081 }, 00:14:35.081 "driver_specific": { 00:14:35.081 "nvme": [ 00:14:35.081 { 00:14:35.081 "trid": { 00:14:35.081 "trtype": "TCP", 00:14:35.081 "adrfam": "IPv4", 00:14:35.081 "traddr": "10.0.0.2", 00:14:35.081 "trsvcid": "4420", 00:14:35.081 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:35.081 }, 00:14:35.081 "ctrlr_data": { 00:14:35.081 "cntlid": 1, 00:14:35.081 "vendor_id": "0x8086", 00:14:35.081 "model_number": "SPDK bdev Controller", 00:14:35.081 "serial_number": "SPDK0", 00:14:35.081 "firmware_revision": "24.01.1", 00:14:35.081 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:35.081 "oacs": { 00:14:35.081 "security": 0, 00:14:35.081 "format": 0, 00:14:35.081 "firmware": 0, 00:14:35.081 "ns_manage": 0 00:14:35.081 }, 00:14:35.081 "multi_ctrlr": true, 00:14:35.081 "ana_reporting": false 00:14:35.081 }, 00:14:35.081 "vs": { 00:14:35.081 "nvme_version": "1.3" 00:14:35.081 }, 00:14:35.081 "ns_data": { 00:14:35.081 "id": 1, 00:14:35.081 "can_share": true 00:14:35.081 } 00:14:35.081 } 00:14:35.081 ], 00:14:35.081 "mp_policy": "active_passive" 00:14:35.081 } 00:14:35.081 } 00:14:35.081 ] 00:14:35.081 12:28:28 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1253197 00:14:35.081 12:28:28 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:35.081 12:28:28 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:35.341 Running I/O for 10 seconds... 00:14:36.276 Latency(us) 00:14:36.276 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:36.276 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:36.276 Nvme0n1 : 1.00 14742.00 57.59 0.00 0.00 0.00 0.00 0.00 00:14:36.276 =================================================================================================================== 00:14:36.277 Total : 14742.00 57.59 0.00 0.00 0.00 0.00 0.00 00:14:36.277 00:14:37.211 12:28:30 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:37.211 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:37.211 Nvme0n1 : 2.00 14874.00 58.10 0.00 0.00 0.00 0.00 0.00 00:14:37.211 =================================================================================================================== 00:14:37.211 Total : 14874.00 58.10 0.00 0.00 0.00 0.00 0.00 00:14:37.211 00:14:37.469 true 00:14:37.469 12:28:31 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:37.469 12:28:31 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:37.727 12:28:31 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:37.727 12:28:31 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:37.727 12:28:31 -- target/nvmf_lvs_grow.sh@65 -- # wait 1253197 00:14:38.295 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:38.295 Nvme0n1 : 3.00 14976.33 58.50 0.00 0.00 0.00 0.00 0.00 00:14:38.295 =================================================================================================================== 00:14:38.295 Total : 14976.33 58.50 0.00 0.00 0.00 0.00 0.00 00:14:38.295 00:14:39.230 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:39.230 Nvme0n1 : 4.00 15075.75 58.89 0.00 0.00 0.00 0.00 0.00 00:14:39.230 =================================================================================================================== 00:14:39.230 Total : 15075.75 58.89 0.00 0.00 0.00 0.00 0.00 00:14:39.230 00:14:40.602 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:40.602 Nvme0n1 : 5.00 15149.20 59.18 0.00 0.00 0.00 0.00 0.00 00:14:40.602 =================================================================================================================== 00:14:40.602 Total : 15149.20 59.18 0.00 0.00 0.00 0.00 0.00 00:14:40.602 00:14:41.536 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:41.536 Nvme0n1 : 6.00 15207.17 59.40 0.00 0.00 0.00 0.00 0.00 00:14:41.536 =================================================================================================================== 00:14:41.536 Total : 15207.17 59.40 0.00 0.00 0.00 0.00 0.00 00:14:41.536 00:14:42.471 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:42.471 Nvme0n1 : 7.00 15249.00 59.57 0.00 0.00 0.00 0.00 0.00 00:14:42.471 =================================================================================================================== 00:14:42.471 Total : 15249.00 59.57 0.00 0.00 0.00 0.00 0.00 00:14:42.471 00:14:43.409 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:43.409 Nvme0n1 : 8.00 15282.12 59.70 0.00 0.00 0.00 0.00 0.00 00:14:43.409 =================================================================================================================== 00:14:43.409 Total : 15282.12 59.70 0.00 0.00 0.00 0.00 0.00 00:14:43.409 00:14:44.347 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:44.347 Nvme0n1 : 9.00 15304.44 59.78 0.00 0.00 0.00 0.00 0.00 00:14:44.347 =================================================================================================================== 00:14:44.347 Total : 15304.44 59.78 0.00 0.00 0.00 0.00 0.00 00:14:44.347 00:14:45.277 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.277 Nvme0n1 : 10.00 15331.10 59.89 0.00 0.00 0.00 0.00 0.00 00:14:45.277 =================================================================================================================== 00:14:45.277 Total : 15331.10 59.89 0.00 0.00 0.00 0.00 0.00 00:14:45.277 00:14:45.277 00:14:45.277 Latency(us) 00:14:45.277 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:45.277 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:45.277 Nvme0n1 : 10.01 15333.22 59.90 0.00 0.00 8343.34 3349.62 16117.00 00:14:45.277 =================================================================================================================== 00:14:45.277 Total : 15333.22 59.90 0.00 0.00 8343.34 3349.62 16117.00 00:14:45.277 0 00:14:45.277 12:28:39 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1253051 00:14:45.277 12:28:39 -- common/autotest_common.sh@926 -- # '[' -z 1253051 ']' 00:14:45.277 12:28:39 -- common/autotest_common.sh@930 -- # kill -0 1253051 00:14:45.277 12:28:39 -- common/autotest_common.sh@931 -- # uname 00:14:45.277 12:28:39 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:45.277 12:28:39 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1253051 00:14:45.277 12:28:39 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:14:45.277 12:28:39 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:14:45.277 12:28:39 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1253051' 00:14:45.277 killing process with pid 1253051 00:14:45.277 12:28:39 -- common/autotest_common.sh@945 -- # kill 1253051 00:14:45.277 Received shutdown signal, test time was about 10.000000 seconds 00:14:45.277 00:14:45.277 Latency(us) 00:14:45.277 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:45.277 =================================================================================================================== 00:14:45.277 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:45.277 12:28:39 -- common/autotest_common.sh@950 -- # wait 1253051 00:14:45.542 12:28:39 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:45.804 12:28:39 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:45.804 12:28:39 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:46.062 12:28:39 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:46.062 12:28:39 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:14:46.062 12:28:39 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1250363 00:14:46.062 12:28:39 -- target/nvmf_lvs_grow.sh@74 -- # wait 1250363 00:14:46.322 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1250363 Killed "${NVMF_APP[@]}" "$@" 00:14:46.322 12:28:39 -- target/nvmf_lvs_grow.sh@74 -- # true 00:14:46.322 12:28:39 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:14:46.322 12:28:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:46.322 12:28:39 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:46.322 12:28:39 -- common/autotest_common.sh@10 -- # set +x 00:14:46.322 12:28:39 -- nvmf/common.sh@469 -- # nvmfpid=1254559 00:14:46.322 12:28:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:46.322 12:28:39 -- nvmf/common.sh@470 -- # waitforlisten 1254559 00:14:46.322 12:28:39 -- common/autotest_common.sh@819 -- # '[' -z 1254559 ']' 00:14:46.322 12:28:39 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:46.322 12:28:39 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:46.322 12:28:39 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:46.322 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:46.322 12:28:39 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:46.322 12:28:39 -- common/autotest_common.sh@10 -- # set +x 00:14:46.322 [2024-07-12 12:28:40.035569] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:46.322 [2024-07-12 12:28:40.035670] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:46.322 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.322 [2024-07-12 12:28:40.103206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:46.322 [2024-07-12 12:28:40.210707] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:46.322 [2024-07-12 12:28:40.210906] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:46.322 [2024-07-12 12:28:40.210924] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:46.322 [2024-07-12 12:28:40.210936] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:46.322 [2024-07-12 12:28:40.210965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:47.255 12:28:40 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:47.255 12:28:40 -- common/autotest_common.sh@852 -- # return 0 00:14:47.255 12:28:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:47.255 12:28:40 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:47.255 12:28:40 -- common/autotest_common.sh@10 -- # set +x 00:14:47.255 12:28:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:47.255 12:28:40 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:47.514 [2024-07-12 12:28:41.260607] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:14:47.514 [2024-07-12 12:28:41.260750] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:14:47.514 [2024-07-12 12:28:41.260807] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:14:47.514 12:28:41 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:14:47.514 12:28:41 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:47.514 12:28:41 -- common/autotest_common.sh@887 -- # local bdev_name=44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:47.514 12:28:41 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:47.514 12:28:41 -- common/autotest_common.sh@889 -- # local i 00:14:47.514 12:28:41 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:47.514 12:28:41 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:47.514 12:28:41 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:47.772 12:28:41 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 44b1447f-59c2-400e-ac8b-e309d24cb5f8 -t 2000 00:14:48.030 [ 00:14:48.030 { 00:14:48.031 "name": "44b1447f-59c2-400e-ac8b-e309d24cb5f8", 00:14:48.031 "aliases": [ 00:14:48.031 "lvs/lvol" 00:14:48.031 ], 00:14:48.031 "product_name": "Logical Volume", 00:14:48.031 "block_size": 4096, 00:14:48.031 "num_blocks": 38912, 00:14:48.031 "uuid": "44b1447f-59c2-400e-ac8b-e309d24cb5f8", 00:14:48.031 "assigned_rate_limits": { 00:14:48.031 "rw_ios_per_sec": 0, 00:14:48.031 "rw_mbytes_per_sec": 0, 00:14:48.031 "r_mbytes_per_sec": 0, 00:14:48.031 "w_mbytes_per_sec": 0 00:14:48.031 }, 00:14:48.031 "claimed": false, 00:14:48.031 "zoned": false, 00:14:48.031 "supported_io_types": { 00:14:48.031 "read": true, 00:14:48.031 "write": true, 00:14:48.031 "unmap": true, 00:14:48.031 "write_zeroes": true, 00:14:48.031 "flush": false, 00:14:48.031 "reset": true, 00:14:48.031 "compare": false, 00:14:48.031 "compare_and_write": false, 00:14:48.031 "abort": false, 00:14:48.031 "nvme_admin": false, 00:14:48.031 "nvme_io": false 00:14:48.031 }, 00:14:48.031 "driver_specific": { 00:14:48.031 "lvol": { 00:14:48.031 "lvol_store_uuid": "f3e480d3-f045-48e5-add0-1a2f2db30cbc", 00:14:48.031 "base_bdev": "aio_bdev", 00:14:48.031 "thin_provision": false, 00:14:48.031 "snapshot": false, 00:14:48.031 "clone": false, 00:14:48.031 "esnap_clone": false 00:14:48.031 } 00:14:48.031 } 00:14:48.031 } 00:14:48.031 ] 00:14:48.031 12:28:41 -- common/autotest_common.sh@895 -- # return 0 00:14:48.031 12:28:41 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:48.031 12:28:41 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:14:48.287 12:28:41 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:14:48.287 12:28:41 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:48.287 12:28:41 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:14:48.559 12:28:42 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:14:48.559 12:28:42 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:48.825 [2024-07-12 12:28:42.489558] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:48.825 12:28:42 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:48.825 12:28:42 -- common/autotest_common.sh@640 -- # local es=0 00:14:48.825 12:28:42 -- common/autotest_common.sh@642 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:48.825 12:28:42 -- common/autotest_common.sh@628 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:48.825 12:28:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:48.825 12:28:42 -- common/autotest_common.sh@632 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:48.825 12:28:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:48.825 12:28:42 -- common/autotest_common.sh@634 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:48.825 12:28:42 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:14:48.825 12:28:42 -- common/autotest_common.sh@634 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:48.825 12:28:42 -- common/autotest_common.sh@634 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:48.825 12:28:42 -- common/autotest_common.sh@643 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:49.084 request: 00:14:49.084 { 00:14:49.084 "uuid": "f3e480d3-f045-48e5-add0-1a2f2db30cbc", 00:14:49.084 "method": "bdev_lvol_get_lvstores", 00:14:49.084 "req_id": 1 00:14:49.084 } 00:14:49.084 Got JSON-RPC error response 00:14:49.084 response: 00:14:49.084 { 00:14:49.084 "code": -19, 00:14:49.084 "message": "No such device" 00:14:49.084 } 00:14:49.084 12:28:42 -- common/autotest_common.sh@643 -- # es=1 00:14:49.084 12:28:42 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:14:49.084 12:28:42 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:14:49.084 12:28:42 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:14:49.084 12:28:42 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:49.084 aio_bdev 00:14:49.084 12:28:42 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:49.084 12:28:42 -- common/autotest_common.sh@887 -- # local bdev_name=44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:49.084 12:28:42 -- common/autotest_common.sh@888 -- # local bdev_timeout= 00:14:49.084 12:28:42 -- common/autotest_common.sh@889 -- # local i 00:14:49.084 12:28:42 -- common/autotest_common.sh@890 -- # [[ -z '' ]] 00:14:49.084 12:28:42 -- common/autotest_common.sh@890 -- # bdev_timeout=2000 00:14:49.084 12:28:42 -- common/autotest_common.sh@892 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:14:49.348 12:28:43 -- common/autotest_common.sh@894 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 44b1447f-59c2-400e-ac8b-e309d24cb5f8 -t 2000 00:14:49.609 [ 00:14:49.609 { 00:14:49.609 "name": "44b1447f-59c2-400e-ac8b-e309d24cb5f8", 00:14:49.609 "aliases": [ 00:14:49.609 "lvs/lvol" 00:14:49.609 ], 00:14:49.609 "product_name": "Logical Volume", 00:14:49.609 "block_size": 4096, 00:14:49.609 "num_blocks": 38912, 00:14:49.609 "uuid": "44b1447f-59c2-400e-ac8b-e309d24cb5f8", 00:14:49.609 "assigned_rate_limits": { 00:14:49.609 "rw_ios_per_sec": 0, 00:14:49.609 "rw_mbytes_per_sec": 0, 00:14:49.609 "r_mbytes_per_sec": 0, 00:14:49.609 "w_mbytes_per_sec": 0 00:14:49.609 }, 00:14:49.609 "claimed": false, 00:14:49.609 "zoned": false, 00:14:49.609 "supported_io_types": { 00:14:49.609 "read": true, 00:14:49.609 "write": true, 00:14:49.609 "unmap": true, 00:14:49.609 "write_zeroes": true, 00:14:49.609 "flush": false, 00:14:49.609 "reset": true, 00:14:49.609 "compare": false, 00:14:49.609 "compare_and_write": false, 00:14:49.609 "abort": false, 00:14:49.609 "nvme_admin": false, 00:14:49.609 "nvme_io": false 00:14:49.609 }, 00:14:49.609 "driver_specific": { 00:14:49.609 "lvol": { 00:14:49.609 "lvol_store_uuid": "f3e480d3-f045-48e5-add0-1a2f2db30cbc", 00:14:49.609 "base_bdev": "aio_bdev", 00:14:49.609 "thin_provision": false, 00:14:49.609 "snapshot": false, 00:14:49.609 "clone": false, 00:14:49.609 "esnap_clone": false 00:14:49.609 } 00:14:49.609 } 00:14:49.609 } 00:14:49.609 ] 00:14:49.609 12:28:43 -- common/autotest_common.sh@895 -- # return 0 00:14:49.609 12:28:43 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:49.609 12:28:43 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:14:49.868 12:28:43 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:14:49.869 12:28:43 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:49.869 12:28:43 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:14:50.125 12:28:43 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:14:50.125 12:28:43 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 44b1447f-59c2-400e-ac8b-e309d24cb5f8 00:14:50.383 12:28:44 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u f3e480d3-f045-48e5-add0-1a2f2db30cbc 00:14:50.641 12:28:44 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:50.900 12:28:44 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:50.900 00:14:50.900 real 0m19.756s 00:14:50.900 user 0m49.468s 00:14:50.900 sys 0m4.716s 00:14:50.900 12:28:44 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:50.900 12:28:44 -- common/autotest_common.sh@10 -- # set +x 00:14:50.900 ************************************ 00:14:50.900 END TEST lvs_grow_dirty 00:14:50.900 ************************************ 00:14:50.900 12:28:44 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:14:50.900 12:28:44 -- common/autotest_common.sh@796 -- # type=--id 00:14:50.900 12:28:44 -- common/autotest_common.sh@797 -- # id=0 00:14:50.900 12:28:44 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:14:50.900 12:28:44 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:14:50.900 12:28:44 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:14:50.900 12:28:44 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:14:50.900 12:28:44 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:14:50.900 12:28:44 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:14:50.900 nvmf_trace.0 00:14:50.900 12:28:44 -- common/autotest_common.sh@811 -- # return 0 00:14:50.900 12:28:44 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:14:50.900 12:28:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:50.900 12:28:44 -- nvmf/common.sh@116 -- # sync 00:14:50.900 12:28:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:50.900 12:28:44 -- nvmf/common.sh@119 -- # set +e 00:14:50.900 12:28:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:50.900 12:28:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:50.900 rmmod nvme_tcp 00:14:50.900 rmmod nvme_fabrics 00:14:50.900 rmmod nvme_keyring 00:14:50.900 12:28:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:50.900 12:28:44 -- nvmf/common.sh@123 -- # set -e 00:14:50.900 12:28:44 -- nvmf/common.sh@124 -- # return 0 00:14:50.900 12:28:44 -- nvmf/common.sh@477 -- # '[' -n 1254559 ']' 00:14:50.900 12:28:44 -- nvmf/common.sh@478 -- # killprocess 1254559 00:14:50.900 12:28:44 -- common/autotest_common.sh@926 -- # '[' -z 1254559 ']' 00:14:50.900 12:28:44 -- common/autotest_common.sh@930 -- # kill -0 1254559 00:14:50.900 12:28:44 -- common/autotest_common.sh@931 -- # uname 00:14:51.157 12:28:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:51.157 12:28:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1254559 00:14:51.157 12:28:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:51.157 12:28:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:51.157 12:28:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1254559' 00:14:51.157 killing process with pid 1254559 00:14:51.157 12:28:44 -- common/autotest_common.sh@945 -- # kill 1254559 00:14:51.157 12:28:44 -- common/autotest_common.sh@950 -- # wait 1254559 00:14:51.415 12:28:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:51.415 12:28:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:51.415 12:28:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:51.415 12:28:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:51.415 12:28:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:51.415 12:28:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:51.415 12:28:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:51.415 12:28:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.326 12:28:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:53.326 00:14:53.326 real 0m43.021s 00:14:53.326 user 1m12.947s 00:14:53.326 sys 0m8.336s 00:14:53.326 12:28:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:14:53.326 12:28:47 -- common/autotest_common.sh@10 -- # set +x 00:14:53.326 ************************************ 00:14:53.326 END TEST nvmf_lvs_grow 00:14:53.326 ************************************ 00:14:53.326 12:28:47 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:53.326 12:28:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:14:53.326 12:28:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:14:53.326 12:28:47 -- common/autotest_common.sh@10 -- # set +x 00:14:53.326 ************************************ 00:14:53.326 START TEST nvmf_bdev_io_wait 00:14:53.326 ************************************ 00:14:53.326 12:28:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:14:53.326 * Looking for test storage... 00:14:53.326 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:53.326 12:28:47 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:53.326 12:28:47 -- nvmf/common.sh@7 -- # uname -s 00:14:53.326 12:28:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:53.326 12:28:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:53.326 12:28:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:53.326 12:28:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:53.326 12:28:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:53.326 12:28:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:53.326 12:28:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:53.326 12:28:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:53.326 12:28:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:53.326 12:28:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:53.326 12:28:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:53.326 12:28:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:53.326 12:28:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:53.326 12:28:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:53.327 12:28:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:53.327 12:28:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:53.327 12:28:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:53.327 12:28:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:53.327 12:28:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:53.327 12:28:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.327 12:28:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.327 12:28:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.327 12:28:47 -- paths/export.sh@5 -- # export PATH 00:14:53.327 12:28:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:53.327 12:28:47 -- nvmf/common.sh@46 -- # : 0 00:14:53.327 12:28:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:53.327 12:28:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:53.327 12:28:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:53.327 12:28:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:53.327 12:28:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:53.327 12:28:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:53.327 12:28:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:53.327 12:28:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:53.327 12:28:47 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:53.327 12:28:47 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:53.327 12:28:47 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:14:53.327 12:28:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:53.327 12:28:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:53.327 12:28:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:53.327 12:28:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:53.327 12:28:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:53.327 12:28:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:53.327 12:28:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:53.327 12:28:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:53.327 12:28:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:53.327 12:28:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:53.327 12:28:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:53.327 12:28:47 -- common/autotest_common.sh@10 -- # set +x 00:14:55.859 12:28:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:55.859 12:28:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:55.859 12:28:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:55.859 12:28:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:55.859 12:28:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:55.859 12:28:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:55.859 12:28:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:55.859 12:28:49 -- nvmf/common.sh@294 -- # net_devs=() 00:14:55.859 12:28:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:55.859 12:28:49 -- nvmf/common.sh@295 -- # e810=() 00:14:55.859 12:28:49 -- nvmf/common.sh@295 -- # local -ga e810 00:14:55.859 12:28:49 -- nvmf/common.sh@296 -- # x722=() 00:14:55.859 12:28:49 -- nvmf/common.sh@296 -- # local -ga x722 00:14:55.859 12:28:49 -- nvmf/common.sh@297 -- # mlx=() 00:14:55.859 12:28:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:55.859 12:28:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:55.859 12:28:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:55.860 12:28:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:55.860 12:28:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:55.860 12:28:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:55.860 12:28:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:55.860 12:28:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:55.860 12:28:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:55.860 12:28:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:55.860 12:28:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:55.860 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:55.860 12:28:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:55.860 12:28:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:55.860 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:55.860 12:28:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:55.860 12:28:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:55.860 12:28:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:55.860 12:28:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:55.860 12:28:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:55.860 12:28:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:55.860 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:55.860 12:28:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:55.860 12:28:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:55.860 12:28:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:55.860 12:28:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:55.860 12:28:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:55.860 12:28:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:55.860 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:55.860 12:28:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:55.860 12:28:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:55.860 12:28:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:55.860 12:28:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:55.860 12:28:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:55.860 12:28:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:55.860 12:28:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:55.860 12:28:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:55.860 12:28:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:55.860 12:28:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:55.860 12:28:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:55.860 12:28:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:55.860 12:28:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:55.860 12:28:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:55.860 12:28:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:55.860 12:28:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:55.860 12:28:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:55.860 12:28:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:55.860 12:28:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:55.860 12:28:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:55.860 12:28:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:55.860 12:28:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:55.860 12:28:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:55.860 12:28:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:55.860 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:55.860 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.138 ms 00:14:55.860 00:14:55.860 --- 10.0.0.2 ping statistics --- 00:14:55.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:55.860 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:14:55.860 12:28:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:55.860 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:55.860 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.184 ms 00:14:55.860 00:14:55.860 --- 10.0.0.1 ping statistics --- 00:14:55.860 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:55.860 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:14:55.860 12:28:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:55.860 12:28:49 -- nvmf/common.sh@410 -- # return 0 00:14:55.860 12:28:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:55.860 12:28:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:55.860 12:28:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:55.860 12:28:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:55.860 12:28:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:55.860 12:28:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:55.860 12:28:49 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:14:55.860 12:28:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:55.860 12:28:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:14:55.860 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:55.860 12:28:49 -- nvmf/common.sh@469 -- # nvmfpid=1257120 00:14:55.860 12:28:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:14:55.860 12:28:49 -- nvmf/common.sh@470 -- # waitforlisten 1257120 00:14:55.860 12:28:49 -- common/autotest_common.sh@819 -- # '[' -z 1257120 ']' 00:14:55.860 12:28:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:55.860 12:28:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:14:55.860 12:28:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:55.860 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:55.860 12:28:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:14:55.860 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:55.860 [2024-07-12 12:28:49.458550] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:55.860 [2024-07-12 12:28:49.458631] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:55.860 EAL: No free 2048 kB hugepages reported on node 1 00:14:55.860 [2024-07-12 12:28:49.521587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:55.860 [2024-07-12 12:28:49.630743] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:55.860 [2024-07-12 12:28:49.630902] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:55.860 [2024-07-12 12:28:49.630924] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:55.860 [2024-07-12 12:28:49.630938] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:55.860 [2024-07-12 12:28:49.630992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:55.860 [2024-07-12 12:28:49.631061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:55.860 [2024-07-12 12:28:49.631110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:55.860 [2024-07-12 12:28:49.631113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:55.860 12:28:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:14:55.860 12:28:49 -- common/autotest_common.sh@852 -- # return 0 00:14:55.860 12:28:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:55.860 12:28:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:14:55.860 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:55.860 12:28:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:55.860 12:28:49 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:14:55.860 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:55.860 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:55.860 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:55.860 12:28:49 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:14:55.860 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:55.860 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:56.119 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:56.119 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.119 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:56.119 [2024-07-12 12:28:49.812632] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:56.119 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:56.119 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.119 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:56.119 Malloc0 00:14:56.119 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:56.119 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.119 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:56.119 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:56.119 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.119 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:56.119 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:56.119 12:28:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:56.119 12:28:49 -- common/autotest_common.sh@10 -- # set +x 00:14:56.119 [2024-07-12 12:28:49.872559] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:56.119 12:28:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1257153 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@30 -- # READ_PID=1257155 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # config=() 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.119 12:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1257157 00:14:56.119 12:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.119 { 00:14:56.119 "params": { 00:14:56.119 "name": "Nvme$subsystem", 00:14:56.119 "trtype": "$TEST_TRANSPORT", 00:14:56.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.119 "adrfam": "ipv4", 00:14:56.119 "trsvcid": "$NVMF_PORT", 00:14:56.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.119 "hdgst": ${hdgst:-false}, 00:14:56.119 "ddgst": ${ddgst:-false} 00:14:56.119 }, 00:14:56.119 "method": "bdev_nvme_attach_controller" 00:14:56.119 } 00:14:56.119 EOF 00:14:56.119 )") 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # config=() 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.119 12:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.119 12:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.119 { 00:14:56.119 "params": { 00:14:56.119 "name": "Nvme$subsystem", 00:14:56.119 "trtype": "$TEST_TRANSPORT", 00:14:56.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.119 "adrfam": "ipv4", 00:14:56.119 "trsvcid": "$NVMF_PORT", 00:14:56.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.119 "hdgst": ${hdgst:-false}, 00:14:56.119 "ddgst": ${ddgst:-false} 00:14:56.119 }, 00:14:56.119 "method": "bdev_nvme_attach_controller" 00:14:56.119 } 00:14:56.119 EOF 00:14:56.119 )") 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1257159 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@35 -- # sync 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # config=() 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.119 12:28:49 -- nvmf/common.sh@542 -- # cat 00:14:56.119 12:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.119 12:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.119 { 00:14:56.119 "params": { 00:14:56.119 "name": "Nvme$subsystem", 00:14:56.119 "trtype": "$TEST_TRANSPORT", 00:14:56.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.119 "adrfam": "ipv4", 00:14:56.119 "trsvcid": "$NVMF_PORT", 00:14:56.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.119 "hdgst": ${hdgst:-false}, 00:14:56.119 "ddgst": ${ddgst:-false} 00:14:56.119 }, 00:14:56.119 "method": "bdev_nvme_attach_controller" 00:14:56.119 } 00:14:56.119 EOF 00:14:56.119 )") 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:14:56.119 12:28:49 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # config=() 00:14:56.119 12:28:49 -- nvmf/common.sh@542 -- # cat 00:14:56.119 12:28:49 -- nvmf/common.sh@520 -- # local subsystem config 00:14:56.119 12:28:49 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:56.119 12:28:49 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:56.119 { 00:14:56.119 "params": { 00:14:56.119 "name": "Nvme$subsystem", 00:14:56.119 "trtype": "$TEST_TRANSPORT", 00:14:56.119 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:56.119 "adrfam": "ipv4", 00:14:56.119 "trsvcid": "$NVMF_PORT", 00:14:56.119 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:56.119 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:56.119 "hdgst": ${hdgst:-false}, 00:14:56.119 "ddgst": ${ddgst:-false} 00:14:56.119 }, 00:14:56.119 "method": "bdev_nvme_attach_controller" 00:14:56.119 } 00:14:56.119 EOF 00:14:56.120 )") 00:14:56.120 12:28:49 -- nvmf/common.sh@542 -- # cat 00:14:56.120 12:28:49 -- target/bdev_io_wait.sh@37 -- # wait 1257153 00:14:56.120 12:28:49 -- nvmf/common.sh@542 -- # cat 00:14:56.120 12:28:49 -- nvmf/common.sh@544 -- # jq . 00:14:56.120 12:28:49 -- nvmf/common.sh@544 -- # jq . 00:14:56.120 12:28:49 -- nvmf/common.sh@544 -- # jq . 00:14:56.120 12:28:49 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.120 12:28:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.120 "params": { 00:14:56.120 "name": "Nvme1", 00:14:56.120 "trtype": "tcp", 00:14:56.120 "traddr": "10.0.0.2", 00:14:56.120 "adrfam": "ipv4", 00:14:56.120 "trsvcid": "4420", 00:14:56.120 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.120 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.120 "hdgst": false, 00:14:56.120 "ddgst": false 00:14:56.120 }, 00:14:56.120 "method": "bdev_nvme_attach_controller" 00:14:56.120 }' 00:14:56.120 12:28:49 -- nvmf/common.sh@544 -- # jq . 00:14:56.120 12:28:49 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.120 12:28:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.120 "params": { 00:14:56.120 "name": "Nvme1", 00:14:56.120 "trtype": "tcp", 00:14:56.120 "traddr": "10.0.0.2", 00:14:56.120 "adrfam": "ipv4", 00:14:56.120 "trsvcid": "4420", 00:14:56.120 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.120 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.120 "hdgst": false, 00:14:56.120 "ddgst": false 00:14:56.120 }, 00:14:56.120 "method": "bdev_nvme_attach_controller" 00:14:56.120 }' 00:14:56.120 12:28:49 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.120 12:28:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.120 "params": { 00:14:56.120 "name": "Nvme1", 00:14:56.120 "trtype": "tcp", 00:14:56.120 "traddr": "10.0.0.2", 00:14:56.120 "adrfam": "ipv4", 00:14:56.120 "trsvcid": "4420", 00:14:56.120 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.120 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.120 "hdgst": false, 00:14:56.120 "ddgst": false 00:14:56.120 }, 00:14:56.120 "method": "bdev_nvme_attach_controller" 00:14:56.120 }' 00:14:56.120 12:28:49 -- nvmf/common.sh@545 -- # IFS=, 00:14:56.120 12:28:49 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:56.120 "params": { 00:14:56.120 "name": "Nvme1", 00:14:56.120 "trtype": "tcp", 00:14:56.120 "traddr": "10.0.0.2", 00:14:56.120 "adrfam": "ipv4", 00:14:56.120 "trsvcid": "4420", 00:14:56.120 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:56.120 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:56.120 "hdgst": false, 00:14:56.120 "ddgst": false 00:14:56.120 }, 00:14:56.120 "method": "bdev_nvme_attach_controller" 00:14:56.120 }' 00:14:56.120 [2024-07-12 12:28:49.915423] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:56.120 [2024-07-12 12:28:49.915424] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:56.120 [2024-07-12 12:28:49.915423] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:56.120 [2024-07-12 12:28:49.915504] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-12 12:28:49.915504] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-07-12 12:28:49.915504] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:14:56.120 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:14:56.120 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:14:56.120 [2024-07-12 12:28:49.915976] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:14:56.120 [2024-07-12 12:28:49.916045] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:14:56.120 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.379 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.379 [2024-07-12 12:28:50.099974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.379 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.379 [2024-07-12 12:28:50.194116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:56.379 [2024-07-12 12:28:50.198417] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.379 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.379 [2024-07-12 12:28:50.296697] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.639 [2024-07-12 12:28:50.304558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:56.639 [2024-07-12 12:28:50.376991] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:56.639 [2024-07-12 12:28:50.396265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:56.639 [2024-07-12 12:28:50.470220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:14:56.639 Running I/O for 1 seconds... 00:14:56.639 Running I/O for 1 seconds... 00:14:56.896 Running I/O for 1 seconds... 00:14:56.896 Running I/O for 1 seconds... 00:14:57.831 00:14:57.831 Latency(us) 00:14:57.831 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.831 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:14:57.831 Nvme1n1 : 1.00 170522.61 666.10 0.00 0.00 747.75 298.86 1019.45 00:14:57.831 =================================================================================================================== 00:14:57.831 Total : 170522.61 666.10 0.00 0.00 747.75 298.86 1019.45 00:14:57.831 00:14:57.831 Latency(us) 00:14:57.831 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.831 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:14:57.831 Nvme1n1 : 1.02 6793.73 26.54 0.00 0.00 18659.07 8883.77 29709.65 00:14:57.831 =================================================================================================================== 00:14:57.831 Total : 6793.73 26.54 0.00 0.00 18659.07 8883.77 29709.65 00:14:57.831 00:14:57.831 Latency(us) 00:14:57.831 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.831 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:14:57.831 Nvme1n1 : 1.01 9600.27 37.50 0.00 0.00 13274.59 7427.41 25631.86 00:14:57.831 =================================================================================================================== 00:14:57.831 Total : 9600.27 37.50 0.00 0.00 13274.59 7427.41 25631.86 00:14:57.831 00:14:57.832 Latency(us) 00:14:57.832 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:57.832 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:14:57.832 Nvme1n1 : 1.00 7057.28 27.57 0.00 0.00 18088.48 4466.16 39807.05 00:14:57.832 =================================================================================================================== 00:14:57.832 Total : 7057.28 27.57 0.00 0.00 18088.48 4466.16 39807.05 00:14:58.090 12:28:51 -- target/bdev_io_wait.sh@38 -- # wait 1257155 00:14:58.090 12:28:51 -- target/bdev_io_wait.sh@39 -- # wait 1257157 00:14:58.090 12:28:51 -- target/bdev_io_wait.sh@40 -- # wait 1257159 00:14:58.090 12:28:51 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:58.090 12:28:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:14:58.090 12:28:51 -- common/autotest_common.sh@10 -- # set +x 00:14:58.090 12:28:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:14:58.090 12:28:52 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:14:58.090 12:28:52 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:14:58.090 12:28:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:58.090 12:28:52 -- nvmf/common.sh@116 -- # sync 00:14:58.090 12:28:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:58.090 12:28:52 -- nvmf/common.sh@119 -- # set +e 00:14:58.090 12:28:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:58.090 12:28:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:58.347 rmmod nvme_tcp 00:14:58.347 rmmod nvme_fabrics 00:14:58.347 rmmod nvme_keyring 00:14:58.347 12:28:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:58.347 12:28:52 -- nvmf/common.sh@123 -- # set -e 00:14:58.347 12:28:52 -- nvmf/common.sh@124 -- # return 0 00:14:58.347 12:28:52 -- nvmf/common.sh@477 -- # '[' -n 1257120 ']' 00:14:58.347 12:28:52 -- nvmf/common.sh@478 -- # killprocess 1257120 00:14:58.347 12:28:52 -- common/autotest_common.sh@926 -- # '[' -z 1257120 ']' 00:14:58.347 12:28:52 -- common/autotest_common.sh@930 -- # kill -0 1257120 00:14:58.347 12:28:52 -- common/autotest_common.sh@931 -- # uname 00:14:58.347 12:28:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:14:58.347 12:28:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1257120 00:14:58.347 12:28:52 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:14:58.347 12:28:52 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:14:58.347 12:28:52 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1257120' 00:14:58.347 killing process with pid 1257120 00:14:58.347 12:28:52 -- common/autotest_common.sh@945 -- # kill 1257120 00:14:58.347 12:28:52 -- common/autotest_common.sh@950 -- # wait 1257120 00:14:58.606 12:28:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:58.606 12:28:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:58.606 12:28:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:58.606 12:28:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:58.606 12:28:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:58.606 12:28:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.606 12:28:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.606 12:28:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.510 12:28:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:00.510 00:15:00.510 real 0m7.201s 00:15:00.510 user 0m16.370s 00:15:00.510 sys 0m3.607s 00:15:00.510 12:28:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:00.510 12:28:54 -- common/autotest_common.sh@10 -- # set +x 00:15:00.510 ************************************ 00:15:00.510 END TEST nvmf_bdev_io_wait 00:15:00.510 ************************************ 00:15:00.510 12:28:54 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:00.510 12:28:54 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:00.510 12:28:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:00.510 12:28:54 -- common/autotest_common.sh@10 -- # set +x 00:15:00.510 ************************************ 00:15:00.510 START TEST nvmf_queue_depth 00:15:00.510 ************************************ 00:15:00.510 12:28:54 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:00.769 * Looking for test storage... 00:15:00.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:00.769 12:28:54 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:00.769 12:28:54 -- nvmf/common.sh@7 -- # uname -s 00:15:00.769 12:28:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:00.769 12:28:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:00.769 12:28:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:00.769 12:28:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:00.769 12:28:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:00.769 12:28:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:00.769 12:28:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:00.769 12:28:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:00.769 12:28:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:00.769 12:28:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:00.769 12:28:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.769 12:28:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:00.769 12:28:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:00.769 12:28:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:00.769 12:28:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:00.769 12:28:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:00.769 12:28:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:00.769 12:28:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:00.769 12:28:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:00.769 12:28:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.769 12:28:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.769 12:28:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.769 12:28:54 -- paths/export.sh@5 -- # export PATH 00:15:00.769 12:28:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:00.769 12:28:54 -- nvmf/common.sh@46 -- # : 0 00:15:00.769 12:28:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:00.769 12:28:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:00.769 12:28:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:00.769 12:28:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:00.769 12:28:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:00.769 12:28:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:00.769 12:28:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:00.769 12:28:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:00.769 12:28:54 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:00.769 12:28:54 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:00.769 12:28:54 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:00.769 12:28:54 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:00.769 12:28:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:00.769 12:28:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:00.769 12:28:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:00.769 12:28:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:00.769 12:28:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:00.769 12:28:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.769 12:28:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.769 12:28:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:00.769 12:28:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:00.769 12:28:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:00.769 12:28:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:00.769 12:28:54 -- common/autotest_common.sh@10 -- # set +x 00:15:02.672 12:28:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:02.672 12:28:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:02.672 12:28:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:02.672 12:28:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:02.672 12:28:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:02.672 12:28:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:02.672 12:28:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:02.672 12:28:56 -- nvmf/common.sh@294 -- # net_devs=() 00:15:02.672 12:28:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:02.672 12:28:56 -- nvmf/common.sh@295 -- # e810=() 00:15:02.672 12:28:56 -- nvmf/common.sh@295 -- # local -ga e810 00:15:02.672 12:28:56 -- nvmf/common.sh@296 -- # x722=() 00:15:02.672 12:28:56 -- nvmf/common.sh@296 -- # local -ga x722 00:15:02.672 12:28:56 -- nvmf/common.sh@297 -- # mlx=() 00:15:02.672 12:28:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:02.672 12:28:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:02.672 12:28:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:02.672 12:28:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:02.672 12:28:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:02.672 12:28:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.672 12:28:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:02.672 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:02.672 12:28:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:02.672 12:28:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:02.672 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:02.672 12:28:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:02.672 12:28:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.672 12:28:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.672 12:28:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.672 12:28:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.672 12:28:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:02.672 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:02.672 12:28:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.672 12:28:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:02.672 12:28:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:02.672 12:28:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:02.672 12:28:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:02.672 12:28:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:02.672 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:02.672 12:28:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:02.672 12:28:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:02.672 12:28:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:02.672 12:28:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:02.672 12:28:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:02.672 12:28:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:02.672 12:28:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:02.672 12:28:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:02.672 12:28:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:02.672 12:28:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:02.672 12:28:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:02.672 12:28:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:02.672 12:28:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:02.672 12:28:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:02.672 12:28:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:02.672 12:28:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:02.672 12:28:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:02.673 12:28:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:02.673 12:28:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:02.673 12:28:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:02.673 12:28:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:02.673 12:28:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:02.673 12:28:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:02.673 12:28:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:02.673 12:28:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:02.673 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:02.673 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.168 ms 00:15:02.673 00:15:02.673 --- 10.0.0.2 ping statistics --- 00:15:02.673 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.673 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:15:02.673 12:28:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:02.673 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:02.673 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:15:02.673 00:15:02.673 --- 10.0.0.1 ping statistics --- 00:15:02.673 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:02.673 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:15:02.673 12:28:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:02.673 12:28:56 -- nvmf/common.sh@410 -- # return 0 00:15:02.673 12:28:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:02.673 12:28:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:02.673 12:28:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:02.673 12:28:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:02.673 12:28:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:02.673 12:28:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:02.673 12:28:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:02.673 12:28:56 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:02.673 12:28:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:02.673 12:28:56 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:02.673 12:28:56 -- common/autotest_common.sh@10 -- # set +x 00:15:02.673 12:28:56 -- nvmf/common.sh@469 -- # nvmfpid=1259391 00:15:02.673 12:28:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:02.673 12:28:56 -- nvmf/common.sh@470 -- # waitforlisten 1259391 00:15:02.673 12:28:56 -- common/autotest_common.sh@819 -- # '[' -z 1259391 ']' 00:15:02.673 12:28:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:02.673 12:28:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:02.673 12:28:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:02.673 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:02.673 12:28:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:02.673 12:28:56 -- common/autotest_common.sh@10 -- # set +x 00:15:02.929 [2024-07-12 12:28:56.616017] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:02.929 [2024-07-12 12:28:56.616090] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:02.929 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.929 [2024-07-12 12:28:56.684069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.929 [2024-07-12 12:28:56.798003] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:02.929 [2024-07-12 12:28:56.798176] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:02.929 [2024-07-12 12:28:56.798193] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:02.929 [2024-07-12 12:28:56.798204] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:02.929 [2024-07-12 12:28:56.798246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:03.865 12:28:57 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:03.865 12:28:57 -- common/autotest_common.sh@852 -- # return 0 00:15:03.865 12:28:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:03.865 12:28:57 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 12:28:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:03.865 12:28:57 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:03.865 12:28:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 [2024-07-12 12:28:57.591457] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:03.865 12:28:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:03.865 12:28:57 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:03.865 12:28:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 Malloc0 00:15:03.865 12:28:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:03.865 12:28:57 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:03.865 12:28:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 12:28:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:03.865 12:28:57 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:03.865 12:28:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 12:28:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:03.865 12:28:57 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:03.865 12:28:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 [2024-07-12 12:28:57.654544] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:03.865 12:28:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:03.865 12:28:57 -- target/queue_depth.sh@30 -- # bdevperf_pid=1259543 00:15:03.865 12:28:57 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:03.865 12:28:57 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:03.865 12:28:57 -- target/queue_depth.sh@33 -- # waitforlisten 1259543 /var/tmp/bdevperf.sock 00:15:03.865 12:28:57 -- common/autotest_common.sh@819 -- # '[' -z 1259543 ']' 00:15:03.865 12:28:57 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:03.865 12:28:57 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:03.865 12:28:57 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:03.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:03.865 12:28:57 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:03.865 12:28:57 -- common/autotest_common.sh@10 -- # set +x 00:15:03.865 [2024-07-12 12:28:57.696407] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:03.865 [2024-07-12 12:28:57.696471] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1259543 ] 00:15:03.865 EAL: No free 2048 kB hugepages reported on node 1 00:15:03.865 [2024-07-12 12:28:57.757170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:04.122 [2024-07-12 12:28:57.879122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:05.053 12:28:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:05.053 12:28:58 -- common/autotest_common.sh@852 -- # return 0 00:15:05.053 12:28:58 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:05.053 12:28:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:05.053 12:28:58 -- common/autotest_common.sh@10 -- # set +x 00:15:05.053 NVMe0n1 00:15:05.053 12:28:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:05.053 12:28:58 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:05.312 Running I/O for 10 seconds... 00:15:15.319 00:15:15.319 Latency(us) 00:15:15.319 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:15.319 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:15.319 Verification LBA range: start 0x0 length 0x4000 00:15:15.319 NVMe0n1 : 10.07 12332.03 48.17 0.00 0.00 82706.50 15340.28 62526.20 00:15:15.319 =================================================================================================================== 00:15:15.319 Total : 12332.03 48.17 0.00 0.00 82706.50 15340.28 62526.20 00:15:15.319 0 00:15:15.319 12:29:09 -- target/queue_depth.sh@39 -- # killprocess 1259543 00:15:15.319 12:29:09 -- common/autotest_common.sh@926 -- # '[' -z 1259543 ']' 00:15:15.319 12:29:09 -- common/autotest_common.sh@930 -- # kill -0 1259543 00:15:15.319 12:29:09 -- common/autotest_common.sh@931 -- # uname 00:15:15.319 12:29:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:15.319 12:29:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1259543 00:15:15.319 12:29:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:15:15.319 12:29:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:15:15.319 12:29:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1259543' 00:15:15.319 killing process with pid 1259543 00:15:15.319 12:29:09 -- common/autotest_common.sh@945 -- # kill 1259543 00:15:15.319 Received shutdown signal, test time was about 10.000000 seconds 00:15:15.319 00:15:15.319 Latency(us) 00:15:15.319 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:15.319 =================================================================================================================== 00:15:15.319 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:15.319 12:29:09 -- common/autotest_common.sh@950 -- # wait 1259543 00:15:15.578 12:29:09 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:15.578 12:29:09 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:15.578 12:29:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:15.578 12:29:09 -- nvmf/common.sh@116 -- # sync 00:15:15.578 12:29:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:15.578 12:29:09 -- nvmf/common.sh@119 -- # set +e 00:15:15.578 12:29:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:15.578 12:29:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:15.578 rmmod nvme_tcp 00:15:15.578 rmmod nvme_fabrics 00:15:15.578 rmmod nvme_keyring 00:15:15.578 12:29:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:15.578 12:29:09 -- nvmf/common.sh@123 -- # set -e 00:15:15.578 12:29:09 -- nvmf/common.sh@124 -- # return 0 00:15:15.578 12:29:09 -- nvmf/common.sh@477 -- # '[' -n 1259391 ']' 00:15:15.578 12:29:09 -- nvmf/common.sh@478 -- # killprocess 1259391 00:15:15.578 12:29:09 -- common/autotest_common.sh@926 -- # '[' -z 1259391 ']' 00:15:15.578 12:29:09 -- common/autotest_common.sh@930 -- # kill -0 1259391 00:15:15.578 12:29:09 -- common/autotest_common.sh@931 -- # uname 00:15:15.578 12:29:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:15.578 12:29:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1259391 00:15:15.578 12:29:09 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:15.578 12:29:09 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:15.578 12:29:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1259391' 00:15:15.578 killing process with pid 1259391 00:15:15.578 12:29:09 -- common/autotest_common.sh@945 -- # kill 1259391 00:15:15.578 12:29:09 -- common/autotest_common.sh@950 -- # wait 1259391 00:15:16.146 12:29:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:16.146 12:29:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:16.146 12:29:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:16.146 12:29:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:16.146 12:29:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:16.146 12:29:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.146 12:29:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.146 12:29:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.050 12:29:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:18.050 00:15:18.050 real 0m17.450s 00:15:18.050 user 0m25.056s 00:15:18.050 sys 0m3.160s 00:15:18.050 12:29:11 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:18.050 12:29:11 -- common/autotest_common.sh@10 -- # set +x 00:15:18.050 ************************************ 00:15:18.050 END TEST nvmf_queue_depth 00:15:18.050 ************************************ 00:15:18.050 12:29:11 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:18.050 12:29:11 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:18.050 12:29:11 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:18.050 12:29:11 -- common/autotest_common.sh@10 -- # set +x 00:15:18.050 ************************************ 00:15:18.050 START TEST nvmf_multipath 00:15:18.050 ************************************ 00:15:18.050 12:29:11 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:18.050 * Looking for test storage... 00:15:18.050 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:18.050 12:29:11 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:18.050 12:29:11 -- nvmf/common.sh@7 -- # uname -s 00:15:18.050 12:29:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:18.050 12:29:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:18.050 12:29:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:18.050 12:29:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:18.050 12:29:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:18.050 12:29:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:18.050 12:29:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:18.050 12:29:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:18.050 12:29:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:18.050 12:29:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:18.050 12:29:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.050 12:29:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:18.050 12:29:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:18.050 12:29:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:18.050 12:29:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:18.050 12:29:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:18.050 12:29:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:18.050 12:29:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:18.050 12:29:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:18.050 12:29:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.050 12:29:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.050 12:29:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.050 12:29:11 -- paths/export.sh@5 -- # export PATH 00:15:18.050 12:29:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:18.050 12:29:11 -- nvmf/common.sh@46 -- # : 0 00:15:18.050 12:29:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:18.050 12:29:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:18.050 12:29:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:18.050 12:29:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:18.050 12:29:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:18.050 12:29:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:18.050 12:29:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:18.050 12:29:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:18.050 12:29:11 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:18.050 12:29:11 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:18.050 12:29:11 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:18.050 12:29:11 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:18.050 12:29:11 -- target/multipath.sh@43 -- # nvmftestinit 00:15:18.050 12:29:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:18.050 12:29:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:18.050 12:29:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:18.050 12:29:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:18.050 12:29:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:18.050 12:29:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:18.050 12:29:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:18.050 12:29:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:18.051 12:29:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:18.051 12:29:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:18.051 12:29:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:18.051 12:29:11 -- common/autotest_common.sh@10 -- # set +x 00:15:20.584 12:29:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:20.584 12:29:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:20.584 12:29:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:20.584 12:29:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:20.584 12:29:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:20.584 12:29:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:20.584 12:29:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:20.584 12:29:13 -- nvmf/common.sh@294 -- # net_devs=() 00:15:20.584 12:29:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:20.584 12:29:13 -- nvmf/common.sh@295 -- # e810=() 00:15:20.584 12:29:13 -- nvmf/common.sh@295 -- # local -ga e810 00:15:20.584 12:29:13 -- nvmf/common.sh@296 -- # x722=() 00:15:20.584 12:29:13 -- nvmf/common.sh@296 -- # local -ga x722 00:15:20.584 12:29:13 -- nvmf/common.sh@297 -- # mlx=() 00:15:20.584 12:29:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:20.584 12:29:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:20.584 12:29:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:20.584 12:29:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:20.584 12:29:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:20.584 12:29:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.584 12:29:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:20.584 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:20.584 12:29:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:20.584 12:29:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:20.584 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:20.584 12:29:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:20.584 12:29:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.584 12:29:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.584 12:29:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.584 12:29:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.584 12:29:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:20.584 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:20.584 12:29:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.584 12:29:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:20.584 12:29:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:20.584 12:29:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:20.584 12:29:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:20.584 12:29:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:20.584 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:20.584 12:29:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:20.584 12:29:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:20.584 12:29:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:20.584 12:29:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:20.584 12:29:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:20.584 12:29:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:20.584 12:29:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:20.584 12:29:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:20.584 12:29:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:20.584 12:29:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:20.584 12:29:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:20.584 12:29:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:20.584 12:29:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:20.584 12:29:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:20.584 12:29:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:20.584 12:29:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:20.584 12:29:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:20.584 12:29:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:20.584 12:29:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:20.584 12:29:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:20.584 12:29:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:20.584 12:29:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:20.584 12:29:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:20.584 12:29:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:20.584 12:29:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:20.584 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:20.584 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:15:20.584 00:15:20.584 --- 10.0.0.2 ping statistics --- 00:15:20.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.584 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:15:20.584 12:29:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:20.584 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:20.584 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:15:20.584 00:15:20.584 --- 10.0.0.1 ping statistics --- 00:15:20.584 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:20.584 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:15:20.584 12:29:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:20.584 12:29:14 -- nvmf/common.sh@410 -- # return 0 00:15:20.584 12:29:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:20.584 12:29:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:20.584 12:29:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:20.584 12:29:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:20.584 12:29:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:20.584 12:29:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:20.584 12:29:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:20.584 12:29:14 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:20.584 12:29:14 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:20.584 only one NIC for nvmf test 00:15:20.584 12:29:14 -- target/multipath.sh@47 -- # nvmftestfini 00:15:20.585 12:29:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:20.585 12:29:14 -- nvmf/common.sh@116 -- # sync 00:15:20.585 12:29:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:20.585 12:29:14 -- nvmf/common.sh@119 -- # set +e 00:15:20.585 12:29:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:20.585 12:29:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:20.585 rmmod nvme_tcp 00:15:20.585 rmmod nvme_fabrics 00:15:20.585 rmmod nvme_keyring 00:15:20.585 12:29:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:20.585 12:29:14 -- nvmf/common.sh@123 -- # set -e 00:15:20.585 12:29:14 -- nvmf/common.sh@124 -- # return 0 00:15:20.585 12:29:14 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:20.585 12:29:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:20.585 12:29:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:20.585 12:29:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:20.585 12:29:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:20.585 12:29:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:20.585 12:29:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:20.585 12:29:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:20.585 12:29:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.487 12:29:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:22.487 12:29:16 -- target/multipath.sh@48 -- # exit 0 00:15:22.487 12:29:16 -- target/multipath.sh@1 -- # nvmftestfini 00:15:22.487 12:29:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.487 12:29:16 -- nvmf/common.sh@116 -- # sync 00:15:22.487 12:29:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.487 12:29:16 -- nvmf/common.sh@119 -- # set +e 00:15:22.487 12:29:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.487 12:29:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.487 12:29:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.487 12:29:16 -- nvmf/common.sh@123 -- # set -e 00:15:22.487 12:29:16 -- nvmf/common.sh@124 -- # return 0 00:15:22.487 12:29:16 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:22.487 12:29:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.487 12:29:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.487 12:29:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.487 12:29:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.487 12:29:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.487 12:29:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.487 12:29:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.487 12:29:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.487 12:29:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:22.487 00:15:22.487 real 0m4.364s 00:15:22.487 user 0m0.828s 00:15:22.487 sys 0m1.523s 00:15:22.487 12:29:16 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:22.487 12:29:16 -- common/autotest_common.sh@10 -- # set +x 00:15:22.487 ************************************ 00:15:22.487 END TEST nvmf_multipath 00:15:22.487 ************************************ 00:15:22.487 12:29:16 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:22.487 12:29:16 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:22.487 12:29:16 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:22.487 12:29:16 -- common/autotest_common.sh@10 -- # set +x 00:15:22.487 ************************************ 00:15:22.487 START TEST nvmf_zcopy 00:15:22.488 ************************************ 00:15:22.488 12:29:16 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:22.488 * Looking for test storage... 00:15:22.488 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:22.488 12:29:16 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:22.488 12:29:16 -- nvmf/common.sh@7 -- # uname -s 00:15:22.488 12:29:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:22.488 12:29:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:22.488 12:29:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:22.488 12:29:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:22.488 12:29:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:22.488 12:29:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:22.488 12:29:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:22.488 12:29:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:22.488 12:29:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:22.488 12:29:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:22.488 12:29:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.488 12:29:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:22.488 12:29:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:22.488 12:29:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:22.488 12:29:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:22.488 12:29:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:22.488 12:29:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:22.488 12:29:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:22.488 12:29:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:22.488 12:29:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.488 12:29:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.488 12:29:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.488 12:29:16 -- paths/export.sh@5 -- # export PATH 00:15:22.488 12:29:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:22.488 12:29:16 -- nvmf/common.sh@46 -- # : 0 00:15:22.488 12:29:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:22.488 12:29:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:22.488 12:29:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:22.488 12:29:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:22.488 12:29:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:22.488 12:29:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:22.488 12:29:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:22.488 12:29:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:22.488 12:29:16 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:22.488 12:29:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:22.488 12:29:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:22.488 12:29:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:22.488 12:29:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:22.488 12:29:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:22.488 12:29:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.488 12:29:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.488 12:29:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:22.488 12:29:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:22.488 12:29:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:22.488 12:29:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:22.488 12:29:16 -- common/autotest_common.sh@10 -- # set +x 00:15:24.388 12:29:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:24.388 12:29:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:24.388 12:29:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:24.388 12:29:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:24.388 12:29:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:24.388 12:29:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:24.388 12:29:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:24.388 12:29:18 -- nvmf/common.sh@294 -- # net_devs=() 00:15:24.388 12:29:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:24.388 12:29:18 -- nvmf/common.sh@295 -- # e810=() 00:15:24.388 12:29:18 -- nvmf/common.sh@295 -- # local -ga e810 00:15:24.388 12:29:18 -- nvmf/common.sh@296 -- # x722=() 00:15:24.388 12:29:18 -- nvmf/common.sh@296 -- # local -ga x722 00:15:24.388 12:29:18 -- nvmf/common.sh@297 -- # mlx=() 00:15:24.388 12:29:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:24.388 12:29:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:24.388 12:29:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:24.388 12:29:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:24.388 12:29:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:24.388 12:29:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.388 12:29:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:24.388 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:24.388 12:29:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:24.388 12:29:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:24.388 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:24.388 12:29:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:24.388 12:29:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:24.388 12:29:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.388 12:29:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.388 12:29:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.388 12:29:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.388 12:29:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:24.388 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:24.389 12:29:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.389 12:29:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:24.389 12:29:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:24.389 12:29:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:24.389 12:29:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:24.389 12:29:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:24.389 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:24.389 12:29:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:24.389 12:29:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:24.389 12:29:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:24.389 12:29:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:24.389 12:29:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:24.389 12:29:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:24.389 12:29:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.389 12:29:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:24.389 12:29:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:24.389 12:29:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:24.389 12:29:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:24.389 12:29:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:24.389 12:29:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:24.389 12:29:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:24.389 12:29:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.389 12:29:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:24.389 12:29:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:24.389 12:29:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:24.389 12:29:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:24.647 12:29:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:24.647 12:29:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:24.647 12:29:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:24.647 12:29:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:24.647 12:29:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:24.647 12:29:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:24.647 12:29:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:24.647 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.647 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:15:24.647 00:15:24.647 --- 10.0.0.2 ping statistics --- 00:15:24.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.647 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:15:24.647 12:29:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:24.647 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:24.647 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:15:24.647 00:15:24.647 --- 10.0.0.1 ping statistics --- 00:15:24.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.647 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:15:24.647 12:29:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:24.647 12:29:18 -- nvmf/common.sh@410 -- # return 0 00:15:24.647 12:29:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:24.647 12:29:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:24.647 12:29:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:24.647 12:29:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:24.647 12:29:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:24.647 12:29:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:24.647 12:29:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:24.647 12:29:18 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:24.647 12:29:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:24.647 12:29:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:24.647 12:29:18 -- common/autotest_common.sh@10 -- # set +x 00:15:24.647 12:29:18 -- nvmf/common.sh@469 -- # nvmfpid=1264907 00:15:24.647 12:29:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:24.647 12:29:18 -- nvmf/common.sh@470 -- # waitforlisten 1264907 00:15:24.647 12:29:18 -- common/autotest_common.sh@819 -- # '[' -z 1264907 ']' 00:15:24.647 12:29:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.647 12:29:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:24.647 12:29:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.647 12:29:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:24.647 12:29:18 -- common/autotest_common.sh@10 -- # set +x 00:15:24.647 [2024-07-12 12:29:18.451349] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:24.647 [2024-07-12 12:29:18.451428] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:24.647 EAL: No free 2048 kB hugepages reported on node 1 00:15:24.647 [2024-07-12 12:29:18.515463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:24.905 [2024-07-12 12:29:18.633286] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:24.905 [2024-07-12 12:29:18.633446] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:24.905 [2024-07-12 12:29:18.633467] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:24.905 [2024-07-12 12:29:18.633482] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:24.905 [2024-07-12 12:29:18.633513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.837 12:29:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:25.837 12:29:19 -- common/autotest_common.sh@852 -- # return 0 00:15:25.837 12:29:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:25.837 12:29:19 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 12:29:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.837 12:29:19 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:25.837 12:29:19 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:25.837 12:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 [2024-07-12 12:29:19.459957] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.837 12:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:25.837 12:29:19 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:25.837 12:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 12:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:25.837 12:29:19 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:25.837 12:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 [2024-07-12 12:29:19.476102] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:25.837 12:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:25.837 12:29:19 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:25.837 12:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 12:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:25.837 12:29:19 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:25.837 12:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 malloc0 00:15:25.837 12:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:25.837 12:29:19 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:25.837 12:29:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:25.837 12:29:19 -- common/autotest_common.sh@10 -- # set +x 00:15:25.837 12:29:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:25.837 12:29:19 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:25.837 12:29:19 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:25.837 12:29:19 -- nvmf/common.sh@520 -- # config=() 00:15:25.837 12:29:19 -- nvmf/common.sh@520 -- # local subsystem config 00:15:25.837 12:29:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:25.837 12:29:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:25.837 { 00:15:25.837 "params": { 00:15:25.837 "name": "Nvme$subsystem", 00:15:25.837 "trtype": "$TEST_TRANSPORT", 00:15:25.837 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.837 "adrfam": "ipv4", 00:15:25.837 "trsvcid": "$NVMF_PORT", 00:15:25.837 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.837 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.837 "hdgst": ${hdgst:-false}, 00:15:25.837 "ddgst": ${ddgst:-false} 00:15:25.837 }, 00:15:25.837 "method": "bdev_nvme_attach_controller" 00:15:25.837 } 00:15:25.837 EOF 00:15:25.837 )") 00:15:25.837 12:29:19 -- nvmf/common.sh@542 -- # cat 00:15:25.837 12:29:19 -- nvmf/common.sh@544 -- # jq . 00:15:25.837 12:29:19 -- nvmf/common.sh@545 -- # IFS=, 00:15:25.837 12:29:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:25.837 "params": { 00:15:25.837 "name": "Nvme1", 00:15:25.837 "trtype": "tcp", 00:15:25.837 "traddr": "10.0.0.2", 00:15:25.837 "adrfam": "ipv4", 00:15:25.837 "trsvcid": "4420", 00:15:25.837 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.837 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.837 "hdgst": false, 00:15:25.837 "ddgst": false 00:15:25.837 }, 00:15:25.837 "method": "bdev_nvme_attach_controller" 00:15:25.837 }' 00:15:25.837 [2024-07-12 12:29:19.554237] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:25.837 [2024-07-12 12:29:19.554327] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1265064 ] 00:15:25.837 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.837 [2024-07-12 12:29:19.623115] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:25.837 [2024-07-12 12:29:19.742204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:26.095 Running I/O for 10 seconds... 00:15:38.288 00:15:38.288 Latency(us) 00:15:38.288 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:38.288 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:15:38.288 Verification LBA range: start 0x0 length 0x1000 00:15:38.288 Nvme1n1 : 10.01 8723.97 68.16 0.00 0.00 14638.31 1686.95 22136.60 00:15:38.288 =================================================================================================================== 00:15:38.288 Total : 8723.97 68.16 0.00 0.00 14638.31 1686.95 22136.60 00:15:38.288 12:29:30 -- target/zcopy.sh@39 -- # perfpid=1266299 00:15:38.288 12:29:30 -- target/zcopy.sh@41 -- # xtrace_disable 00:15:38.288 12:29:30 -- common/autotest_common.sh@10 -- # set +x 00:15:38.288 12:29:30 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:15:38.288 12:29:30 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:15:38.288 12:29:30 -- nvmf/common.sh@520 -- # config=() 00:15:38.288 12:29:30 -- nvmf/common.sh@520 -- # local subsystem config 00:15:38.288 12:29:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:38.288 12:29:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:38.288 { 00:15:38.288 "params": { 00:15:38.288 "name": "Nvme$subsystem", 00:15:38.288 "trtype": "$TEST_TRANSPORT", 00:15:38.288 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:38.288 "adrfam": "ipv4", 00:15:38.288 "trsvcid": "$NVMF_PORT", 00:15:38.288 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:38.288 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:38.288 "hdgst": ${hdgst:-false}, 00:15:38.288 "ddgst": ${ddgst:-false} 00:15:38.288 }, 00:15:38.288 "method": "bdev_nvme_attach_controller" 00:15:38.288 } 00:15:38.288 EOF 00:15:38.288 )") 00:15:38.288 12:29:30 -- nvmf/common.sh@542 -- # cat 00:15:38.288 [2024-07-12 12:29:30.288203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.288 [2024-07-12 12:29:30.288249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.288 12:29:30 -- nvmf/common.sh@544 -- # jq . 00:15:38.288 12:29:30 -- nvmf/common.sh@545 -- # IFS=, 00:15:38.288 12:29:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:38.288 "params": { 00:15:38.288 "name": "Nvme1", 00:15:38.288 "trtype": "tcp", 00:15:38.288 "traddr": "10.0.0.2", 00:15:38.288 "adrfam": "ipv4", 00:15:38.288 "trsvcid": "4420", 00:15:38.289 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:38.289 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:38.289 "hdgst": false, 00:15:38.289 "ddgst": false 00:15:38.289 }, 00:15:38.289 "method": "bdev_nvme_attach_controller" 00:15:38.289 }' 00:15:38.289 [2024-07-12 12:29:30.296177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.296204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.304200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.304226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.312195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.312216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.320250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.320270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.321603] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:38.289 [2024-07-12 12:29:30.321658] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1266299 ] 00:15:38.289 [2024-07-12 12:29:30.328259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.328279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.336278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.336297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.344296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.344316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.289 [2024-07-12 12:29:30.352316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.352336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.360353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.360378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.368377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.368402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.376398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.376422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.384422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.384445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.384450] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:38.289 [2024-07-12 12:29:30.392468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.392504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.400490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.400528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.408491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.408515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.416510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.416535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.424532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.424556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.432554] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.432578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.440577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.440601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.448605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.448630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.456645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.456683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.464643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.464668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.472665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.472689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.480685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.480709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.488707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.488731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.496730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.496754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.503198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:38.289 [2024-07-12 12:29:30.504752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.504776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.512777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.512802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.520815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.520851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.528841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.528885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.536878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.536936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.544913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.544947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.552935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.552970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.560953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.560990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.568970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.569003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.576961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.576982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.585002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.585035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.593006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.593039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.601016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.601041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.609030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.609050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.617052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.617073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.625100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.625127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.633103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.633125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.641128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.641166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.649163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.649190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.657194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.657220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.665218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.665243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.673242] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.673267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.681266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.681290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.689298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.689322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.697331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.697358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.705358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.705383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.713374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.289 [2024-07-12 12:29:30.713400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.289 [2024-07-12 12:29:30.762076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.762104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.769539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.769566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 Running I/O for 5 seconds... 00:15:38.290 [2024-07-12 12:29:30.777562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.777588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.793061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.793091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.805751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.805784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.818317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.818350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.830131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.830160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.842620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.842652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.854661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.854694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.867146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.867174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.879121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.879166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.891888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.891922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.904044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.904072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.916136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.916178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.927923] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.927951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.939757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.939789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.951407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.951438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.963091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.963119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.975422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.975453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:30.987721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:30.987752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.000560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.000592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.011943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.011971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.023487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.023518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.035280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.035307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.047450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.047481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.059002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.059029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.070156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.070197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.082264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.082291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.093729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.093760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.107523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.107554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.118785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.118817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.130681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.130712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.143103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.143131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.155271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.155306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.166450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.166493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.177700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.177727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.189557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.189584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.201598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.201630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.214455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.214487] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.226275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.226306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.237757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.237784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.249965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.249996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.262124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.262154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.276030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.276067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.287192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.287219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.299521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.299548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.311735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.311762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.324141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.324172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.335948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.335976] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.348309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.348340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.360456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.360488] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.374240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.374268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.385343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.385383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.397348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.397375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.409780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.409808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.421588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.421619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.433410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.433437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.444812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.290 [2024-07-12 12:29:31.444840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.290 [2024-07-12 12:29:31.456437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.456469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.468250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.468287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.480012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.480040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.491567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.491599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.503688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.503720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.515578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.515609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.526753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.526784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.538623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.538654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.549968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.549996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.561978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.562006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.573656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.573687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.585513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.585544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.597151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.597193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.608587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.608635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.620937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.620964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.633393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.633425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.645509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.645537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.657729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.657761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.669759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.669787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.681281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.681311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.693475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.693507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.705631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.705658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.717526] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.717554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.731090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.731119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.741361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.741392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.754280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.754307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.766127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.766158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.777854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.777905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.789786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.789817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.801523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.801551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.813352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.813381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.824814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.824840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.836572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.836611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.847859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.847897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.859558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.859586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.870847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.870886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.882422] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.882451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.893787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.893815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.905410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.905437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.916828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.916856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.929920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.929948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.941117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.941147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.952458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.952485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.963758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.963786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.975199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.975227] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.986942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.986970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:31.998974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:31.999002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.010637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.010668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.022107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.022150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.033754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.033782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.045021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.045049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.056953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.056987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.069272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.069299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.081122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.081150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.093435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.093462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.105705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.105746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.117716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.117759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.129884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.129928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.291 [2024-07-12 12:29:32.142029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.291 [2024-07-12 12:29:32.142057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.292 [2024-07-12 12:29:32.154113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.292 [2024-07-12 12:29:32.154141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.292 [2024-07-12 12:29:32.166175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.292 [2024-07-12 12:29:32.166202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.292 [2024-07-12 12:29:32.177684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.292 [2024-07-12 12:29:32.177711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.292 [2024-07-12 12:29:32.189036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.292 [2024-07-12 12:29:32.189064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.292 [2024-07-12 12:29:32.200623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.292 [2024-07-12 12:29:32.200650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.212695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.212723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.224493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.224520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.237735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.237762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.247839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.247891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.259768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.259794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.271148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.271192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.282344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.282371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.294454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.294481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.307101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.307128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.319454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.319481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.330661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.330688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.343167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.343194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.355693] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.355720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.367660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.367687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.379988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.380015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.391909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.391937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.403261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.403288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.416296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.416323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.426930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.426958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.438423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.438450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.449604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.449631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.549 [2024-07-12 12:29:32.461253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.549 [2024-07-12 12:29:32.461297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.473301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.473328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.485218] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.485245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.496246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.496274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.508261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.508306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.519635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.519662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.531232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.531275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.542840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.542877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.554583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.554611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.566664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.566692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.578058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.578086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.591269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.591315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.602425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.602453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.614461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.614489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.625734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.625762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.637467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.637495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.650032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.650062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.662104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.662133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.673620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.673648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.685684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.685712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.697638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.697666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.709304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.709331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:38.807 [2024-07-12 12:29:32.721007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:38.807 [2024-07-12 12:29:32.721035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.732780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.732807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.744647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.744674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.758284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.758311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.769414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.769457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.781289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.781316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.793110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.793138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.807252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.807280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.818335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.818362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.830315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.830342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.842075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.842102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.854138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.854180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.866665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.866692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.878649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.878677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.890253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.890280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.902084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.902112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.914195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.914222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.925423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.925450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.937176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.937204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.949114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.949149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.960672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.960716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.064 [2024-07-12 12:29:32.972931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.064 [2024-07-12 12:29:32.972959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:32.984296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:32.984324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:32.998263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:32.998296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.009328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.009366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.021364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.021392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.033233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.033261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.045028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.045056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.056918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.056947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.069504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.069535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.081901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.081946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.094629] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.094661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.106551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.320 [2024-07-12 12:29:33.106583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.320 [2024-07-12 12:29:33.119515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.119546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.131908] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.131936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.144234] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.144261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.155983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.156014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.169709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.169751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.180806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.180846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.193168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.193211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.205061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.205089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.216261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.216292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.227944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.227972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.321 [2024-07-12 12:29:33.240244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.321 [2024-07-12 12:29:33.240275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.252730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.252758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.264896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.264924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.276609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.276636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.290263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.290290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.301634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.301665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.313306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.313333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.324761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.324788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.338557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.338584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.349578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.349610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.361222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.361249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.372655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.372687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.384195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.384222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.396044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.396072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.407735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.407769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.419665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.419696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.433729] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.433761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.445239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.445284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.456810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.456841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.469065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.469093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.480476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.480503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.578 [2024-07-12 12:29:33.492136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.578 [2024-07-12 12:29:33.492179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.504347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.504375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.516350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.516377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.528303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.528330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.542157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.542200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.553195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.553222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.564860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.564913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.576418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.576445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.588006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.588034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.834 [2024-07-12 12:29:33.599631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.834 [2024-07-12 12:29:33.599663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.611321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.611352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.623123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.623151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.635154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.635203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.647384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.647415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.659063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.659091] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.672909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.672937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.683068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.683096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.695191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.695219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.707503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.707535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.719892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.719920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.732328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.732358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:39.835 [2024-07-12 12:29:33.744281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:39.835 [2024-07-12 12:29:33.744309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.756543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.756580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.768651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.768679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.780635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.780662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.792507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.792534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.804309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.804336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.815950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.815979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.828296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.828328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.840498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.840525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.852385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.852414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.866399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.866439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.878014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.878044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.092 [2024-07-12 12:29:33.890251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.092 [2024-07-12 12:29:33.890283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.902346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.902377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.913765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.913796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.925640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.925671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.937579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.937610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.949236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.949263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.960940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.960968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.972936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.972964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.984483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.984514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:33.996381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:33.996413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.093 [2024-07-12 12:29:34.008261] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.093 [2024-07-12 12:29:34.008290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.353 [2024-07-12 12:29:34.020447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.353 [2024-07-12 12:29:34.020475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.353 [2024-07-12 12:29:34.031837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.353 [2024-07-12 12:29:34.031878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.353 [2024-07-12 12:29:34.043490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.353 [2024-07-12 12:29:34.043521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.353 [2024-07-12 12:29:34.054875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.054903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.066252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.066279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.078243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.078271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.090428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.090461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.102354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.102386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.114039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.114068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.127606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.127634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.139109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.139138] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.151418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.151450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.163562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.163598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.175761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.175802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.187573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.187604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.199438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.199470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.211343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.211370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.222984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.223012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.234752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.234783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.248538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.248569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.259682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.259713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.354 [2024-07-12 12:29:34.271519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.354 [2024-07-12 12:29:34.271557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.283713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.283745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.295408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.295439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.308512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.308543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.319007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.319034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.331048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.331076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.343390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.343421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.355459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.355490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.367389] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.367427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.379354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.379386] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.390775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.390807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.402346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.402377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.639 [2024-07-12 12:29:34.413821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.639 [2024-07-12 12:29:34.413852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.425255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.425286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.437421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.437453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.451505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.451537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.462649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.462680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.474148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.474177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.486044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.486072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.497722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.497753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.509081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.509109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.521156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.521199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.534680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.534711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.640 [2024-07-12 12:29:34.545599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.640 [2024-07-12 12:29:34.545631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.557198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.557226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.569044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.569073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.581471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.581502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.593689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.593720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.605600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.605631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.617418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.617449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.631432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.631463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.643721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.643752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.655849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.655902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.667851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.667888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.680031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.680059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.691836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.691879] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.704195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.704238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.716794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.716825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.729491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.729522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.741993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.742021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.753857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.753906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.765768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.765804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.779202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.779230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.789990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.790018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.802104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.802132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:40.903 [2024-07-12 12:29:34.813567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:40.903 [2024-07-12 12:29:34.813595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.824812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.824844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.836853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.836905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.848919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.848946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.860558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.860586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.872215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.872243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.884266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.884294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.896285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.896318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.908046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.908075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.920166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.920198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.932339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.932367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.944067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.944096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.955400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.955427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.967110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.967141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.978899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.978929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:34.990744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:34.990779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.004425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.004452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.014850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.014900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.026963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.026991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.038644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.038671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.050402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.050433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.062600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.062627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.162 [2024-07-12 12:29:35.074277] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.162 [2024-07-12 12:29:35.074304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.421 [2024-07-12 12:29:35.086903] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.421 [2024-07-12 12:29:35.086931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.421 [2024-07-12 12:29:35.098951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.421 [2024-07-12 12:29:35.098979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.421 [2024-07-12 12:29:35.110571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.421 [2024-07-12 12:29:35.110598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.421 [2024-07-12 12:29:35.122744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.421 [2024-07-12 12:29:35.122771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.421 [2024-07-12 12:29:35.134665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.421 [2024-07-12 12:29:35.134697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.147193] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.147220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.159458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.159489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.171648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.171679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.183301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.183328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.195078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.195106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.207286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.207317] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.219458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.219498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.232369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.232401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.244651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.244687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.258337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.258365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.269799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.269826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.281369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.281400] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.293240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.293268] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.304980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.305009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.316839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.316880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.328997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.329025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.422 [2024-07-12 12:29:35.341114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.422 [2024-07-12 12:29:35.341143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.353102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.353145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.365524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.365552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.378034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.378061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.389977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.390007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.402004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.402035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.413926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.413958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.680 [2024-07-12 12:29:35.425883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.680 [2024-07-12 12:29:35.425914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.437704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.437735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.449694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.449733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.461780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.461811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.473460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.473492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.485714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.485745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.497781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.497812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.509862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.509901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.521738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.521770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.534112] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.534143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.546011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.546043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.558041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.558073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.573990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.574022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.585372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.585403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.681 [2024-07-12 12:29:35.597666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.681 [2024-07-12 12:29:35.597697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.609905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.609936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.622201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.622232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.634618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.634650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.646810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.646842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.659066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.659097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.670622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.670653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.682479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.682524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.694124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.694155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.706384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.706415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.718846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.718886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.731302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.731334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.745379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.745410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.756620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.756651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.769003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.769034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.781287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.781318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.793100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.793130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 00:15:41.938 Latency(us) 00:15:41.938 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.938 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:15:41.938 Nvme1n1 : 5.01 10684.69 83.47 0.00 0.00 11961.70 5194.33 25437.68 00:15:41.938 =================================================================================================================== 00:15:41.938 Total : 10684.69 83.47 0.00 0.00 11961.70 5194.33 25437.68 00:15:41.938 [2024-07-12 12:29:35.799639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.799668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.807664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.807692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.815678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.815705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.823717] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.823755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.831760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.831808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.839783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.839830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.847808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.847855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:41.938 [2024-07-12 12:29:35.855830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:41.938 [2024-07-12 12:29:35.855886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.863855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.863912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.871880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.871928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.879906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.879953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.887932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.887984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.895958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.896008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.903975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.904024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.911990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.912031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.920013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.920056] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.928036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.928080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.936018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.936043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.944037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.944061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.952061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.952085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.960085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.960109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.968108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.968131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.976175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.976220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.984191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.984236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:35.992177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:35.992202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.000198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.000222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.008228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.008252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.016243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.016266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.024268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.024294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.032326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.032371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.040354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.040399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.048331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.048356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.056353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.056378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 [2024-07-12 12:29:36.064373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:15:42.196 [2024-07-12 12:29:36.064399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:42.196 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1266299) - No such process 00:15:42.196 12:29:36 -- target/zcopy.sh@49 -- # wait 1266299 00:15:42.196 12:29:36 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:15:42.196 12:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:42.196 12:29:36 -- common/autotest_common.sh@10 -- # set +x 00:15:42.196 12:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:42.196 12:29:36 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:42.196 12:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:42.196 12:29:36 -- common/autotest_common.sh@10 -- # set +x 00:15:42.196 delay0 00:15:42.196 12:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:42.196 12:29:36 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:15:42.196 12:29:36 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:42.196 12:29:36 -- common/autotest_common.sh@10 -- # set +x 00:15:42.196 12:29:36 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:42.196 12:29:36 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:15:42.454 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.454 [2024-07-12 12:29:36.269973] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:15:50.564 [2024-07-12 12:29:43.305061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1385f30 is same with the state(5) to be set 00:15:50.564 Initializing NVMe Controllers 00:15:50.564 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:50.564 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:50.564 Initialization complete. Launching workers. 00:15:50.564 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 250, failed: 21819 00:15:50.564 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 21959, failed to submit 110 00:15:50.564 success 21853, unsuccess 106, failed 0 00:15:50.564 12:29:43 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:15:50.564 12:29:43 -- target/zcopy.sh@60 -- # nvmftestfini 00:15:50.564 12:29:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:50.564 12:29:43 -- nvmf/common.sh@116 -- # sync 00:15:50.564 12:29:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:50.564 12:29:43 -- nvmf/common.sh@119 -- # set +e 00:15:50.564 12:29:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:50.564 12:29:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:50.564 rmmod nvme_tcp 00:15:50.564 rmmod nvme_fabrics 00:15:50.564 rmmod nvme_keyring 00:15:50.564 12:29:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:50.564 12:29:43 -- nvmf/common.sh@123 -- # set -e 00:15:50.564 12:29:43 -- nvmf/common.sh@124 -- # return 0 00:15:50.564 12:29:43 -- nvmf/common.sh@477 -- # '[' -n 1264907 ']' 00:15:50.564 12:29:43 -- nvmf/common.sh@478 -- # killprocess 1264907 00:15:50.564 12:29:43 -- common/autotest_common.sh@926 -- # '[' -z 1264907 ']' 00:15:50.564 12:29:43 -- common/autotest_common.sh@930 -- # kill -0 1264907 00:15:50.564 12:29:43 -- common/autotest_common.sh@931 -- # uname 00:15:50.564 12:29:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:15:50.564 12:29:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1264907 00:15:50.564 12:29:43 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:15:50.564 12:29:43 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:15:50.564 12:29:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1264907' 00:15:50.564 killing process with pid 1264907 00:15:50.564 12:29:43 -- common/autotest_common.sh@945 -- # kill 1264907 00:15:50.564 12:29:43 -- common/autotest_common.sh@950 -- # wait 1264907 00:15:50.564 12:29:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:50.564 12:29:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:50.564 12:29:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:50.564 12:29:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:50.564 12:29:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:50.564 12:29:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:50.564 12:29:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:50.564 12:29:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.939 12:29:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:51.939 00:15:51.939 real 0m29.462s 00:15:51.939 user 0m43.037s 00:15:51.939 sys 0m9.130s 00:15:51.939 12:29:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:15:51.939 12:29:45 -- common/autotest_common.sh@10 -- # set +x 00:15:51.939 ************************************ 00:15:51.939 END TEST nvmf_zcopy 00:15:51.939 ************************************ 00:15:51.939 12:29:45 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:51.939 12:29:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:15:51.939 12:29:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:15:51.939 12:29:45 -- common/autotest_common.sh@10 -- # set +x 00:15:51.939 ************************************ 00:15:51.939 START TEST nvmf_nmic 00:15:51.939 ************************************ 00:15:51.939 12:29:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:15:51.939 * Looking for test storage... 00:15:51.939 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:51.939 12:29:45 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:51.939 12:29:45 -- nvmf/common.sh@7 -- # uname -s 00:15:51.939 12:29:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:51.939 12:29:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:51.939 12:29:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:51.939 12:29:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:51.939 12:29:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:51.939 12:29:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:51.939 12:29:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:51.939 12:29:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:51.939 12:29:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:51.939 12:29:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:51.939 12:29:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.939 12:29:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:51.939 12:29:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:51.939 12:29:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:51.939 12:29:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:51.939 12:29:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:51.939 12:29:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:51.939 12:29:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:51.939 12:29:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:51.939 12:29:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.939 12:29:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.939 12:29:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.939 12:29:45 -- paths/export.sh@5 -- # export PATH 00:15:51.939 12:29:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:51.939 12:29:45 -- nvmf/common.sh@46 -- # : 0 00:15:51.939 12:29:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:51.939 12:29:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:51.939 12:29:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:51.939 12:29:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:51.939 12:29:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:51.939 12:29:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:51.939 12:29:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:51.939 12:29:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:51.939 12:29:45 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:51.939 12:29:45 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:51.939 12:29:45 -- target/nmic.sh@14 -- # nvmftestinit 00:15:51.939 12:29:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:51.939 12:29:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:51.939 12:29:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:51.939 12:29:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:51.939 12:29:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:51.939 12:29:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:51.939 12:29:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:51.939 12:29:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:51.939 12:29:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:51.939 12:29:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:51.939 12:29:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:51.939 12:29:45 -- common/autotest_common.sh@10 -- # set +x 00:15:54.466 12:29:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:54.466 12:29:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:54.466 12:29:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:54.466 12:29:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:54.466 12:29:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:54.466 12:29:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:54.466 12:29:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:54.466 12:29:47 -- nvmf/common.sh@294 -- # net_devs=() 00:15:54.466 12:29:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:54.466 12:29:47 -- nvmf/common.sh@295 -- # e810=() 00:15:54.466 12:29:47 -- nvmf/common.sh@295 -- # local -ga e810 00:15:54.466 12:29:47 -- nvmf/common.sh@296 -- # x722=() 00:15:54.466 12:29:47 -- nvmf/common.sh@296 -- # local -ga x722 00:15:54.466 12:29:47 -- nvmf/common.sh@297 -- # mlx=() 00:15:54.466 12:29:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:54.466 12:29:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:54.466 12:29:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:54.466 12:29:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:54.466 12:29:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:54.466 12:29:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:54.466 12:29:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:54.466 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:54.466 12:29:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:54.466 12:29:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:54.466 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:54.466 12:29:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:54.466 12:29:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:54.466 12:29:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.466 12:29:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:54.466 12:29:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.466 12:29:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:54.466 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:54.466 12:29:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.466 12:29:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:54.466 12:29:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:54.466 12:29:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:54.466 12:29:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:54.466 12:29:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:54.466 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:54.466 12:29:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:54.466 12:29:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:54.466 12:29:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:54.466 12:29:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:54.466 12:29:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:54.466 12:29:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:54.466 12:29:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:54.466 12:29:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:54.466 12:29:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:54.466 12:29:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:54.466 12:29:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:54.466 12:29:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:54.466 12:29:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:54.466 12:29:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:54.466 12:29:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:54.466 12:29:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:54.466 12:29:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:54.466 12:29:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:54.466 12:29:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:54.467 12:29:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:54.467 12:29:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:54.467 12:29:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:54.467 12:29:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:54.467 12:29:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:54.467 12:29:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:54.467 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:54.467 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.121 ms 00:15:54.467 00:15:54.467 --- 10.0.0.2 ping statistics --- 00:15:54.467 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:54.467 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:15:54.467 12:29:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:54.467 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:54.467 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:15:54.467 00:15:54.467 --- 10.0.0.1 ping statistics --- 00:15:54.467 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:54.467 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:15:54.467 12:29:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:54.467 12:29:47 -- nvmf/common.sh@410 -- # return 0 00:15:54.467 12:29:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:54.467 12:29:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:54.467 12:29:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:54.467 12:29:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:54.467 12:29:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:54.467 12:29:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:54.467 12:29:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:54.467 12:29:47 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:15:54.467 12:29:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:54.467 12:29:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:15:54.467 12:29:47 -- common/autotest_common.sh@10 -- # set +x 00:15:54.467 12:29:47 -- nvmf/common.sh@469 -- # nvmfpid=1269863 00:15:54.467 12:29:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:54.467 12:29:47 -- nvmf/common.sh@470 -- # waitforlisten 1269863 00:15:54.467 12:29:47 -- common/autotest_common.sh@819 -- # '[' -z 1269863 ']' 00:15:54.467 12:29:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:54.467 12:29:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:15:54.467 12:29:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:54.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:54.467 12:29:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:15:54.467 12:29:47 -- common/autotest_common.sh@10 -- # set +x 00:15:54.467 [2024-07-12 12:29:48.021484] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:15:54.467 [2024-07-12 12:29:48.021561] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:54.467 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.467 [2024-07-12 12:29:48.088857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:54.467 [2024-07-12 12:29:48.204502] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:54.467 [2024-07-12 12:29:48.204667] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:54.467 [2024-07-12 12:29:48.204686] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:54.467 [2024-07-12 12:29:48.204700] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:54.467 [2024-07-12 12:29:48.204787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:54.467 [2024-07-12 12:29:48.204839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:54.467 [2024-07-12 12:29:48.204905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:54.467 [2024-07-12 12:29:48.204908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:55.398 12:29:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:15:55.398 12:29:48 -- common/autotest_common.sh@852 -- # return 0 00:15:55.398 12:29:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:55.398 12:29:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:15:55.398 12:29:48 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 12:29:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:55.398 12:29:48 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:55.398 12:29:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:48 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 [2024-07-12 12:29:48.981304] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:55.398 12:29:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:48 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:55.398 12:29:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:48 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 Malloc0 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 [2024-07-12 12:29:49.034891] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:15:55.398 test case1: single bdev can't be used in multiple subsystems 00:15:55.398 12:29:49 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@28 -- # nmic_status=0 00:15:55.398 12:29:49 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 [2024-07-12 12:29:49.058749] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:15:55.398 [2024-07-12 12:29:49.058778] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:15:55.398 [2024-07-12 12:29:49.058810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:15:55.398 request: 00:15:55.398 { 00:15:55.398 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:15:55.398 "namespace": { 00:15:55.398 "bdev_name": "Malloc0" 00:15:55.398 }, 00:15:55.398 "method": "nvmf_subsystem_add_ns", 00:15:55.398 "req_id": 1 00:15:55.398 } 00:15:55.398 Got JSON-RPC error response 00:15:55.398 response: 00:15:55.398 { 00:15:55.398 "code": -32602, 00:15:55.398 "message": "Invalid parameters" 00:15:55.398 } 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@29 -- # nmic_status=1 00:15:55.398 12:29:49 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:15:55.398 12:29:49 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:15:55.398 Adding namespace failed - expected result. 00:15:55.398 12:29:49 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:15:55.398 test case2: host connect to nvmf target in multiple paths 00:15:55.398 12:29:49 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:15:55.398 12:29:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:15:55.398 12:29:49 -- common/autotest_common.sh@10 -- # set +x 00:15:55.398 [2024-07-12 12:29:49.066878] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:15:55.398 12:29:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:15:55.398 12:29:49 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:55.963 12:29:49 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:15:56.528 12:29:50 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:15:56.528 12:29:50 -- common/autotest_common.sh@1177 -- # local i=0 00:15:56.528 12:29:50 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:15:56.528 12:29:50 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:15:56.528 12:29:50 -- common/autotest_common.sh@1184 -- # sleep 2 00:15:59.060 12:29:52 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:15:59.060 12:29:52 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:15:59.060 12:29:52 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:15:59.060 12:29:52 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:15:59.060 12:29:52 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:15:59.060 12:29:52 -- common/autotest_common.sh@1187 -- # return 0 00:15:59.060 12:29:52 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:15:59.060 [global] 00:15:59.060 thread=1 00:15:59.060 invalidate=1 00:15:59.060 rw=write 00:15:59.060 time_based=1 00:15:59.060 runtime=1 00:15:59.060 ioengine=libaio 00:15:59.060 direct=1 00:15:59.060 bs=4096 00:15:59.060 iodepth=1 00:15:59.060 norandommap=0 00:15:59.060 numjobs=1 00:15:59.060 00:15:59.060 verify_dump=1 00:15:59.060 verify_backlog=512 00:15:59.060 verify_state_save=0 00:15:59.060 do_verify=1 00:15:59.060 verify=crc32c-intel 00:15:59.060 [job0] 00:15:59.060 filename=/dev/nvme0n1 00:15:59.060 Could not set queue depth (nvme0n1) 00:15:59.060 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:15:59.060 fio-3.35 00:15:59.060 Starting 1 thread 00:15:59.999 00:15:59.999 job0: (groupid=0, jobs=1): err= 0: pid=1270526: Fri Jul 12 12:29:53 2024 00:15:59.999 read: IOPS=1499, BW=5996KiB/s (6140kB/s)(6212KiB/1036msec) 00:15:59.999 slat (nsec): min=5385, max=18569, avg=6659.56, stdev=864.21 00:15:59.999 clat (usec): min=180, max=41381, avg=401.33, stdev=2735.70 00:15:59.999 lat (usec): min=186, max=41388, avg=407.99, stdev=2735.85 00:15:59.999 clat percentiles (usec): 00:15:59.999 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 200], 20.00th=[ 206], 00:15:59.999 | 30.00th=[ 210], 40.00th=[ 212], 50.00th=[ 217], 60.00th=[ 221], 00:15:59.999 | 70.00th=[ 225], 80.00th=[ 229], 90.00th=[ 235], 95.00th=[ 241], 00:15:59.999 | 99.00th=[ 297], 99.50th=[ 334], 99.90th=[41157], 99.95th=[41157], 00:15:59.999 | 99.99th=[41157] 00:15:59.999 write: IOPS=1976, BW=7907KiB/s (8097kB/s)(8192KiB/1036msec); 0 zone resets 00:15:59.999 slat (usec): min=7, max=28019, avg=22.37, stdev=618.95 00:15:59.999 clat (usec): min=128, max=1244, avg=170.42, stdev=48.11 00:15:59.999 lat (usec): min=136, max=28304, avg=192.79, stdev=623.35 00:15:59.999 clat percentiles (usec): 00:15:59.999 | 1.00th=[ 137], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 155], 00:15:59.999 | 30.00th=[ 159], 40.00th=[ 163], 50.00th=[ 165], 60.00th=[ 167], 00:15:59.999 | 70.00th=[ 172], 80.00th=[ 180], 90.00th=[ 194], 95.00th=[ 202], 00:15:59.999 | 99.00th=[ 273], 99.50th=[ 293], 99.90th=[ 848], 99.95th=[ 1057], 00:15:59.999 | 99.99th=[ 1237] 00:15:59.999 bw ( KiB/s): min= 5384, max=11000, per=100.00%, avg=8192.00, stdev=3971.11, samples=2 00:15:59.999 iops : min= 1346, max= 2750, avg=2048.00, stdev=992.78, samples=2 00:15:59.999 lat (usec) : 250=97.95%, 500=1.64%, 750=0.11%, 1000=0.06% 00:15:59.999 lat (msec) : 2=0.06%, 50=0.19% 00:15:59.999 cpu : usr=1.16%, sys=2.90%, ctx=3603, majf=0, minf=2 00:15:59.999 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:15:59.999 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.999 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:15:59.999 issued rwts: total=1553,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:15:59.999 latency : target=0, window=0, percentile=100.00%, depth=1 00:15:59.999 00:15:59.999 Run status group 0 (all jobs): 00:15:59.999 READ: bw=5996KiB/s (6140kB/s), 5996KiB/s-5996KiB/s (6140kB/s-6140kB/s), io=6212KiB (6361kB), run=1036-1036msec 00:15:59.999 WRITE: bw=7907KiB/s (8097kB/s), 7907KiB/s-7907KiB/s (8097kB/s-8097kB/s), io=8192KiB (8389kB), run=1036-1036msec 00:15:59.999 00:15:59.999 Disk stats (read/write): 00:15:59.999 nvme0n1: ios=1569/2048, merge=0/0, ticks=1441/349, in_queue=1790, util=98.60% 00:15:59.999 12:29:53 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:59.999 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:15:59.999 12:29:53 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:59.999 12:29:53 -- common/autotest_common.sh@1198 -- # local i=0 00:15:59.999 12:29:53 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:15:59.999 12:29:53 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:59.999 12:29:53 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:15:59.999 12:29:53 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:59.999 12:29:53 -- common/autotest_common.sh@1210 -- # return 0 00:15:59.999 12:29:53 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:15:59.999 12:29:53 -- target/nmic.sh@53 -- # nvmftestfini 00:15:59.999 12:29:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:59.999 12:29:53 -- nvmf/common.sh@116 -- # sync 00:15:59.999 12:29:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:59.999 12:29:53 -- nvmf/common.sh@119 -- # set +e 00:15:59.999 12:29:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:59.999 12:29:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:59.999 rmmod nvme_tcp 00:15:59.999 rmmod nvme_fabrics 00:15:59.999 rmmod nvme_keyring 00:15:59.999 12:29:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:59.999 12:29:53 -- nvmf/common.sh@123 -- # set -e 00:15:59.999 12:29:53 -- nvmf/common.sh@124 -- # return 0 00:15:59.999 12:29:53 -- nvmf/common.sh@477 -- # '[' -n 1269863 ']' 00:15:59.999 12:29:53 -- nvmf/common.sh@478 -- # killprocess 1269863 00:15:59.999 12:29:53 -- common/autotest_common.sh@926 -- # '[' -z 1269863 ']' 00:16:00.259 12:29:53 -- common/autotest_common.sh@930 -- # kill -0 1269863 00:16:00.259 12:29:53 -- common/autotest_common.sh@931 -- # uname 00:16:00.259 12:29:53 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:00.259 12:29:53 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1269863 00:16:00.259 12:29:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:00.259 12:29:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:00.259 12:29:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1269863' 00:16:00.259 killing process with pid 1269863 00:16:00.259 12:29:53 -- common/autotest_common.sh@945 -- # kill 1269863 00:16:00.259 12:29:53 -- common/autotest_common.sh@950 -- # wait 1269863 00:16:00.518 12:29:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.518 12:29:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.518 12:29:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.518 12:29:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.518 12:29:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.518 12:29:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.518 12:29:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.518 12:29:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.426 12:29:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:02.426 00:16:02.426 real 0m10.521s 00:16:02.426 user 0m24.831s 00:16:02.426 sys 0m2.399s 00:16:02.426 12:29:56 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:02.426 12:29:56 -- common/autotest_common.sh@10 -- # set +x 00:16:02.426 ************************************ 00:16:02.426 END TEST nvmf_nmic 00:16:02.426 ************************************ 00:16:02.426 12:29:56 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:02.426 12:29:56 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:02.426 12:29:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:02.426 12:29:56 -- common/autotest_common.sh@10 -- # set +x 00:16:02.426 ************************************ 00:16:02.426 START TEST nvmf_fio_target 00:16:02.426 ************************************ 00:16:02.426 12:29:56 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:02.684 * Looking for test storage... 00:16:02.684 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:02.684 12:29:56 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:02.684 12:29:56 -- nvmf/common.sh@7 -- # uname -s 00:16:02.684 12:29:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:02.684 12:29:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:02.684 12:29:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:02.684 12:29:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:02.684 12:29:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:02.684 12:29:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:02.684 12:29:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:02.684 12:29:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:02.684 12:29:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:02.684 12:29:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:02.685 12:29:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.685 12:29:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:02.685 12:29:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:02.685 12:29:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:02.685 12:29:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:02.685 12:29:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:02.685 12:29:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:02.685 12:29:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:02.685 12:29:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:02.685 12:29:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.685 12:29:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.685 12:29:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.685 12:29:56 -- paths/export.sh@5 -- # export PATH 00:16:02.685 12:29:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:02.685 12:29:56 -- nvmf/common.sh@46 -- # : 0 00:16:02.685 12:29:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:02.685 12:29:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:02.685 12:29:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:02.685 12:29:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:02.685 12:29:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:02.685 12:29:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:02.685 12:29:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:02.685 12:29:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:02.685 12:29:56 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:02.685 12:29:56 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:02.685 12:29:56 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:02.685 12:29:56 -- target/fio.sh@16 -- # nvmftestinit 00:16:02.685 12:29:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:02.685 12:29:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:02.685 12:29:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:02.685 12:29:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:02.685 12:29:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:02.685 12:29:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:02.685 12:29:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:02.685 12:29:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:02.685 12:29:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:02.685 12:29:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:02.685 12:29:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:02.685 12:29:56 -- common/autotest_common.sh@10 -- # set +x 00:16:04.586 12:29:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:04.586 12:29:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:04.586 12:29:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:04.586 12:29:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:04.586 12:29:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:04.586 12:29:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:04.586 12:29:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:04.586 12:29:58 -- nvmf/common.sh@294 -- # net_devs=() 00:16:04.586 12:29:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:04.586 12:29:58 -- nvmf/common.sh@295 -- # e810=() 00:16:04.586 12:29:58 -- nvmf/common.sh@295 -- # local -ga e810 00:16:04.586 12:29:58 -- nvmf/common.sh@296 -- # x722=() 00:16:04.586 12:29:58 -- nvmf/common.sh@296 -- # local -ga x722 00:16:04.586 12:29:58 -- nvmf/common.sh@297 -- # mlx=() 00:16:04.586 12:29:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:04.586 12:29:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:04.586 12:29:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:04.586 12:29:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:04.586 12:29:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:04.586 12:29:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:04.586 12:29:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:04.586 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:04.586 12:29:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:04.586 12:29:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:04.586 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:04.586 12:29:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:04.586 12:29:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:04.586 12:29:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:04.587 12:29:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:04.587 12:29:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:04.587 12:29:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.587 12:29:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:04.587 12:29:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.587 12:29:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:04.587 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:04.587 12:29:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.587 12:29:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:04.587 12:29:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:04.587 12:29:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:04.587 12:29:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:04.587 12:29:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:04.587 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:04.587 12:29:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:04.587 12:29:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:04.587 12:29:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:04.587 12:29:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:04.587 12:29:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:04.587 12:29:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:04.587 12:29:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:04.587 12:29:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:04.587 12:29:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:04.587 12:29:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:04.587 12:29:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:04.587 12:29:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:04.587 12:29:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:04.587 12:29:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:04.587 12:29:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:04.587 12:29:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:04.587 12:29:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:04.587 12:29:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:04.587 12:29:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:04.587 12:29:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:04.587 12:29:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:04.587 12:29:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:04.587 12:29:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:04.587 12:29:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:04.587 12:29:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:04.587 12:29:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:04.587 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:04.587 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.155 ms 00:16:04.587 00:16:04.587 --- 10.0.0.2 ping statistics --- 00:16:04.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:04.587 rtt min/avg/max/mdev = 0.155/0.155/0.155/0.000 ms 00:16:04.587 12:29:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:04.587 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:04.587 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:16:04.587 00:16:04.587 --- 10.0.0.1 ping statistics --- 00:16:04.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:04.587 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:16:04.587 12:29:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:04.587 12:29:58 -- nvmf/common.sh@410 -- # return 0 00:16:04.587 12:29:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:04.587 12:29:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:04.587 12:29:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:04.587 12:29:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:04.587 12:29:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:04.587 12:29:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:04.587 12:29:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:04.587 12:29:58 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:04.587 12:29:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:04.587 12:29:58 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:04.587 12:29:58 -- common/autotest_common.sh@10 -- # set +x 00:16:04.855 12:29:58 -- nvmf/common.sh@469 -- # nvmfpid=1272615 00:16:04.855 12:29:58 -- nvmf/common.sh@470 -- # waitforlisten 1272615 00:16:04.855 12:29:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:04.855 12:29:58 -- common/autotest_common.sh@819 -- # '[' -z 1272615 ']' 00:16:04.855 12:29:58 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:04.855 12:29:58 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:04.855 12:29:58 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:04.855 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:04.855 12:29:58 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:04.855 12:29:58 -- common/autotest_common.sh@10 -- # set +x 00:16:04.855 [2024-07-12 12:29:58.545796] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:04.855 [2024-07-12 12:29:58.545885] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:04.855 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.855 [2024-07-12 12:29:58.622646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:04.855 [2024-07-12 12:29:58.748579] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:04.855 [2024-07-12 12:29:58.748740] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:04.855 [2024-07-12 12:29:58.748760] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:04.855 [2024-07-12 12:29:58.748774] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:04.855 [2024-07-12 12:29:58.748849] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.855 [2024-07-12 12:29:58.748908] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:04.855 [2024-07-12 12:29:58.748903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:04.855 [2024-07-12 12:29:58.748879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:05.797 12:29:59 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:05.797 12:29:59 -- common/autotest_common.sh@852 -- # return 0 00:16:05.797 12:29:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:05.797 12:29:59 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:05.797 12:29:59 -- common/autotest_common.sh@10 -- # set +x 00:16:05.797 12:29:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:05.797 12:29:59 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:06.055 [2024-07-12 12:29:59.846392] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:06.055 12:29:59 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.313 12:30:00 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:06.313 12:30:00 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.571 12:30:00 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:06.571 12:30:00 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:06.829 12:30:00 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:06.829 12:30:00 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.087 12:30:00 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:07.087 12:30:00 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:07.344 12:30:01 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.603 12:30:01 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:07.603 12:30:01 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:07.860 12:30:01 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:07.860 12:30:01 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:08.117 12:30:01 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:08.117 12:30:01 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:08.374 12:30:02 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:08.632 12:30:02 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:08.632 12:30:02 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:08.890 12:30:02 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:08.890 12:30:02 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:09.148 12:30:02 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:09.405 [2024-07-12 12:30:03.146684] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:09.405 12:30:03 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:09.662 12:30:03 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:09.919 12:30:03 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:10.487 12:30:04 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:10.487 12:30:04 -- common/autotest_common.sh@1177 -- # local i=0 00:16:10.487 12:30:04 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:16:10.487 12:30:04 -- common/autotest_common.sh@1179 -- # [[ -n 4 ]] 00:16:10.487 12:30:04 -- common/autotest_common.sh@1180 -- # nvme_device_counter=4 00:16:10.487 12:30:04 -- common/autotest_common.sh@1184 -- # sleep 2 00:16:12.389 12:30:06 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:16:12.389 12:30:06 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:16:12.389 12:30:06 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:16:12.389 12:30:06 -- common/autotest_common.sh@1186 -- # nvme_devices=4 00:16:12.389 12:30:06 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:16:12.389 12:30:06 -- common/autotest_common.sh@1187 -- # return 0 00:16:12.389 12:30:06 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:12.389 [global] 00:16:12.389 thread=1 00:16:12.389 invalidate=1 00:16:12.389 rw=write 00:16:12.389 time_based=1 00:16:12.389 runtime=1 00:16:12.389 ioengine=libaio 00:16:12.389 direct=1 00:16:12.389 bs=4096 00:16:12.389 iodepth=1 00:16:12.389 norandommap=0 00:16:12.389 numjobs=1 00:16:12.389 00:16:12.389 verify_dump=1 00:16:12.389 verify_backlog=512 00:16:12.389 verify_state_save=0 00:16:12.389 do_verify=1 00:16:12.389 verify=crc32c-intel 00:16:12.389 [job0] 00:16:12.389 filename=/dev/nvme0n1 00:16:12.389 [job1] 00:16:12.389 filename=/dev/nvme0n2 00:16:12.389 [job2] 00:16:12.389 filename=/dev/nvme0n3 00:16:12.389 [job3] 00:16:12.389 filename=/dev/nvme0n4 00:16:12.648 Could not set queue depth (nvme0n1) 00:16:12.648 Could not set queue depth (nvme0n2) 00:16:12.648 Could not set queue depth (nvme0n3) 00:16:12.648 Could not set queue depth (nvme0n4) 00:16:12.648 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.648 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.648 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.648 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:12.648 fio-3.35 00:16:12.648 Starting 4 threads 00:16:14.026 00:16:14.026 job0: (groupid=0, jobs=1): err= 0: pid=1273835: Fri Jul 12 12:30:07 2024 00:16:14.026 read: IOPS=1462, BW=5850KiB/s (5991kB/s)(5856KiB/1001msec) 00:16:14.026 slat (nsec): min=5812, max=41655, avg=11691.45, stdev=5931.33 00:16:14.026 clat (usec): min=178, max=42007, avg=446.74, stdev=2634.40 00:16:14.026 lat (usec): min=185, max=42022, avg=458.43, stdev=2634.72 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 192], 5.00th=[ 202], 10.00th=[ 210], 20.00th=[ 221], 00:16:14.026 | 30.00th=[ 229], 40.00th=[ 237], 50.00th=[ 247], 60.00th=[ 260], 00:16:14.026 | 70.00th=[ 273], 80.00th=[ 302], 90.00th=[ 449], 95.00th=[ 482], 00:16:14.026 | 99.00th=[ 594], 99.50th=[ 865], 99.90th=[41681], 99.95th=[42206], 00:16:14.026 | 99.99th=[42206] 00:16:14.026 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:14.026 slat (nsec): min=7545, max=57608, avg=14686.77, stdev=6959.57 00:16:14.026 clat (usec): min=131, max=2410, avg=192.16, stdev=73.18 00:16:14.026 lat (usec): min=140, max=2421, avg=206.85, stdev=75.32 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 139], 5.00th=[ 145], 10.00th=[ 147], 20.00th=[ 153], 00:16:14.026 | 30.00th=[ 159], 40.00th=[ 172], 50.00th=[ 188], 60.00th=[ 198], 00:16:14.026 | 70.00th=[ 208], 80.00th=[ 225], 90.00th=[ 241], 95.00th=[ 260], 00:16:14.026 | 99.00th=[ 293], 99.50th=[ 330], 99.90th=[ 1037], 99.95th=[ 2409], 00:16:14.026 | 99.99th=[ 2409] 00:16:14.026 bw ( KiB/s): min= 8192, max= 8192, per=41.08%, avg=8192.00, stdev= 0.00, samples=1 00:16:14.026 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:14.026 lat (usec) : 250=73.67%, 500=24.93%, 750=1.03%, 1000=0.07% 00:16:14.026 lat (msec) : 2=0.07%, 4=0.03%, 50=0.20% 00:16:14.026 cpu : usr=3.30%, sys=5.00%, ctx=3002, majf=0, minf=2 00:16:14.026 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:14.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 issued rwts: total=1464,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:14.026 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:14.026 job1: (groupid=0, jobs=1): err= 0: pid=1273836: Fri Jul 12 12:30:07 2024 00:16:14.026 read: IOPS=1000, BW=4000KiB/s (4096kB/s)(4108KiB/1027msec) 00:16:14.026 slat (nsec): min=4528, max=50073, avg=10356.60, stdev=5214.31 00:16:14.026 clat (usec): min=179, max=41895, avg=685.95, stdev=4021.03 00:16:14.026 lat (usec): min=184, max=41910, avg=696.31, stdev=4021.41 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 188], 5.00th=[ 206], 10.00th=[ 219], 20.00th=[ 239], 00:16:14.026 | 30.00th=[ 249], 40.00th=[ 258], 50.00th=[ 269], 60.00th=[ 289], 00:16:14.026 | 70.00th=[ 314], 80.00th=[ 351], 90.00th=[ 383], 95.00th=[ 404], 00:16:14.026 | 99.00th=[ 603], 99.50th=[41157], 99.90th=[41681], 99.95th=[41681], 00:16:14.026 | 99.99th=[41681] 00:16:14.026 write: IOPS=1495, BW=5982KiB/s (6126kB/s)(6144KiB/1027msec); 0 zone resets 00:16:14.026 slat (nsec): min=6165, max=51704, avg=11046.83, stdev=5899.44 00:16:14.026 clat (usec): min=121, max=615, avg=187.27, stdev=54.29 00:16:14.026 lat (usec): min=128, max=623, avg=198.32, stdev=57.77 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 126], 5.00th=[ 131], 10.00th=[ 135], 20.00th=[ 141], 00:16:14.026 | 30.00th=[ 147], 40.00th=[ 153], 50.00th=[ 169], 60.00th=[ 198], 00:16:14.026 | 70.00th=[ 231], 80.00th=[ 235], 90.00th=[ 241], 95.00th=[ 251], 00:16:14.026 | 99.00th=[ 396], 99.50th=[ 445], 99.90th=[ 603], 99.95th=[ 619], 00:16:14.026 | 99.99th=[ 619] 00:16:14.026 bw ( KiB/s): min= 4096, max= 8192, per=30.81%, avg=6144.00, stdev=2896.31, samples=2 00:16:14.026 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:14.026 lat (usec) : 250=69.61%, 500=29.65%, 750=0.35% 00:16:14.026 lat (msec) : 50=0.39% 00:16:14.026 cpu : usr=0.97%, sys=3.22%, ctx=2564, majf=0, minf=1 00:16:14.026 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:14.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 issued rwts: total=1027,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:14.026 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:14.026 job2: (groupid=0, jobs=1): err= 0: pid=1273837: Fri Jul 12 12:30:07 2024 00:16:14.026 read: IOPS=492, BW=1970KiB/s (2018kB/s)(1996KiB/1013msec) 00:16:14.026 slat (nsec): min=4961, max=57270, avg=16667.26, stdev=8891.28 00:16:14.026 clat (usec): min=194, max=42035, avg=1739.45, stdev=7437.45 00:16:14.026 lat (usec): min=199, max=42048, avg=1756.12, stdev=7437.24 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 221], 5.00th=[ 249], 10.00th=[ 269], 20.00th=[ 285], 00:16:14.026 | 30.00th=[ 314], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 363], 00:16:14.026 | 70.00th=[ 379], 80.00th=[ 396], 90.00th=[ 433], 95.00th=[ 519], 00:16:14.026 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:14.026 | 99.99th=[42206] 00:16:14.026 write: IOPS=505, BW=2022KiB/s (2070kB/s)(2048KiB/1013msec); 0 zone resets 00:16:14.026 slat (nsec): min=7575, max=46537, avg=17720.55, stdev=5298.43 00:16:14.026 clat (usec): min=172, max=505, avg=239.78, stdev=31.14 00:16:14.026 lat (usec): min=192, max=526, avg=257.50, stdev=30.77 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 192], 5.00th=[ 206], 10.00th=[ 212], 20.00th=[ 219], 00:16:14.026 | 30.00th=[ 225], 40.00th=[ 229], 50.00th=[ 233], 60.00th=[ 239], 00:16:14.026 | 70.00th=[ 245], 80.00th=[ 255], 90.00th=[ 273], 95.00th=[ 297], 00:16:14.026 | 99.00th=[ 363], 99.50th=[ 383], 99.90th=[ 506], 99.95th=[ 506], 00:16:14.026 | 99.99th=[ 506] 00:16:14.026 bw ( KiB/s): min= 4096, max= 4096, per=20.54%, avg=4096.00, stdev= 0.00, samples=1 00:16:14.026 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:14.026 lat (usec) : 250=41.05%, 500=56.28%, 750=0.99% 00:16:14.026 lat (msec) : 50=1.68% 00:16:14.026 cpu : usr=0.79%, sys=1.88%, ctx=1012, majf=0, minf=1 00:16:14.026 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:14.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 issued rwts: total=499,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:14.026 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:14.026 job3: (groupid=0, jobs=1): err= 0: pid=1273838: Fri Jul 12 12:30:07 2024 00:16:14.026 read: IOPS=1009, BW=4039KiB/s (4136kB/s)(4116KiB/1019msec) 00:16:14.026 slat (nsec): min=4931, max=39837, avg=10750.49, stdev=7483.12 00:16:14.026 clat (usec): min=199, max=42021, avg=640.46, stdev=3792.30 00:16:14.026 lat (usec): min=210, max=42036, avg=651.21, stdev=3792.59 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 210], 5.00th=[ 219], 10.00th=[ 225], 20.00th=[ 235], 00:16:14.026 | 30.00th=[ 243], 40.00th=[ 249], 50.00th=[ 258], 60.00th=[ 269], 00:16:14.026 | 70.00th=[ 289], 80.00th=[ 334], 90.00th=[ 396], 95.00th=[ 474], 00:16:14.026 | 99.00th=[ 562], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:16:14.026 | 99.99th=[42206] 00:16:14.026 write: IOPS=1507, BW=6029KiB/s (6174kB/s)(6144KiB/1019msec); 0 zone resets 00:16:14.026 slat (usec): min=6, max=718, avg=15.23, stdev=19.22 00:16:14.026 clat (usec): min=139, max=575, avg=206.34, stdev=42.41 00:16:14.026 lat (usec): min=147, max=1014, avg=221.58, stdev=50.15 00:16:14.026 clat percentiles (usec): 00:16:14.026 | 1.00th=[ 149], 5.00th=[ 159], 10.00th=[ 165], 20.00th=[ 174], 00:16:14.026 | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 196], 60.00th=[ 206], 00:16:14.026 | 70.00th=[ 217], 80.00th=[ 233], 90.00th=[ 277], 95.00th=[ 289], 00:16:14.026 | 99.00th=[ 318], 99.50th=[ 347], 99.90th=[ 523], 99.95th=[ 578], 00:16:14.026 | 99.99th=[ 578] 00:16:14.026 bw ( KiB/s): min= 4096, max= 8192, per=30.81%, avg=6144.00, stdev=2896.31, samples=2 00:16:14.026 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:16:14.026 lat (usec) : 250=67.84%, 500=31.15%, 750=0.66% 00:16:14.026 lat (msec) : 50=0.35% 00:16:14.026 cpu : usr=1.77%, sys=3.24%, ctx=2568, majf=0, minf=1 00:16:14.026 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:14.026 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:14.026 issued rwts: total=1029,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:14.026 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:14.026 00:16:14.026 Run status group 0 (all jobs): 00:16:14.026 READ: bw=15.3MiB/s (16.0MB/s), 1970KiB/s-5850KiB/s (2018kB/s-5991kB/s), io=15.7MiB (16.5MB), run=1001-1027msec 00:16:14.026 WRITE: bw=19.5MiB/s (20.4MB/s), 2022KiB/s-6138KiB/s (2070kB/s-6285kB/s), io=20.0MiB (21.0MB), run=1001-1027msec 00:16:14.026 00:16:14.026 Disk stats (read/write): 00:16:14.026 nvme0n1: ios=1081/1536, merge=0/0, ticks=950/276, in_queue=1226, util=97.19% 00:16:14.026 nvme0n2: ios=1074/1174, merge=0/0, ticks=918/228, in_queue=1146, util=97.55% 00:16:14.026 nvme0n3: ios=535/512, merge=0/0, ticks=1013/120, in_queue=1133, util=97.37% 00:16:14.027 nvme0n4: ios=1088/1536, merge=0/0, ticks=658/312, in_queue=970, util=97.45% 00:16:14.027 12:30:07 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:14.027 [global] 00:16:14.027 thread=1 00:16:14.027 invalidate=1 00:16:14.027 rw=randwrite 00:16:14.027 time_based=1 00:16:14.027 runtime=1 00:16:14.027 ioengine=libaio 00:16:14.027 direct=1 00:16:14.027 bs=4096 00:16:14.027 iodepth=1 00:16:14.027 norandommap=0 00:16:14.027 numjobs=1 00:16:14.027 00:16:14.027 verify_dump=1 00:16:14.027 verify_backlog=512 00:16:14.027 verify_state_save=0 00:16:14.027 do_verify=1 00:16:14.027 verify=crc32c-intel 00:16:14.027 [job0] 00:16:14.027 filename=/dev/nvme0n1 00:16:14.027 [job1] 00:16:14.027 filename=/dev/nvme0n2 00:16:14.027 [job2] 00:16:14.027 filename=/dev/nvme0n3 00:16:14.027 [job3] 00:16:14.027 filename=/dev/nvme0n4 00:16:14.027 Could not set queue depth (nvme0n1) 00:16:14.027 Could not set queue depth (nvme0n2) 00:16:14.027 Could not set queue depth (nvme0n3) 00:16:14.027 Could not set queue depth (nvme0n4) 00:16:14.286 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.286 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.286 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.286 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:14.286 fio-3.35 00:16:14.286 Starting 4 threads 00:16:15.664 00:16:15.664 job0: (groupid=0, jobs=1): err= 0: pid=1274391: Fri Jul 12 12:30:09 2024 00:16:15.664 read: IOPS=1500, BW=6004KiB/s (6148kB/s)(6172KiB/1028msec) 00:16:15.664 slat (nsec): min=4518, max=66083, avg=9908.69, stdev=5142.59 00:16:15.664 clat (usec): min=176, max=41998, avg=432.85, stdev=2796.82 00:16:15.664 lat (usec): min=182, max=42012, avg=442.75, stdev=2797.07 00:16:15.664 clat percentiles (usec): 00:16:15.664 | 1.00th=[ 184], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 200], 00:16:15.664 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 221], 00:16:15.664 | 70.00th=[ 239], 80.00th=[ 297], 90.00th=[ 375], 95.00th=[ 383], 00:16:15.664 | 99.00th=[ 441], 99.50th=[ 486], 99.90th=[42206], 99.95th=[42206], 00:16:15.664 | 99.99th=[42206] 00:16:15.664 write: IOPS=1992, BW=7969KiB/s (8160kB/s)(8192KiB/1028msec); 0 zone resets 00:16:15.664 slat (nsec): min=6043, max=36209, avg=10906.21, stdev=4975.55 00:16:15.664 clat (usec): min=125, max=251, avg=152.37, stdev=15.29 00:16:15.664 lat (usec): min=132, max=283, avg=163.28, stdev=17.81 00:16:15.664 clat percentiles (usec): 00:16:15.664 | 1.00th=[ 129], 5.00th=[ 133], 10.00th=[ 135], 20.00th=[ 139], 00:16:15.664 | 30.00th=[ 143], 40.00th=[ 147], 50.00th=[ 151], 60.00th=[ 155], 00:16:15.664 | 70.00th=[ 159], 80.00th=[ 165], 90.00th=[ 174], 95.00th=[ 180], 00:16:15.664 | 99.00th=[ 192], 99.50th=[ 198], 99.90th=[ 235], 99.95th=[ 239], 00:16:15.664 | 99.99th=[ 251] 00:16:15.664 bw ( KiB/s): min= 4096, max=12288, per=35.42%, avg=8192.00, stdev=5792.62, samples=2 00:16:15.664 iops : min= 1024, max= 3072, avg=2048.00, stdev=1448.15, samples=2 00:16:15.664 lat (usec) : 250=87.91%, 500=11.89% 00:16:15.664 lat (msec) : 50=0.19% 00:16:15.664 cpu : usr=2.53%, sys=3.31%, ctx=3592, majf=0, minf=1 00:16:15.664 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.664 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.664 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.664 issued rwts: total=1543,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.664 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.664 job1: (groupid=0, jobs=1): err= 0: pid=1274402: Fri Jul 12 12:30:09 2024 00:16:15.664 read: IOPS=60, BW=240KiB/s (246kB/s)(244KiB/1015msec) 00:16:15.664 slat (nsec): min=7268, max=44585, avg=17016.44, stdev=5266.52 00:16:15.664 clat (usec): min=225, max=46000, avg=14575.23, stdev=19919.56 00:16:15.664 lat (usec): min=241, max=46017, avg=14592.25, stdev=19917.98 00:16:15.664 clat percentiles (usec): 00:16:15.664 | 1.00th=[ 225], 5.00th=[ 235], 10.00th=[ 241], 20.00th=[ 249], 00:16:15.664 | 30.00th=[ 255], 40.00th=[ 262], 50.00th=[ 285], 60.00th=[ 347], 00:16:15.664 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:15.664 | 99.00th=[45876], 99.50th=[45876], 99.90th=[45876], 99.95th=[45876], 00:16:15.664 | 99.99th=[45876] 00:16:15.664 write: IOPS=504, BW=2018KiB/s (2066kB/s)(2048KiB/1015msec); 0 zone resets 00:16:15.664 slat (nsec): min=7453, max=49550, avg=21108.62, stdev=5203.59 00:16:15.664 clat (usec): min=152, max=1109, avg=216.08, stdev=71.31 00:16:15.664 lat (usec): min=161, max=1118, avg=237.19, stdev=70.63 00:16:15.664 clat percentiles (usec): 00:16:15.664 | 1.00th=[ 174], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 192], 00:16:15.664 | 30.00th=[ 196], 40.00th=[ 198], 50.00th=[ 202], 60.00th=[ 208], 00:16:15.664 | 70.00th=[ 212], 80.00th=[ 221], 90.00th=[ 235], 95.00th=[ 277], 00:16:15.664 | 99.00th=[ 578], 99.50th=[ 758], 99.90th=[ 1106], 99.95th=[ 1106], 00:16:15.664 | 99.99th=[ 1106] 00:16:15.664 bw ( KiB/s): min= 4096, max= 4096, per=17.71%, avg=4096.00, stdev= 0.00, samples=1 00:16:15.664 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:15.664 lat (usec) : 250=84.99%, 500=10.12%, 750=0.70%, 1000=0.35% 00:16:15.664 lat (msec) : 2=0.17%, 50=3.66% 00:16:15.664 cpu : usr=0.79%, sys=1.48%, ctx=574, majf=0, minf=1 00:16:15.664 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.664 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.664 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.664 issued rwts: total=61,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.664 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.664 job2: (groupid=0, jobs=1): err= 0: pid=1274445: Fri Jul 12 12:30:09 2024 00:16:15.664 read: IOPS=807, BW=3230KiB/s (3307kB/s)(3288KiB/1018msec) 00:16:15.664 slat (nsec): min=5846, max=35981, avg=8304.06, stdev=3845.95 00:16:15.664 clat (usec): min=197, max=42021, avg=955.92, stdev=5341.01 00:16:15.664 lat (usec): min=204, max=42035, avg=964.23, stdev=5341.73 00:16:15.664 clat percentiles (usec): 00:16:15.664 | 1.00th=[ 212], 5.00th=[ 221], 10.00th=[ 225], 20.00th=[ 233], 00:16:15.664 | 30.00th=[ 239], 40.00th=[ 243], 50.00th=[ 247], 60.00th=[ 251], 00:16:15.664 | 70.00th=[ 255], 80.00th=[ 260], 90.00th=[ 269], 95.00th=[ 293], 00:16:15.664 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:15.664 | 99.99th=[42206] 00:16:15.664 write: IOPS=1005, BW=4024KiB/s (4120kB/s)(4096KiB/1018msec); 0 zone resets 00:16:15.664 slat (nsec): min=7261, max=52303, avg=15487.22, stdev=7655.28 00:16:15.664 clat (usec): min=142, max=741, avg=198.30, stdev=40.81 00:16:15.664 lat (usec): min=149, max=749, avg=213.79, stdev=44.86 00:16:15.664 clat percentiles (usec): 00:16:15.664 | 1.00th=[ 149], 5.00th=[ 155], 10.00th=[ 161], 20.00th=[ 169], 00:16:15.665 | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 196], 60.00th=[ 202], 00:16:15.665 | 70.00th=[ 210], 80.00th=[ 219], 90.00th=[ 233], 95.00th=[ 247], 00:16:15.665 | 99.00th=[ 310], 99.50th=[ 343], 99.90th=[ 635], 99.95th=[ 742], 00:16:15.665 | 99.99th=[ 742] 00:16:15.665 bw ( KiB/s): min= 4096, max= 4096, per=17.71%, avg=4096.00, stdev= 0.00, samples=2 00:16:15.665 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:15.665 lat (usec) : 250=79.90%, 500=19.01%, 750=0.27% 00:16:15.665 lat (msec) : 4=0.05%, 50=0.76% 00:16:15.665 cpu : usr=1.28%, sys=3.34%, ctx=1847, majf=0, minf=1 00:16:15.665 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.665 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.665 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.665 issued rwts: total=822,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.665 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.665 job3: (groupid=0, jobs=1): err= 0: pid=1274464: Fri Jul 12 12:30:09 2024 00:16:15.665 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:15.665 slat (nsec): min=5958, max=46035, avg=9513.63, stdev=4780.49 00:16:15.665 clat (usec): min=184, max=507, avg=244.94, stdev=32.96 00:16:15.665 lat (usec): min=191, max=514, avg=254.46, stdev=34.59 00:16:15.665 clat percentiles (usec): 00:16:15.665 | 1.00th=[ 198], 5.00th=[ 202], 10.00th=[ 206], 20.00th=[ 215], 00:16:15.665 | 30.00th=[ 227], 40.00th=[ 237], 50.00th=[ 243], 60.00th=[ 251], 00:16:15.665 | 70.00th=[ 260], 80.00th=[ 269], 90.00th=[ 281], 95.00th=[ 293], 00:16:15.665 | 99.00th=[ 359], 99.50th=[ 408], 99.90th=[ 441], 99.95th=[ 465], 00:16:15.665 | 99.99th=[ 506] 00:16:15.665 write: IOPS=2357, BW=9431KiB/s (9657kB/s)(9440KiB/1001msec); 0 zone resets 00:16:15.665 slat (nsec): min=7397, max=68194, avg=13248.20, stdev=6834.59 00:16:15.665 clat (usec): min=132, max=1507, avg=183.67, stdev=51.16 00:16:15.665 lat (usec): min=140, max=1515, avg=196.92, stdev=54.39 00:16:15.665 clat percentiles (usec): 00:16:15.665 | 1.00th=[ 139], 5.00th=[ 143], 10.00th=[ 145], 20.00th=[ 151], 00:16:15.665 | 30.00th=[ 157], 40.00th=[ 163], 50.00th=[ 174], 60.00th=[ 186], 00:16:15.665 | 70.00th=[ 200], 80.00th=[ 217], 90.00th=[ 237], 95.00th=[ 247], 00:16:15.665 | 99.00th=[ 269], 99.50th=[ 285], 99.90th=[ 783], 99.95th=[ 1172], 00:16:15.665 | 99.99th=[ 1516] 00:16:15.665 bw ( KiB/s): min= 8192, max= 8192, per=35.42%, avg=8192.00, stdev= 0.00, samples=1 00:16:15.665 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:15.665 lat (usec) : 250=78.18%, 500=21.73%, 750=0.02%, 1000=0.02% 00:16:15.665 lat (msec) : 2=0.05% 00:16:15.665 cpu : usr=3.30%, sys=7.30%, ctx=4409, majf=0, minf=2 00:16:15.665 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:15.665 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.665 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:15.665 issued rwts: total=2048,2360,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:15.665 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:15.665 00:16:15.665 Run status group 0 (all jobs): 00:16:15.665 READ: bw=17.0MiB/s (17.8MB/s), 240KiB/s-8184KiB/s (246kB/s-8380kB/s), io=17.5MiB (18.3MB), run=1001-1028msec 00:16:15.665 WRITE: bw=22.6MiB/s (23.7MB/s), 2018KiB/s-9431KiB/s (2066kB/s-9657kB/s), io=23.2MiB (24.3MB), run=1001-1028msec 00:16:15.665 00:16:15.665 Disk stats (read/write): 00:16:15.665 nvme0n1: ios=1577/2048, merge=0/0, ticks=1024/312, in_queue=1336, util=97.19% 00:16:15.665 nvme0n2: ios=78/512, merge=0/0, ticks=897/103, in_queue=1000, util=97.76% 00:16:15.665 nvme0n3: ios=817/1024, merge=0/0, ticks=568/193, in_queue=761, util=88.76% 00:16:15.665 nvme0n4: ios=1655/2048, merge=0/0, ticks=575/380, in_queue=955, util=97.14% 00:16:15.665 12:30:09 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:15.665 [global] 00:16:15.665 thread=1 00:16:15.665 invalidate=1 00:16:15.665 rw=write 00:16:15.665 time_based=1 00:16:15.665 runtime=1 00:16:15.665 ioengine=libaio 00:16:15.665 direct=1 00:16:15.665 bs=4096 00:16:15.665 iodepth=128 00:16:15.665 norandommap=0 00:16:15.665 numjobs=1 00:16:15.665 00:16:15.665 verify_dump=1 00:16:15.665 verify_backlog=512 00:16:15.665 verify_state_save=0 00:16:15.665 do_verify=1 00:16:15.665 verify=crc32c-intel 00:16:15.665 [job0] 00:16:15.665 filename=/dev/nvme0n1 00:16:15.665 [job1] 00:16:15.665 filename=/dev/nvme0n2 00:16:15.665 [job2] 00:16:15.665 filename=/dev/nvme0n3 00:16:15.665 [job3] 00:16:15.665 filename=/dev/nvme0n4 00:16:15.665 Could not set queue depth (nvme0n1) 00:16:15.665 Could not set queue depth (nvme0n2) 00:16:15.665 Could not set queue depth (nvme0n3) 00:16:15.665 Could not set queue depth (nvme0n4) 00:16:15.665 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.665 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.665 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.665 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:15.665 fio-3.35 00:16:15.665 Starting 4 threads 00:16:17.042 00:16:17.042 job0: (groupid=0, jobs=1): err= 0: pid=1274933: Fri Jul 12 12:30:10 2024 00:16:17.042 read: IOPS=3630, BW=14.2MiB/s (14.9MB/s)(14.3MiB/1005msec) 00:16:17.042 slat (usec): min=3, max=8981, avg=115.20, stdev=598.91 00:16:17.042 clat (usec): min=2807, max=36751, avg=15092.33, stdev=6924.61 00:16:17.042 lat (usec): min=6858, max=36756, avg=15207.53, stdev=6959.11 00:16:17.042 clat percentiles (usec): 00:16:17.042 | 1.00th=[ 7767], 5.00th=[ 8979], 10.00th=[ 9372], 20.00th=[10028], 00:16:17.042 | 30.00th=[10552], 40.00th=[10814], 50.00th=[10945], 60.00th=[11731], 00:16:17.042 | 70.00th=[19006], 80.00th=[20841], 90.00th=[26346], 95.00th=[29230], 00:16:17.042 | 99.00th=[34866], 99.50th=[35914], 99.90th=[36963], 99.95th=[36963], 00:16:17.042 | 99.99th=[36963] 00:16:17.042 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec); 0 zone resets 00:16:17.042 slat (usec): min=3, max=10593, avg=132.86, stdev=617.65 00:16:17.042 clat (usec): min=7003, max=60960, avg=17145.61, stdev=11855.68 00:16:17.042 lat (usec): min=8011, max=60971, avg=17278.47, stdev=11928.82 00:16:17.042 clat percentiles (usec): 00:16:17.042 | 1.00th=[ 8455], 5.00th=[ 9372], 10.00th=[10159], 20.00th=[10683], 00:16:17.042 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11863], 60.00th=[13829], 00:16:17.042 | 70.00th=[16057], 80.00th=[20841], 90.00th=[32375], 95.00th=[49546], 00:16:17.042 | 99.00th=[60556], 99.50th=[60556], 99.90th=[61080], 99.95th=[61080], 00:16:17.042 | 99.99th=[61080] 00:16:17.042 bw ( KiB/s): min=12288, max=19976, per=25.12%, avg=16132.00, stdev=5436.24, samples=2 00:16:17.042 iops : min= 3072, max= 4994, avg=4033.00, stdev=1359.06, samples=2 00:16:17.042 lat (msec) : 4=0.01%, 10=13.70%, 20=63.21%, 50=20.44%, 100=2.63% 00:16:17.042 cpu : usr=4.88%, sys=7.27%, ctx=480, majf=0, minf=1 00:16:17.042 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:17.042 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.042 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:17.042 issued rwts: total=3649,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.042 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:17.042 job1: (groupid=0, jobs=1): err= 0: pid=1274934: Fri Jul 12 12:30:10 2024 00:16:17.042 read: IOPS=3545, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1011msec) 00:16:17.042 slat (usec): min=2, max=20723, avg=140.92, stdev=942.72 00:16:17.042 clat (usec): min=4736, max=75386, avg=16514.05, stdev=7415.65 00:16:17.042 lat (usec): min=4740, max=75394, avg=16654.98, stdev=7520.15 00:16:17.042 clat percentiles (usec): 00:16:17.042 | 1.00th=[ 6718], 5.00th=[ 9372], 10.00th=[ 9634], 20.00th=[10290], 00:16:17.042 | 30.00th=[11207], 40.00th=[13173], 50.00th=[15533], 60.00th=[16450], 00:16:17.042 | 70.00th=[18744], 80.00th=[20579], 90.00th=[26608], 95.00th=[30016], 00:16:17.042 | 99.00th=[39584], 99.50th=[45351], 99.90th=[64750], 99.95th=[64750], 00:16:17.042 | 99.99th=[74974] 00:16:17.042 write: IOPS=3796, BW=14.8MiB/s (15.5MB/s)(15.0MiB/1011msec); 0 zone resets 00:16:17.042 slat (usec): min=3, max=5001, avg=122.17, stdev=573.41 00:16:17.042 clat (usec): min=2210, max=76213, avg=17892.14, stdev=11314.44 00:16:17.042 lat (usec): min=2215, max=76223, avg=18014.30, stdev=11367.37 00:16:17.042 clat percentiles (usec): 00:16:17.042 | 1.00th=[ 5538], 5.00th=[ 9765], 10.00th=[10028], 20.00th=[10421], 00:16:17.042 | 30.00th=[10683], 40.00th=[10945], 50.00th=[12780], 60.00th=[16909], 00:16:17.042 | 70.00th=[21103], 80.00th=[23462], 90.00th=[31065], 95.00th=[39060], 00:16:17.042 | 99.00th=[64750], 99.50th=[66323], 99.90th=[76022], 99.95th=[76022], 00:16:17.042 | 99.99th=[76022] 00:16:17.042 bw ( KiB/s): min=13304, max=16384, per=23.12%, avg=14844.00, stdev=2177.89, samples=2 00:16:17.042 iops : min= 3326, max= 4096, avg=3711.00, stdev=544.47, samples=2 00:16:17.042 lat (msec) : 4=0.19%, 10=11.88%, 20=58.34%, 50=27.78%, 100=1.81% 00:16:17.042 cpu : usr=4.06%, sys=4.46%, ctx=385, majf=0, minf=1 00:16:17.042 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:17.042 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.042 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:17.042 issued rwts: total=3584,3838,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.042 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:17.042 job2: (groupid=0, jobs=1): err= 0: pid=1274935: Fri Jul 12 12:30:10 2024 00:16:17.042 read: IOPS=3712, BW=14.5MiB/s (15.2MB/s)(14.6MiB/1010msec) 00:16:17.043 slat (usec): min=2, max=32584, avg=130.27, stdev=925.50 00:16:17.043 clat (usec): min=700, max=62901, avg=16691.92, stdev=8282.20 00:16:17.043 lat (usec): min=4895, max=62915, avg=16822.19, stdev=8330.43 00:16:17.043 clat percentiles (usec): 00:16:17.043 | 1.00th=[ 9765], 5.00th=[11338], 10.00th=[11863], 20.00th=[12387], 00:16:17.043 | 30.00th=[12780], 40.00th=[13698], 50.00th=[14353], 60.00th=[15270], 00:16:17.043 | 70.00th=[16909], 80.00th=[18220], 90.00th=[20317], 95.00th=[34341], 00:16:17.043 | 99.00th=[56361], 99.50th=[56361], 99.90th=[56361], 99.95th=[60556], 00:16:17.043 | 99.99th=[62653] 00:16:17.043 write: IOPS=4055, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1010msec); 0 zone resets 00:16:17.043 slat (usec): min=3, max=10906, avg=118.76, stdev=637.47 00:16:17.043 clat (usec): min=3314, max=32658, avg=15882.40, stdev=4545.45 00:16:17.043 lat (usec): min=3320, max=32676, avg=16001.15, stdev=4591.97 00:16:17.043 clat percentiles (usec): 00:16:17.043 | 1.00th=[ 6063], 5.00th=[10552], 10.00th=[11600], 20.00th=[12256], 00:16:17.043 | 30.00th=[12649], 40.00th=[14222], 50.00th=[14615], 60.00th=[15664], 00:16:17.043 | 70.00th=[17957], 80.00th=[19530], 90.00th=[21890], 95.00th=[25297], 00:16:17.043 | 99.00th=[27657], 99.50th=[27919], 99.90th=[29754], 99.95th=[32113], 00:16:17.043 | 99.99th=[32637] 00:16:17.043 bw ( KiB/s): min=16384, max=16384, per=25.51%, avg=16384.00, stdev= 0.00, samples=2 00:16:17.043 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:16:17.043 lat (usec) : 750=0.01% 00:16:17.043 lat (msec) : 4=0.20%, 10=1.87%, 20=83.86%, 50=12.96%, 100=1.08% 00:16:17.043 cpu : usr=4.66%, sys=6.44%, ctx=389, majf=0, minf=1 00:16:17.043 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:17.043 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.043 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:17.043 issued rwts: total=3750,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.043 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:17.043 job3: (groupid=0, jobs=1): err= 0: pid=1274936: Fri Jul 12 12:30:10 2024 00:16:17.043 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:16:17.043 slat (usec): min=2, max=16267, avg=100.60, stdev=686.92 00:16:17.043 clat (usec): min=4021, max=29218, avg=13991.51, stdev=3410.77 00:16:17.043 lat (usec): min=4026, max=29250, avg=14092.11, stdev=3450.69 00:16:17.043 clat percentiles (usec): 00:16:17.043 | 1.00th=[ 7308], 5.00th=[ 9634], 10.00th=[10552], 20.00th=[11731], 00:16:17.043 | 30.00th=[11863], 40.00th=[12256], 50.00th=[13042], 60.00th=[14484], 00:16:17.043 | 70.00th=[15270], 80.00th=[16188], 90.00th=[18482], 95.00th=[19530], 00:16:17.043 | 99.00th=[26346], 99.50th=[27132], 99.90th=[28443], 99.95th=[28443], 00:16:17.043 | 99.99th=[29230] 00:16:17.043 write: IOPS=4163, BW=16.3MiB/s (17.1MB/s)(16.4MiB/1009msec); 0 zone resets 00:16:17.043 slat (usec): min=3, max=12145, avg=123.59, stdev=642.59 00:16:17.043 clat (msec): min=2, max=104, avg=16.74, stdev=13.76 00:16:17.043 lat (msec): min=2, max=104, avg=16.87, stdev=13.83 00:16:17.043 clat percentiles (msec): 00:16:17.043 | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], 00:16:17.043 | 30.00th=[ 13], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 14], 00:16:17.043 | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 22], 95.00th=[ 28], 00:16:17.043 | 99.00th=[ 96], 99.50th=[ 104], 99.90th=[ 105], 99.95th=[ 105], 00:16:17.043 | 99.99th=[ 105] 00:16:17.043 bw ( KiB/s): min=16384, max=16432, per=25.55%, avg=16408.00, stdev=33.94, samples=2 00:16:17.043 iops : min= 4096, max= 4108, avg=4102.00, stdev= 8.49, samples=2 00:16:17.043 lat (msec) : 4=0.63%, 10=7.48%, 20=79.88%, 50=10.28%, 100=1.27% 00:16:17.043 lat (msec) : 250=0.46% 00:16:17.043 cpu : usr=3.97%, sys=4.56%, ctx=534, majf=0, minf=1 00:16:17.043 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:17.043 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:17.043 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:17.043 issued rwts: total=4096,4201,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:17.043 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:17.043 00:16:17.043 Run status group 0 (all jobs): 00:16:17.043 READ: bw=58.3MiB/s (61.1MB/s), 13.8MiB/s-15.9MiB/s (14.5MB/s-16.6MB/s), io=58.9MiB (61.8MB), run=1005-1011msec 00:16:17.043 WRITE: bw=62.7MiB/s (65.8MB/s), 14.8MiB/s-16.3MiB/s (15.5MB/s-17.1MB/s), io=63.4MiB (66.5MB), run=1005-1011msec 00:16:17.043 00:16:17.043 Disk stats (read/write): 00:16:17.043 nvme0n1: ios=3504/3584, merge=0/0, ticks=12494/13478, in_queue=25972, util=86.87% 00:16:17.043 nvme0n2: ios=3096/3111, merge=0/0, ticks=20006/19401, in_queue=39407, util=98.27% 00:16:17.043 nvme0n3: ios=3122/3399, merge=0/0, ticks=24944/26897, in_queue=51841, util=97.70% 00:16:17.043 nvme0n4: ios=3072/3579, merge=0/0, ticks=20177/34961, in_queue=55138, util=89.25% 00:16:17.043 12:30:10 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:17.043 [global] 00:16:17.043 thread=1 00:16:17.043 invalidate=1 00:16:17.043 rw=randwrite 00:16:17.043 time_based=1 00:16:17.043 runtime=1 00:16:17.043 ioengine=libaio 00:16:17.043 direct=1 00:16:17.043 bs=4096 00:16:17.043 iodepth=128 00:16:17.043 norandommap=0 00:16:17.043 numjobs=1 00:16:17.043 00:16:17.043 verify_dump=1 00:16:17.043 verify_backlog=512 00:16:17.043 verify_state_save=0 00:16:17.043 do_verify=1 00:16:17.043 verify=crc32c-intel 00:16:17.043 [job0] 00:16:17.043 filename=/dev/nvme0n1 00:16:17.043 [job1] 00:16:17.043 filename=/dev/nvme0n2 00:16:17.043 [job2] 00:16:17.043 filename=/dev/nvme0n3 00:16:17.043 [job3] 00:16:17.043 filename=/dev/nvme0n4 00:16:17.043 Could not set queue depth (nvme0n1) 00:16:17.043 Could not set queue depth (nvme0n2) 00:16:17.043 Could not set queue depth (nvme0n3) 00:16:17.043 Could not set queue depth (nvme0n4) 00:16:17.043 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.043 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.043 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.043 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:17.043 fio-3.35 00:16:17.043 Starting 4 threads 00:16:18.420 00:16:18.420 job0: (groupid=0, jobs=1): err= 0: pid=1275166: Fri Jul 12 12:30:12 2024 00:16:18.420 read: IOPS=5598, BW=21.9MiB/s (22.9MB/s)(22.0MiB/1006msec) 00:16:18.420 slat (usec): min=2, max=21250, avg=84.18, stdev=740.30 00:16:18.420 clat (usec): min=1281, max=47186, avg=11617.90, stdev=5225.18 00:16:18.420 lat (usec): min=1294, max=47197, avg=11702.08, stdev=5269.41 00:16:18.420 clat percentiles (usec): 00:16:18.420 | 1.00th=[ 1762], 5.00th=[ 5145], 10.00th=[ 7832], 20.00th=[ 8848], 00:16:18.420 | 30.00th=[ 9765], 40.00th=[10290], 50.00th=[10814], 60.00th=[11076], 00:16:18.420 | 70.00th=[11469], 80.00th=[13042], 90.00th=[16057], 95.00th=[20841], 00:16:18.420 | 99.00th=[35914], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:18.420 | 99.99th=[47449] 00:16:18.420 write: IOPS=5770, BW=22.5MiB/s (23.6MB/s)(22.7MiB/1006msec); 0 zone resets 00:16:18.420 slat (usec): min=3, max=15622, avg=72.39, stdev=567.42 00:16:18.420 clat (usec): min=3018, max=39674, avg=10650.29, stdev=3103.85 00:16:18.420 lat (usec): min=3022, max=39678, avg=10722.68, stdev=3146.90 00:16:18.420 clat percentiles (usec): 00:16:18.420 | 1.00th=[ 3752], 5.00th=[ 5473], 10.00th=[ 6456], 20.00th=[ 8029], 00:16:18.420 | 30.00th=[ 9503], 40.00th=[10159], 50.00th=[11338], 60.00th=[11731], 00:16:18.420 | 70.00th=[12125], 80.00th=[12649], 90.00th=[12911], 95.00th=[14746], 00:16:18.420 | 99.00th=[19530], 99.50th=[21365], 99.90th=[26870], 99.95th=[28181], 00:16:18.420 | 99.99th=[39584] 00:16:18.420 bw ( KiB/s): min=20480, max=24944, per=29.31%, avg=22712.00, stdev=3156.52, samples=2 00:16:18.420 iops : min= 5120, max= 6236, avg=5678.00, stdev=789.13, samples=2 00:16:18.420 lat (msec) : 2=0.71%, 4=1.24%, 10=33.89%, 20=60.55%, 50=3.61% 00:16:18.420 cpu : usr=4.28%, sys=6.47%, ctx=460, majf=0, minf=9 00:16:18.420 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:18.420 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.420 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.420 issued rwts: total=5632,5805,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.420 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.420 job1: (groupid=0, jobs=1): err= 0: pid=1275167: Fri Jul 12 12:30:12 2024 00:16:18.420 read: IOPS=4055, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1010msec) 00:16:18.420 slat (usec): min=2, max=15898, avg=125.55, stdev=870.40 00:16:18.420 clat (usec): min=4111, max=52771, avg=15145.15, stdev=7506.13 00:16:18.420 lat (usec): min=4116, max=52782, avg=15270.70, stdev=7570.36 00:16:18.420 clat percentiles (usec): 00:16:18.420 | 1.00th=[ 7373], 5.00th=[ 8455], 10.00th=[ 9372], 20.00th=[10552], 00:16:18.420 | 30.00th=[11076], 40.00th=[11469], 50.00th=[12256], 60.00th=[13173], 00:16:18.420 | 70.00th=[15926], 80.00th=[18482], 90.00th=[28181], 95.00th=[31065], 00:16:18.420 | 99.00th=[43254], 99.50th=[47973], 99.90th=[52691], 99.95th=[52691], 00:16:18.420 | 99.99th=[52691] 00:16:18.420 write: IOPS=4456, BW=17.4MiB/s (18.3MB/s)(17.6MiB/1010msec); 0 zone resets 00:16:18.420 slat (usec): min=4, max=13451, avg=99.54, stdev=578.86 00:16:18.421 clat (usec): min=1419, max=52770, avg=14674.94, stdev=8073.06 00:16:18.421 lat (usec): min=1431, max=52791, avg=14774.49, stdev=8123.13 00:16:18.421 clat percentiles (usec): 00:16:18.421 | 1.00th=[ 4293], 5.00th=[ 6521], 10.00th=[ 8291], 20.00th=[11207], 00:16:18.421 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12256], 60.00th=[12387], 00:16:18.421 | 70.00th=[12518], 80.00th=[18482], 90.00th=[24511], 95.00th=[34341], 00:16:18.421 | 99.00th=[45876], 99.50th=[49021], 99.90th=[49546], 99.95th=[49546], 00:16:18.421 | 99.99th=[52691] 00:16:18.421 bw ( KiB/s): min=13568, max=21424, per=22.58%, avg=17496.00, stdev=5555.03, samples=2 00:16:18.421 iops : min= 3392, max= 5356, avg=4374.00, stdev=1388.76, samples=2 00:16:18.421 lat (msec) : 2=0.05%, 4=0.33%, 10=14.66%, 20=68.66%, 50=16.23% 00:16:18.421 lat (msec) : 100=0.08% 00:16:18.421 cpu : usr=4.46%, sys=7.53%, ctx=511, majf=0, minf=17 00:16:18.421 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:16:18.421 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.421 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.421 issued rwts: total=4096,4501,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.421 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.421 job2: (groupid=0, jobs=1): err= 0: pid=1275170: Fri Jul 12 12:30:12 2024 00:16:18.421 read: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec) 00:16:18.421 slat (usec): min=3, max=6670, avg=101.29, stdev=618.82 00:16:18.421 clat (usec): min=8001, max=20410, avg=12954.99, stdev=1949.62 00:16:18.421 lat (usec): min=8030, max=20425, avg=13056.28, stdev=2006.68 00:16:18.421 clat percentiles (usec): 00:16:18.421 | 1.00th=[ 8979], 5.00th=[ 9634], 10.00th=[10421], 20.00th=[11731], 00:16:18.421 | 30.00th=[12256], 40.00th=[12649], 50.00th=[12911], 60.00th=[13042], 00:16:18.421 | 70.00th=[13435], 80.00th=[13960], 90.00th=[15795], 95.00th=[16909], 00:16:18.421 | 99.00th=[18220], 99.50th=[18744], 99.90th=[19268], 99.95th=[19792], 00:16:18.421 | 99.99th=[20317] 00:16:18.421 write: IOPS=5000, BW=19.5MiB/s (20.5MB/s)(19.7MiB/1006msec); 0 zone resets 00:16:18.421 slat (usec): min=4, max=6560, avg=97.15, stdev=480.80 00:16:18.421 clat (usec): min=5621, max=19979, avg=13470.18, stdev=1808.79 00:16:18.421 lat (usec): min=6185, max=19999, avg=13567.33, stdev=1808.79 00:16:18.421 clat percentiles (usec): 00:16:18.421 | 1.00th=[ 7701], 5.00th=[ 9765], 10.00th=[11338], 20.00th=[12911], 00:16:18.421 | 30.00th=[13042], 40.00th=[13435], 50.00th=[13698], 60.00th=[13960], 00:16:18.421 | 70.00th=[14091], 80.00th=[14353], 90.00th=[14746], 95.00th=[15795], 00:16:18.421 | 99.00th=[19006], 99.50th=[19268], 99.90th=[19792], 99.95th=[20055], 00:16:18.421 | 99.99th=[20055] 00:16:18.421 bw ( KiB/s): min=18952, max=20280, per=25.31%, avg=19616.00, stdev=939.04, samples=2 00:16:18.421 iops : min= 4738, max= 5070, avg=4904.00, stdev=234.76, samples=2 00:16:18.421 lat (msec) : 10=6.70%, 20=93.29%, 50=0.01% 00:16:18.421 cpu : usr=5.47%, sys=8.76%, ctx=523, majf=0, minf=15 00:16:18.421 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:18.421 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.421 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.421 issued rwts: total=4608,5031,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.421 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.421 job3: (groupid=0, jobs=1): err= 0: pid=1275171: Fri Jul 12 12:30:12 2024 00:16:18.421 read: IOPS=4083, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1003msec) 00:16:18.421 slat (usec): min=2, max=29332, avg=126.48, stdev=961.05 00:16:18.421 clat (usec): min=6650, max=74502, avg=15651.08, stdev=8896.87 00:16:18.421 lat (usec): min=6654, max=74505, avg=15777.56, stdev=8951.70 00:16:18.421 clat percentiles (usec): 00:16:18.421 | 1.00th=[ 6915], 5.00th=[ 8979], 10.00th=[10159], 20.00th=[12518], 00:16:18.421 | 30.00th=[12780], 40.00th=[13042], 50.00th=[13173], 60.00th=[13435], 00:16:18.421 | 70.00th=[14353], 80.00th=[16909], 90.00th=[19268], 95.00th=[33424], 00:16:18.421 | 99.00th=[60556], 99.50th=[74974], 99.90th=[74974], 99.95th=[74974], 00:16:18.421 | 99.99th=[74974] 00:16:18.421 write: IOPS=4216, BW=16.5MiB/s (17.3MB/s)(16.5MiB/1003msec); 0 zone resets 00:16:18.421 slat (usec): min=3, max=12476, avg=106.85, stdev=607.50 00:16:18.421 clat (usec): min=2188, max=50951, avg=14822.30, stdev=5247.82 00:16:18.421 lat (usec): min=2192, max=50982, avg=14929.15, stdev=5301.69 00:16:18.421 clat percentiles (usec): 00:16:18.421 | 1.00th=[ 7832], 5.00th=[ 9503], 10.00th=[11469], 20.00th=[12649], 00:16:18.421 | 30.00th=[13435], 40.00th=[13698], 50.00th=[13960], 60.00th=[14222], 00:16:18.421 | 70.00th=[14746], 80.00th=[15270], 90.00th=[16450], 95.00th=[23200], 00:16:18.421 | 99.00th=[39060], 99.50th=[39060], 99.90th=[44827], 99.95th=[44827], 00:16:18.421 | 99.99th=[51119] 00:16:18.421 bw ( KiB/s): min=12472, max=20464, per=21.25%, avg=16468.00, stdev=5651.20, samples=2 00:16:18.421 iops : min= 3118, max= 5116, avg=4117.00, stdev=1412.80, samples=2 00:16:18.421 lat (msec) : 4=0.04%, 10=7.41%, 20=85.36%, 50=6.16%, 100=1.03% 00:16:18.421 cpu : usr=3.59%, sys=5.89%, ctx=432, majf=0, minf=9 00:16:18.421 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:18.421 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:18.421 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:18.421 issued rwts: total=4096,4229,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:18.421 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:18.421 00:16:18.421 Run status group 0 (all jobs): 00:16:18.421 READ: bw=71.3MiB/s (74.7MB/s), 15.8MiB/s-21.9MiB/s (16.6MB/s-22.9MB/s), io=72.0MiB (75.5MB), run=1003-1010msec 00:16:18.421 WRITE: bw=75.7MiB/s (79.3MB/s), 16.5MiB/s-22.5MiB/s (17.3MB/s-23.6MB/s), io=76.4MiB (80.1MB), run=1003-1010msec 00:16:18.421 00:16:18.421 Disk stats (read/write): 00:16:18.421 nvme0n1: ios=4658/4813, merge=0/0, ticks=50227/47045, in_queue=97272, util=97.90% 00:16:18.421 nvme0n2: ios=3635/3911, merge=0/0, ticks=50889/53772, in_queue=104661, util=97.87% 00:16:18.421 nvme0n3: ios=3941/4096, merge=0/0, ticks=25214/25682, in_queue=50896, util=89.02% 00:16:18.421 nvme0n4: ios=3612/3728, merge=0/0, ticks=23742/24082, in_queue=47824, util=97.47% 00:16:18.421 12:30:12 -- target/fio.sh@55 -- # sync 00:16:18.421 12:30:12 -- target/fio.sh@59 -- # fio_pid=1275311 00:16:18.421 12:30:12 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:18.421 12:30:12 -- target/fio.sh@61 -- # sleep 3 00:16:18.421 [global] 00:16:18.421 thread=1 00:16:18.421 invalidate=1 00:16:18.421 rw=read 00:16:18.421 time_based=1 00:16:18.421 runtime=10 00:16:18.421 ioengine=libaio 00:16:18.421 direct=1 00:16:18.421 bs=4096 00:16:18.421 iodepth=1 00:16:18.421 norandommap=1 00:16:18.421 numjobs=1 00:16:18.421 00:16:18.421 [job0] 00:16:18.421 filename=/dev/nvme0n1 00:16:18.421 [job1] 00:16:18.421 filename=/dev/nvme0n2 00:16:18.421 [job2] 00:16:18.421 filename=/dev/nvme0n3 00:16:18.421 [job3] 00:16:18.421 filename=/dev/nvme0n4 00:16:18.421 Could not set queue depth (nvme0n1) 00:16:18.421 Could not set queue depth (nvme0n2) 00:16:18.421 Could not set queue depth (nvme0n3) 00:16:18.421 Could not set queue depth (nvme0n4) 00:16:18.421 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.421 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.421 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.421 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:18.421 fio-3.35 00:16:18.421 Starting 4 threads 00:16:21.699 12:30:15 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:21.699 12:30:15 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:21.699 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=10821632, buflen=4096 00:16:21.699 fio: pid=1275412, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:21.699 12:30:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:21.699 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=52240384, buflen=4096 00:16:21.699 fio: pid=1275411, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:21.699 12:30:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:21.956 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=27045888, buflen=4096 00:16:21.956 fio: pid=1275403, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:16:21.956 12:30:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:21.956 12:30:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:22.213 fio: io_u error on file /dev/nvme0n2: Input/output error: read offset=48320512, buflen=4096 00:16:22.213 fio: pid=1275405, err=5/file:io_u.c:1889, func=io_u error, error=Input/output error 00:16:22.213 12:30:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.213 12:30:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:22.471 00:16:22.471 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1275403: Fri Jul 12 12:30:16 2024 00:16:22.471 read: IOPS=1935, BW=7741KiB/s (7927kB/s)(25.8MiB/3412msec) 00:16:22.471 slat (usec): min=5, max=28690, avg=16.07, stdev=402.55 00:16:22.471 clat (usec): min=182, max=41201, avg=494.88, stdev=3102.29 00:16:22.471 lat (usec): min=188, max=41214, avg=510.94, stdev=3128.27 00:16:22.471 clat percentiles (usec): 00:16:22.471 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 217], 00:16:22.471 | 30.00th=[ 229], 40.00th=[ 241], 50.00th=[ 249], 60.00th=[ 262], 00:16:22.471 | 70.00th=[ 273], 80.00th=[ 285], 90.00th=[ 310], 95.00th=[ 326], 00:16:22.471 | 99.00th=[ 437], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:16:22.471 | 99.99th=[41157] 00:16:22.471 bw ( KiB/s): min= 96, max=15360, per=17.89%, avg=6597.33, stdev=6456.07, samples=6 00:16:22.471 iops : min= 24, max= 3840, avg=1649.33, stdev=1614.02, samples=6 00:16:22.471 lat (usec) : 250=51.27%, 500=47.94%, 750=0.09%, 1000=0.02% 00:16:22.471 lat (msec) : 2=0.05%, 10=0.03%, 50=0.59% 00:16:22.471 cpu : usr=0.91%, sys=3.11%, ctx=6609, majf=0, minf=1 00:16:22.471 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 issued rwts: total=6604,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.471 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.471 job1: (groupid=0, jobs=1): err= 5 (file:io_u.c:1889, func=io_u error, error=Input/output error): pid=1275405: Fri Jul 12 12:30:16 2024 00:16:22.471 read: IOPS=3219, BW=12.6MiB/s (13.2MB/s)(46.1MiB/3665msec) 00:16:22.471 slat (usec): min=5, max=14706, avg=13.16, stdev=192.70 00:16:22.471 clat (usec): min=186, max=42053, avg=294.88, stdev=1500.80 00:16:22.471 lat (usec): min=192, max=42066, avg=307.44, stdev=1511.85 00:16:22.471 clat percentiles (usec): 00:16:22.471 | 1.00th=[ 198], 5.00th=[ 206], 10.00th=[ 210], 20.00th=[ 219], 00:16:22.471 | 30.00th=[ 227], 40.00th=[ 233], 50.00th=[ 239], 60.00th=[ 245], 00:16:22.471 | 70.00th=[ 251], 80.00th=[ 258], 90.00th=[ 265], 95.00th=[ 277], 00:16:22.471 | 99.00th=[ 330], 99.50th=[ 351], 99.90th=[40633], 99.95th=[41157], 00:16:22.471 | 99.99th=[41157] 00:16:22.471 bw ( KiB/s): min= 3512, max=16376, per=35.67%, avg=13157.29, stdev=4485.89, samples=7 00:16:22.471 iops : min= 878, max= 4094, avg=3289.29, stdev=1121.48, samples=7 00:16:22.471 lat (usec) : 250=69.71%, 500=30.13%, 1000=0.01% 00:16:22.471 lat (msec) : 2=0.01%, 50=0.14% 00:16:22.471 cpu : usr=2.24%, sys=5.38%, ctx=11802, majf=0, minf=1 00:16:22.471 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 issued rwts: total=11798,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.471 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.471 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1275411: Fri Jul 12 12:30:16 2024 00:16:22.471 read: IOPS=4037, BW=15.8MiB/s (16.5MB/s)(49.8MiB/3159msec) 00:16:22.471 slat (usec): min=4, max=11243, avg=10.25, stdev=119.96 00:16:22.471 clat (usec): min=178, max=1089, avg=233.70, stdev=42.27 00:16:22.471 lat (usec): min=183, max=11656, avg=243.94, stdev=129.24 00:16:22.471 clat percentiles (usec): 00:16:22.471 | 1.00th=[ 194], 5.00th=[ 200], 10.00th=[ 204], 20.00th=[ 210], 00:16:22.471 | 30.00th=[ 215], 40.00th=[ 219], 50.00th=[ 221], 60.00th=[ 227], 00:16:22.471 | 70.00th=[ 233], 80.00th=[ 243], 90.00th=[ 277], 95.00th=[ 322], 00:16:22.471 | 99.00th=[ 383], 99.50th=[ 396], 99.90th=[ 502], 99.95th=[ 523], 00:16:22.471 | 99.99th=[ 922] 00:16:22.471 bw ( KiB/s): min=14520, max=17792, per=44.41%, avg=16380.00, stdev=1167.02, samples=6 00:16:22.471 iops : min= 3630, max= 4448, avg=4095.00, stdev=291.76, samples=6 00:16:22.471 lat (usec) : 250=83.47%, 500=16.42%, 750=0.06%, 1000=0.03% 00:16:22.471 lat (msec) : 2=0.01% 00:16:22.471 cpu : usr=1.58%, sys=4.18%, ctx=12758, majf=0, minf=1 00:16:22.471 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 issued rwts: total=12755,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.471 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.471 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=1275412: Fri Jul 12 12:30:16 2024 00:16:22.471 read: IOPS=908, BW=3633KiB/s (3720kB/s)(10.3MiB/2909msec) 00:16:22.471 slat (nsec): min=4739, max=52170, avg=8108.48, stdev=4303.92 00:16:22.471 clat (usec): min=192, max=41097, avg=1080.48, stdev=5709.52 00:16:22.471 lat (usec): min=201, max=41112, avg=1088.59, stdev=5710.59 00:16:22.471 clat percentiles (usec): 00:16:22.471 | 1.00th=[ 204], 5.00th=[ 210], 10.00th=[ 215], 20.00th=[ 221], 00:16:22.471 | 30.00th=[ 227], 40.00th=[ 235], 50.00th=[ 249], 60.00th=[ 269], 00:16:22.471 | 70.00th=[ 281], 80.00th=[ 289], 90.00th=[ 326], 95.00th=[ 388], 00:16:22.471 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:22.471 | 99.99th=[41157] 00:16:22.471 bw ( KiB/s): min= 96, max= 6168, per=4.97%, avg=1835.20, stdev=2671.46, samples=5 00:16:22.471 iops : min= 24, max= 1542, avg=458.80, stdev=667.87, samples=5 00:16:22.471 lat (usec) : 250=50.36%, 500=46.99%, 750=0.49%, 1000=0.04% 00:16:22.471 lat (msec) : 2=0.04%, 10=0.04%, 50=2.01% 00:16:22.471 cpu : usr=0.48%, sys=1.03%, ctx=2643, majf=0, minf=1 00:16:22.471 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:22.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:22.471 issued rwts: total=2643,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:22.471 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:22.471 00:16:22.471 Run status group 0 (all jobs): 00:16:22.471 READ: bw=36.0MiB/s (37.8MB/s), 3633KiB/s-15.8MiB/s (3720kB/s-16.5MB/s), io=132MiB (138MB), run=2909-3665msec 00:16:22.471 00:16:22.471 Disk stats (read/write): 00:16:22.471 nvme0n1: ios=6454/0, merge=0/0, ticks=4013/0, in_queue=4013, util=98.57% 00:16:22.471 nvme0n2: ios=11795/0, merge=0/0, ticks=3235/0, in_queue=3235, util=95.74% 00:16:22.471 nvme0n3: ios=12590/0, merge=0/0, ticks=2859/0, in_queue=2859, util=96.16% 00:16:22.471 nvme0n4: ios=2509/0, merge=0/0, ticks=2796/0, in_queue=2796, util=96.71% 00:16:22.471 12:30:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.471 12:30:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:22.729 12:30:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.729 12:30:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:22.986 12:30:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:22.986 12:30:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:23.243 12:30:17 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:23.243 12:30:17 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:23.526 12:30:17 -- target/fio.sh@69 -- # fio_status=0 00:16:23.526 12:30:17 -- target/fio.sh@70 -- # wait 1275311 00:16:23.526 12:30:17 -- target/fio.sh@70 -- # fio_status=4 00:16:23.526 12:30:17 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:23.787 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:23.787 12:30:17 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:23.787 12:30:17 -- common/autotest_common.sh@1198 -- # local i=0 00:16:23.787 12:30:17 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:16:23.787 12:30:17 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:23.787 12:30:17 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:16:23.787 12:30:17 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:23.787 12:30:17 -- common/autotest_common.sh@1210 -- # return 0 00:16:23.787 12:30:17 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:23.787 12:30:17 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:23.787 nvmf hotplug test: fio failed as expected 00:16:23.787 12:30:17 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:24.045 12:30:17 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:24.045 12:30:17 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:24.045 12:30:17 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:24.045 12:30:17 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:24.045 12:30:17 -- target/fio.sh@91 -- # nvmftestfini 00:16:24.045 12:30:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:24.045 12:30:17 -- nvmf/common.sh@116 -- # sync 00:16:24.045 12:30:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:24.045 12:30:17 -- nvmf/common.sh@119 -- # set +e 00:16:24.045 12:30:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:24.045 12:30:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:24.045 rmmod nvme_tcp 00:16:24.045 rmmod nvme_fabrics 00:16:24.045 rmmod nvme_keyring 00:16:24.045 12:30:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:24.045 12:30:17 -- nvmf/common.sh@123 -- # set -e 00:16:24.045 12:30:17 -- nvmf/common.sh@124 -- # return 0 00:16:24.045 12:30:17 -- nvmf/common.sh@477 -- # '[' -n 1272615 ']' 00:16:24.045 12:30:17 -- nvmf/common.sh@478 -- # killprocess 1272615 00:16:24.045 12:30:17 -- common/autotest_common.sh@926 -- # '[' -z 1272615 ']' 00:16:24.045 12:30:17 -- common/autotest_common.sh@930 -- # kill -0 1272615 00:16:24.045 12:30:17 -- common/autotest_common.sh@931 -- # uname 00:16:24.045 12:30:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:24.045 12:30:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1272615 00:16:24.045 12:30:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:16:24.045 12:30:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:16:24.045 12:30:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1272615' 00:16:24.045 killing process with pid 1272615 00:16:24.045 12:30:17 -- common/autotest_common.sh@945 -- # kill 1272615 00:16:24.045 12:30:17 -- common/autotest_common.sh@950 -- # wait 1272615 00:16:24.303 12:30:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:24.303 12:30:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:24.303 12:30:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:24.303 12:30:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:24.303 12:30:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:24.303 12:30:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:24.303 12:30:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:24.303 12:30:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.208 12:30:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:26.466 00:16:26.466 real 0m23.826s 00:16:26.466 user 1m22.895s 00:16:26.466 sys 0m7.556s 00:16:26.466 12:30:20 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:26.466 12:30:20 -- common/autotest_common.sh@10 -- # set +x 00:16:26.466 ************************************ 00:16:26.466 END TEST nvmf_fio_target 00:16:26.466 ************************************ 00:16:26.466 12:30:20 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:26.466 12:30:20 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:26.466 12:30:20 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:26.466 12:30:20 -- common/autotest_common.sh@10 -- # set +x 00:16:26.466 ************************************ 00:16:26.466 START TEST nvmf_bdevio 00:16:26.466 ************************************ 00:16:26.466 12:30:20 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:26.466 * Looking for test storage... 00:16:26.466 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:26.466 12:30:20 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:26.466 12:30:20 -- nvmf/common.sh@7 -- # uname -s 00:16:26.466 12:30:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:26.466 12:30:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:26.466 12:30:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:26.466 12:30:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:26.466 12:30:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:26.466 12:30:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:26.466 12:30:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:26.466 12:30:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:26.466 12:30:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:26.466 12:30:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:26.466 12:30:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.466 12:30:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:26.466 12:30:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:26.466 12:30:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:26.466 12:30:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:26.466 12:30:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:26.466 12:30:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:26.466 12:30:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:26.466 12:30:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:26.466 12:30:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.466 12:30:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.466 12:30:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.466 12:30:20 -- paths/export.sh@5 -- # export PATH 00:16:26.466 12:30:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:26.466 12:30:20 -- nvmf/common.sh@46 -- # : 0 00:16:26.466 12:30:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:26.466 12:30:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:26.466 12:30:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:26.466 12:30:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:26.466 12:30:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:26.466 12:30:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:26.466 12:30:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:26.466 12:30:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:26.466 12:30:20 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:26.466 12:30:20 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:26.466 12:30:20 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:26.466 12:30:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:26.466 12:30:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:26.467 12:30:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:26.467 12:30:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:26.467 12:30:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:26.467 12:30:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:26.467 12:30:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:26.467 12:30:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:26.467 12:30:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:26.467 12:30:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:26.467 12:30:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:26.467 12:30:20 -- common/autotest_common.sh@10 -- # set +x 00:16:28.417 12:30:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:28.417 12:30:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:28.417 12:30:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:28.417 12:30:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:28.417 12:30:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:28.417 12:30:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:28.417 12:30:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:28.417 12:30:22 -- nvmf/common.sh@294 -- # net_devs=() 00:16:28.418 12:30:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:28.418 12:30:22 -- nvmf/common.sh@295 -- # e810=() 00:16:28.418 12:30:22 -- nvmf/common.sh@295 -- # local -ga e810 00:16:28.418 12:30:22 -- nvmf/common.sh@296 -- # x722=() 00:16:28.418 12:30:22 -- nvmf/common.sh@296 -- # local -ga x722 00:16:28.418 12:30:22 -- nvmf/common.sh@297 -- # mlx=() 00:16:28.418 12:30:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:28.418 12:30:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:28.418 12:30:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:28.418 12:30:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:28.418 12:30:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:28.418 12:30:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:28.418 12:30:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:28.418 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:28.418 12:30:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:28.418 12:30:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:28.418 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:28.418 12:30:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:28.418 12:30:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:28.418 12:30:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:28.418 12:30:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:28.418 12:30:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:28.418 12:30:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:28.418 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:28.418 12:30:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:28.418 12:30:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:28.418 12:30:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:28.418 12:30:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:28.418 12:30:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:28.418 12:30:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:28.418 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:28.418 12:30:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:28.418 12:30:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:28.418 12:30:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:28.418 12:30:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:28.418 12:30:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:28.418 12:30:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:28.418 12:30:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:28.418 12:30:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:28.418 12:30:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:28.418 12:30:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:28.418 12:30:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:28.418 12:30:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:28.418 12:30:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:28.418 12:30:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:28.418 12:30:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:28.418 12:30:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:28.418 12:30:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:28.418 12:30:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:28.418 12:30:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:28.418 12:30:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:28.418 12:30:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:28.418 12:30:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:28.418 12:30:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:28.418 12:30:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:28.418 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:28.418 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.229 ms 00:16:28.418 00:16:28.418 --- 10.0.0.2 ping statistics --- 00:16:28.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:28.418 rtt min/avg/max/mdev = 0.229/0.229/0.229/0.000 ms 00:16:28.418 12:30:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:28.418 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:28.418 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:16:28.418 00:16:28.418 --- 10.0.0.1 ping statistics --- 00:16:28.418 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:28.418 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:16:28.418 12:30:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:28.418 12:30:22 -- nvmf/common.sh@410 -- # return 0 00:16:28.418 12:30:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:28.418 12:30:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:28.418 12:30:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:28.418 12:30:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:28.418 12:30:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:28.418 12:30:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:28.418 12:30:22 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:28.418 12:30:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:28.418 12:30:22 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:28.418 12:30:22 -- common/autotest_common.sh@10 -- # set +x 00:16:28.418 12:30:22 -- nvmf/common.sh@469 -- # nvmfpid=1278047 00:16:28.418 12:30:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:16:28.418 12:30:22 -- nvmf/common.sh@470 -- # waitforlisten 1278047 00:16:28.418 12:30:22 -- common/autotest_common.sh@819 -- # '[' -z 1278047 ']' 00:16:28.418 12:30:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.418 12:30:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:28.418 12:30:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.418 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.418 12:30:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:28.418 12:30:22 -- common/autotest_common.sh@10 -- # set +x 00:16:28.675 [2024-07-12 12:30:22.359264] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:28.676 [2024-07-12 12:30:22.359335] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:28.676 EAL: No free 2048 kB hugepages reported on node 1 00:16:28.676 [2024-07-12 12:30:22.431015] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:28.676 [2024-07-12 12:30:22.548058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:28.676 [2024-07-12 12:30:22.548227] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:28.676 [2024-07-12 12:30:22.548256] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:28.676 [2024-07-12 12:30:22.548271] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:28.676 [2024-07-12 12:30:22.548350] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:28.676 [2024-07-12 12:30:22.548409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:28.676 [2024-07-12 12:30:22.548462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:28.676 [2024-07-12 12:30:22.548465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:29.609 12:30:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:29.609 12:30:23 -- common/autotest_common.sh@852 -- # return 0 00:16:29.609 12:30:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:29.609 12:30:23 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:29.609 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:16:29.609 12:30:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:29.609 12:30:23 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:29.609 12:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.609 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:16:29.609 [2024-07-12 12:30:23.320288] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:29.609 12:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.609 12:30:23 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:29.609 12:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.609 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:16:29.609 Malloc0 00:16:29.609 12:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.609 12:30:23 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:29.609 12:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.609 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:16:29.609 12:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.609 12:30:23 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:29.609 12:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.609 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:16:29.609 12:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.609 12:30:23 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:29.609 12:30:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:29.609 12:30:23 -- common/autotest_common.sh@10 -- # set +x 00:16:29.609 [2024-07-12 12:30:23.374288] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:29.609 12:30:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:29.609 12:30:23 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:16:29.609 12:30:23 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:29.609 12:30:23 -- nvmf/common.sh@520 -- # config=() 00:16:29.609 12:30:23 -- nvmf/common.sh@520 -- # local subsystem config 00:16:29.609 12:30:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:29.609 12:30:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:29.609 { 00:16:29.609 "params": { 00:16:29.609 "name": "Nvme$subsystem", 00:16:29.609 "trtype": "$TEST_TRANSPORT", 00:16:29.609 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:29.609 "adrfam": "ipv4", 00:16:29.609 "trsvcid": "$NVMF_PORT", 00:16:29.609 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:29.609 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:29.609 "hdgst": ${hdgst:-false}, 00:16:29.609 "ddgst": ${ddgst:-false} 00:16:29.609 }, 00:16:29.609 "method": "bdev_nvme_attach_controller" 00:16:29.609 } 00:16:29.609 EOF 00:16:29.609 )") 00:16:29.609 12:30:23 -- nvmf/common.sh@542 -- # cat 00:16:29.609 12:30:23 -- nvmf/common.sh@544 -- # jq . 00:16:29.609 12:30:23 -- nvmf/common.sh@545 -- # IFS=, 00:16:29.609 12:30:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:29.609 "params": { 00:16:29.609 "name": "Nvme1", 00:16:29.609 "trtype": "tcp", 00:16:29.609 "traddr": "10.0.0.2", 00:16:29.609 "adrfam": "ipv4", 00:16:29.609 "trsvcid": "4420", 00:16:29.609 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:29.609 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:29.609 "hdgst": false, 00:16:29.609 "ddgst": false 00:16:29.609 }, 00:16:29.609 "method": "bdev_nvme_attach_controller" 00:16:29.609 }' 00:16:29.609 [2024-07-12 12:30:23.416823] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:29.610 [2024-07-12 12:30:23.416902] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1278210 ] 00:16:29.610 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.610 [2024-07-12 12:30:23.480290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:29.867 [2024-07-12 12:30:23.592193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:29.867 [2024-07-12 12:30:23.592244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:29.867 [2024-07-12 12:30:23.592248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:30.125 [2024-07-12 12:30:23.815671] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:30.125 [2024-07-12 12:30:23.815722] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:30.125 I/O targets: 00:16:30.125 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:30.125 00:16:30.125 00:16:30.125 CUnit - A unit testing framework for C - Version 2.1-3 00:16:30.125 http://cunit.sourceforge.net/ 00:16:30.125 00:16:30.125 00:16:30.125 Suite: bdevio tests on: Nvme1n1 00:16:30.125 Test: blockdev write read block ...passed 00:16:30.125 Test: blockdev write zeroes read block ...passed 00:16:30.125 Test: blockdev write zeroes read no split ...passed 00:16:30.125 Test: blockdev write zeroes read split ...passed 00:16:30.125 Test: blockdev write zeroes read split partial ...passed 00:16:30.125 Test: blockdev reset ...[2024-07-12 12:30:23.971250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:30.125 [2024-07-12 12:30:23.971350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x170a180 (9): Bad file descriptor 00:16:30.125 [2024-07-12 12:30:23.986156] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:30.125 passed 00:16:30.125 Test: blockdev write read 8 blocks ...passed 00:16:30.125 Test: blockdev write read size > 128k ...passed 00:16:30.125 Test: blockdev write read invalid size ...passed 00:16:30.125 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:30.125 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:30.125 Test: blockdev write read max offset ...passed 00:16:30.382 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:30.382 Test: blockdev writev readv 8 blocks ...passed 00:16:30.382 Test: blockdev writev readv 30 x 1block ...passed 00:16:30.382 Test: blockdev writev readv block ...passed 00:16:30.382 Test: blockdev writev readv size > 128k ...passed 00:16:30.382 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:30.382 Test: blockdev comparev and writev ...[2024-07-12 12:30:24.157016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.157051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.157082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.157101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.157444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.157468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.157490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.157506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.157832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.157855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.157886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.157904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.158225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.158249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.158270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:30.382 [2024-07-12 12:30:24.158286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:30.382 passed 00:16:30.382 Test: blockdev nvme passthru rw ...passed 00:16:30.382 Test: blockdev nvme passthru vendor specific ...[2024-07-12 12:30:24.240121] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:30.382 [2024-07-12 12:30:24.240149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.240299] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:30.382 [2024-07-12 12:30:24.240322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.240463] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:30.382 [2024-07-12 12:30:24.240486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:30.382 [2024-07-12 12:30:24.240627] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:30.382 [2024-07-12 12:30:24.240650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:30.382 passed 00:16:30.383 Test: blockdev nvme admin passthru ...passed 00:16:30.383 Test: blockdev copy ...passed 00:16:30.383 00:16:30.383 Run Summary: Type Total Ran Passed Failed Inactive 00:16:30.383 suites 1 1 n/a 0 0 00:16:30.383 tests 23 23 23 0 0 00:16:30.383 asserts 152 152 152 0 n/a 00:16:30.383 00:16:30.383 Elapsed time = 0.954 seconds 00:16:30.640 12:30:24 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:30.640 12:30:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:30.641 12:30:24 -- common/autotest_common.sh@10 -- # set +x 00:16:30.641 12:30:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:30.641 12:30:24 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:30.641 12:30:24 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:30.641 12:30:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:30.641 12:30:24 -- nvmf/common.sh@116 -- # sync 00:16:30.641 12:30:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:30.641 12:30:24 -- nvmf/common.sh@119 -- # set +e 00:16:30.641 12:30:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:30.641 12:30:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:30.641 rmmod nvme_tcp 00:16:30.641 rmmod nvme_fabrics 00:16:30.901 rmmod nvme_keyring 00:16:30.901 12:30:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:30.901 12:30:24 -- nvmf/common.sh@123 -- # set -e 00:16:30.901 12:30:24 -- nvmf/common.sh@124 -- # return 0 00:16:30.901 12:30:24 -- nvmf/common.sh@477 -- # '[' -n 1278047 ']' 00:16:30.901 12:30:24 -- nvmf/common.sh@478 -- # killprocess 1278047 00:16:30.901 12:30:24 -- common/autotest_common.sh@926 -- # '[' -z 1278047 ']' 00:16:30.901 12:30:24 -- common/autotest_common.sh@930 -- # kill -0 1278047 00:16:30.901 12:30:24 -- common/autotest_common.sh@931 -- # uname 00:16:30.901 12:30:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:30.901 12:30:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1278047 00:16:30.901 12:30:24 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:16:30.901 12:30:24 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:16:30.901 12:30:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1278047' 00:16:30.901 killing process with pid 1278047 00:16:30.901 12:30:24 -- common/autotest_common.sh@945 -- # kill 1278047 00:16:30.901 12:30:24 -- common/autotest_common.sh@950 -- # wait 1278047 00:16:31.160 12:30:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:31.160 12:30:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:31.160 12:30:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:31.160 12:30:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:31.160 12:30:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:31.160 12:30:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:31.160 12:30:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:31.160 12:30:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:33.065 12:30:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:33.065 00:16:33.065 real 0m6.808s 00:16:33.065 user 0m12.249s 00:16:33.065 sys 0m2.014s 00:16:33.065 12:30:26 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:33.065 12:30:26 -- common/autotest_common.sh@10 -- # set +x 00:16:33.065 ************************************ 00:16:33.065 END TEST nvmf_bdevio 00:16:33.065 ************************************ 00:16:33.345 12:30:26 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:16:33.345 12:30:26 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:33.345 12:30:26 -- common/autotest_common.sh@1077 -- # '[' 4 -le 1 ']' 00:16:33.345 12:30:26 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:33.345 12:30:26 -- common/autotest_common.sh@10 -- # set +x 00:16:33.345 ************************************ 00:16:33.345 START TEST nvmf_bdevio_no_huge 00:16:33.345 ************************************ 00:16:33.345 12:30:26 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:16:33.345 * Looking for test storage... 00:16:33.345 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:33.345 12:30:27 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:33.345 12:30:27 -- nvmf/common.sh@7 -- # uname -s 00:16:33.345 12:30:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:33.345 12:30:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:33.345 12:30:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:33.345 12:30:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:33.345 12:30:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:33.345 12:30:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:33.345 12:30:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:33.345 12:30:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:33.345 12:30:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:33.345 12:30:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:33.345 12:30:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:33.345 12:30:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:33.345 12:30:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:33.345 12:30:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:33.345 12:30:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:33.345 12:30:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:33.345 12:30:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:33.345 12:30:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:33.345 12:30:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:33.345 12:30:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.345 12:30:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.346 12:30:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.346 12:30:27 -- paths/export.sh@5 -- # export PATH 00:16:33.346 12:30:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:33.346 12:30:27 -- nvmf/common.sh@46 -- # : 0 00:16:33.346 12:30:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:33.346 12:30:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:33.346 12:30:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:33.346 12:30:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:33.346 12:30:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:33.346 12:30:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:33.346 12:30:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:33.346 12:30:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:33.346 12:30:27 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:33.346 12:30:27 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:33.346 12:30:27 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:33.346 12:30:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:33.346 12:30:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:33.346 12:30:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:33.346 12:30:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:33.346 12:30:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:33.346 12:30:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:33.346 12:30:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:33.346 12:30:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:33.346 12:30:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:33.346 12:30:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:33.346 12:30:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:33.346 12:30:27 -- common/autotest_common.sh@10 -- # set +x 00:16:35.250 12:30:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:35.250 12:30:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:35.250 12:30:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:35.250 12:30:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:35.250 12:30:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:35.250 12:30:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:35.250 12:30:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:35.250 12:30:28 -- nvmf/common.sh@294 -- # net_devs=() 00:16:35.250 12:30:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:35.250 12:30:28 -- nvmf/common.sh@295 -- # e810=() 00:16:35.250 12:30:28 -- nvmf/common.sh@295 -- # local -ga e810 00:16:35.250 12:30:28 -- nvmf/common.sh@296 -- # x722=() 00:16:35.250 12:30:28 -- nvmf/common.sh@296 -- # local -ga x722 00:16:35.250 12:30:28 -- nvmf/common.sh@297 -- # mlx=() 00:16:35.250 12:30:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:35.250 12:30:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:35.250 12:30:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:35.250 12:30:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:35.250 12:30:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:35.250 12:30:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:35.250 12:30:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:35.250 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:35.250 12:30:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:35.250 12:30:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:35.250 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:35.250 12:30:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:35.250 12:30:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:35.250 12:30:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:35.250 12:30:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:35.250 12:30:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:35.250 12:30:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:35.250 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:35.250 12:30:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:35.250 12:30:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:35.250 12:30:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:35.250 12:30:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:35.250 12:30:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:35.250 12:30:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:35.250 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:35.250 12:30:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:35.250 12:30:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:35.250 12:30:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:35.250 12:30:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:35.250 12:30:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:35.250 12:30:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:35.250 12:30:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:35.250 12:30:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:35.250 12:30:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:35.250 12:30:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:35.250 12:30:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:35.250 12:30:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:35.250 12:30:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:35.250 12:30:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:35.250 12:30:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:35.250 12:30:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:35.250 12:30:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:35.250 12:30:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:35.250 12:30:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:35.250 12:30:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:35.250 12:30:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:35.250 12:30:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:35.250 12:30:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:35.250 12:30:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:35.250 12:30:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:35.250 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:35.250 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:16:35.250 00:16:35.250 --- 10.0.0.2 ping statistics --- 00:16:35.250 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:35.250 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:16:35.250 12:30:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:35.250 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:35.250 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:16:35.250 00:16:35.250 --- 10.0.0.1 ping statistics --- 00:16:35.250 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:35.250 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:16:35.250 12:30:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:35.250 12:30:29 -- nvmf/common.sh@410 -- # return 0 00:16:35.250 12:30:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:35.250 12:30:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:35.250 12:30:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:35.250 12:30:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:35.250 12:30:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:35.250 12:30:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:35.250 12:30:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:35.250 12:30:29 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:16:35.250 12:30:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:35.250 12:30:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:35.250 12:30:29 -- common/autotest_common.sh@10 -- # set +x 00:16:35.251 12:30:29 -- nvmf/common.sh@469 -- # nvmfpid=1280296 00:16:35.251 12:30:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:16:35.251 12:30:29 -- nvmf/common.sh@470 -- # waitforlisten 1280296 00:16:35.251 12:30:29 -- common/autotest_common.sh@819 -- # '[' -z 1280296 ']' 00:16:35.251 12:30:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:35.251 12:30:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:35.251 12:30:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:35.251 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:35.251 12:30:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:35.251 12:30:29 -- common/autotest_common.sh@10 -- # set +x 00:16:35.251 [2024-07-12 12:30:29.132663] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:35.251 [2024-07-12 12:30:29.132746] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:16:35.509 [2024-07-12 12:30:29.205279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:35.509 [2024-07-12 12:30:29.324863] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:35.509 [2024-07-12 12:30:29.325034] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:35.509 [2024-07-12 12:30:29.325054] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:35.509 [2024-07-12 12:30:29.325069] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:35.509 [2024-07-12 12:30:29.325164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:35.509 [2024-07-12 12:30:29.325220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:35.509 [2024-07-12 12:30:29.325269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:35.509 [2024-07-12 12:30:29.325272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:36.444 12:30:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:36.444 12:30:30 -- common/autotest_common.sh@852 -- # return 0 00:16:36.444 12:30:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:36.444 12:30:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:36.444 12:30:30 -- common/autotest_common.sh@10 -- # set +x 00:16:36.444 12:30:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:36.444 12:30:30 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:36.444 12:30:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:36.444 12:30:30 -- common/autotest_common.sh@10 -- # set +x 00:16:36.444 [2024-07-12 12:30:30.135361] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:36.445 12:30:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:36.445 12:30:30 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:36.445 12:30:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:36.445 12:30:30 -- common/autotest_common.sh@10 -- # set +x 00:16:36.445 Malloc0 00:16:36.445 12:30:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:36.445 12:30:30 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:36.445 12:30:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:36.445 12:30:30 -- common/autotest_common.sh@10 -- # set +x 00:16:36.445 12:30:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:36.445 12:30:30 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:36.445 12:30:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:36.445 12:30:30 -- common/autotest_common.sh@10 -- # set +x 00:16:36.445 12:30:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:36.445 12:30:30 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:36.445 12:30:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:36.445 12:30:30 -- common/autotest_common.sh@10 -- # set +x 00:16:36.445 [2024-07-12 12:30:30.173105] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:36.445 12:30:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:36.445 12:30:30 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:16:36.445 12:30:30 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:16:36.445 12:30:30 -- nvmf/common.sh@520 -- # config=() 00:16:36.445 12:30:30 -- nvmf/common.sh@520 -- # local subsystem config 00:16:36.445 12:30:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:36.445 12:30:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:36.445 { 00:16:36.445 "params": { 00:16:36.445 "name": "Nvme$subsystem", 00:16:36.445 "trtype": "$TEST_TRANSPORT", 00:16:36.445 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:36.445 "adrfam": "ipv4", 00:16:36.445 "trsvcid": "$NVMF_PORT", 00:16:36.445 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:36.445 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:36.445 "hdgst": ${hdgst:-false}, 00:16:36.445 "ddgst": ${ddgst:-false} 00:16:36.445 }, 00:16:36.445 "method": "bdev_nvme_attach_controller" 00:16:36.445 } 00:16:36.445 EOF 00:16:36.445 )") 00:16:36.445 12:30:30 -- nvmf/common.sh@542 -- # cat 00:16:36.445 12:30:30 -- nvmf/common.sh@544 -- # jq . 00:16:36.445 12:30:30 -- nvmf/common.sh@545 -- # IFS=, 00:16:36.445 12:30:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:36.445 "params": { 00:16:36.445 "name": "Nvme1", 00:16:36.445 "trtype": "tcp", 00:16:36.445 "traddr": "10.0.0.2", 00:16:36.445 "adrfam": "ipv4", 00:16:36.445 "trsvcid": "4420", 00:16:36.445 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:36.445 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:36.445 "hdgst": false, 00:16:36.445 "ddgst": false 00:16:36.445 }, 00:16:36.445 "method": "bdev_nvme_attach_controller" 00:16:36.445 }' 00:16:36.445 [2024-07-12 12:30:30.211953] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:36.445 [2024-07-12 12:30:30.212029] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1280457 ] 00:16:36.445 [2024-07-12 12:30:30.275838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:36.703 [2024-07-12 12:30:30.385776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:36.703 [2024-07-12 12:30:30.385828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:36.703 [2024-07-12 12:30:30.385831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:36.703 [2024-07-12 12:30:30.537191] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:16:36.703 [2024-07-12 12:30:30.537240] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:16:36.703 I/O targets: 00:16:36.703 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:16:36.703 00:16:36.703 00:16:36.703 CUnit - A unit testing framework for C - Version 2.1-3 00:16:36.704 http://cunit.sourceforge.net/ 00:16:36.704 00:16:36.704 00:16:36.704 Suite: bdevio tests on: Nvme1n1 00:16:36.704 Test: blockdev write read block ...passed 00:16:36.963 Test: blockdev write zeroes read block ...passed 00:16:36.963 Test: blockdev write zeroes read no split ...passed 00:16:36.963 Test: blockdev write zeroes read split ...passed 00:16:36.963 Test: blockdev write zeroes read split partial ...passed 00:16:36.963 Test: blockdev reset ...[2024-07-12 12:30:30.741298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:16:36.963 [2024-07-12 12:30:30.741404] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214db00 (9): Bad file descriptor 00:16:36.963 [2024-07-12 12:30:30.757651] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:36.963 passed 00:16:36.963 Test: blockdev write read 8 blocks ...passed 00:16:36.963 Test: blockdev write read size > 128k ...passed 00:16:36.963 Test: blockdev write read invalid size ...passed 00:16:36.963 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:16:36.963 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:16:36.963 Test: blockdev write read max offset ...passed 00:16:37.223 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:16:37.223 Test: blockdev writev readv 8 blocks ...passed 00:16:37.223 Test: blockdev writev readv 30 x 1block ...passed 00:16:37.223 Test: blockdev writev readv block ...passed 00:16:37.223 Test: blockdev writev readv size > 128k ...passed 00:16:37.223 Test: blockdev writev readv size > 128k in two iovs ...passed 00:16:37.223 Test: blockdev comparev and writev ...[2024-07-12 12:30:31.014384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.014420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.014444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.014461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.014771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.014804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.014827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.014843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.015158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.015183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.015204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.015220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.015522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.015545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.015566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:16:37.223 [2024-07-12 12:30:31.015580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:16:37.223 passed 00:16:37.223 Test: blockdev nvme passthru rw ...passed 00:16:37.223 Test: blockdev nvme passthru vendor specific ...[2024-07-12 12:30:31.098129] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:37.223 [2024-07-12 12:30:31.098156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.098299] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:37.223 [2024-07-12 12:30:31.098322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.098461] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:37.223 [2024-07-12 12:30:31.098485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:16:37.223 [2024-07-12 12:30:31.098621] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:16:37.223 [2024-07-12 12:30:31.098644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:16:37.223 passed 00:16:37.223 Test: blockdev nvme admin passthru ...passed 00:16:37.483 Test: blockdev copy ...passed 00:16:37.483 00:16:37.483 Run Summary: Type Total Ran Passed Failed Inactive 00:16:37.483 suites 1 1 n/a 0 0 00:16:37.483 tests 23 23 23 0 0 00:16:37.483 asserts 152 152 152 0 n/a 00:16:37.483 00:16:37.483 Elapsed time = 1.231 seconds 00:16:37.742 12:30:31 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:37.742 12:30:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:16:37.742 12:30:31 -- common/autotest_common.sh@10 -- # set +x 00:16:37.742 12:30:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:16:37.742 12:30:31 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:16:37.742 12:30:31 -- target/bdevio.sh@30 -- # nvmftestfini 00:16:37.742 12:30:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:37.742 12:30:31 -- nvmf/common.sh@116 -- # sync 00:16:37.742 12:30:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:37.742 12:30:31 -- nvmf/common.sh@119 -- # set +e 00:16:37.742 12:30:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:37.742 12:30:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:37.742 rmmod nvme_tcp 00:16:37.742 rmmod nvme_fabrics 00:16:37.742 rmmod nvme_keyring 00:16:37.742 12:30:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:37.742 12:30:31 -- nvmf/common.sh@123 -- # set -e 00:16:37.742 12:30:31 -- nvmf/common.sh@124 -- # return 0 00:16:37.742 12:30:31 -- nvmf/common.sh@477 -- # '[' -n 1280296 ']' 00:16:37.742 12:30:31 -- nvmf/common.sh@478 -- # killprocess 1280296 00:16:37.742 12:30:31 -- common/autotest_common.sh@926 -- # '[' -z 1280296 ']' 00:16:37.742 12:30:31 -- common/autotest_common.sh@930 -- # kill -0 1280296 00:16:37.742 12:30:31 -- common/autotest_common.sh@931 -- # uname 00:16:37.742 12:30:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:16:37.742 12:30:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1280296 00:16:37.742 12:30:31 -- common/autotest_common.sh@932 -- # process_name=reactor_3 00:16:37.742 12:30:31 -- common/autotest_common.sh@936 -- # '[' reactor_3 = sudo ']' 00:16:37.742 12:30:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1280296' 00:16:37.742 killing process with pid 1280296 00:16:37.742 12:30:31 -- common/autotest_common.sh@945 -- # kill 1280296 00:16:37.742 12:30:31 -- common/autotest_common.sh@950 -- # wait 1280296 00:16:38.309 12:30:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:38.309 12:30:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:38.309 12:30:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:38.309 12:30:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:38.309 12:30:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:38.309 12:30:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.309 12:30:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.309 12:30:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:40.207 12:30:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:40.207 00:16:40.207 real 0m7.069s 00:16:40.207 user 0m13.358s 00:16:40.207 sys 0m2.440s 00:16:40.207 12:30:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:16:40.207 12:30:34 -- common/autotest_common.sh@10 -- # set +x 00:16:40.207 ************************************ 00:16:40.207 END TEST nvmf_bdevio_no_huge 00:16:40.207 ************************************ 00:16:40.207 12:30:34 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:40.207 12:30:34 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:16:40.207 12:30:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:16:40.207 12:30:34 -- common/autotest_common.sh@10 -- # set +x 00:16:40.207 ************************************ 00:16:40.207 START TEST nvmf_tls 00:16:40.207 ************************************ 00:16:40.207 12:30:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:16:40.465 * Looking for test storage... 00:16:40.465 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:40.465 12:30:34 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:40.465 12:30:34 -- nvmf/common.sh@7 -- # uname -s 00:16:40.465 12:30:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:40.465 12:30:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:40.465 12:30:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:40.465 12:30:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:40.465 12:30:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:40.465 12:30:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:40.465 12:30:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:40.465 12:30:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:40.465 12:30:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:40.465 12:30:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:40.465 12:30:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:40.465 12:30:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:40.465 12:30:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:40.465 12:30:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:40.465 12:30:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:40.465 12:30:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:40.465 12:30:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:40.465 12:30:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:40.465 12:30:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:40.465 12:30:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.465 12:30:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.465 12:30:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.465 12:30:34 -- paths/export.sh@5 -- # export PATH 00:16:40.465 12:30:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:40.465 12:30:34 -- nvmf/common.sh@46 -- # : 0 00:16:40.465 12:30:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:40.465 12:30:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:40.465 12:30:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:40.465 12:30:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:40.465 12:30:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:40.465 12:30:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:40.465 12:30:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:40.465 12:30:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:40.465 12:30:34 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:40.465 12:30:34 -- target/tls.sh@71 -- # nvmftestinit 00:16:40.465 12:30:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:40.465 12:30:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:40.465 12:30:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:40.466 12:30:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:40.466 12:30:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:40.466 12:30:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:40.466 12:30:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:40.466 12:30:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:40.466 12:30:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:40.466 12:30:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:40.466 12:30:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:40.466 12:30:34 -- common/autotest_common.sh@10 -- # set +x 00:16:42.367 12:30:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:42.367 12:30:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:42.367 12:30:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:42.367 12:30:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:42.367 12:30:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:42.367 12:30:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:42.367 12:30:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:42.367 12:30:36 -- nvmf/common.sh@294 -- # net_devs=() 00:16:42.367 12:30:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:42.367 12:30:36 -- nvmf/common.sh@295 -- # e810=() 00:16:42.367 12:30:36 -- nvmf/common.sh@295 -- # local -ga e810 00:16:42.367 12:30:36 -- nvmf/common.sh@296 -- # x722=() 00:16:42.367 12:30:36 -- nvmf/common.sh@296 -- # local -ga x722 00:16:42.367 12:30:36 -- nvmf/common.sh@297 -- # mlx=() 00:16:42.367 12:30:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:42.367 12:30:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:42.367 12:30:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:42.367 12:30:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:42.367 12:30:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:42.368 12:30:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:42.368 12:30:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:42.368 12:30:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:42.368 12:30:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.368 12:30:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:42.368 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:42.368 12:30:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.368 12:30:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:42.368 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:42.368 12:30:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:42.368 12:30:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.368 12:30:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.368 12:30:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.368 12:30:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.368 12:30:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:42.368 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:42.368 12:30:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.368 12:30:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.368 12:30:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.368 12:30:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.368 12:30:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.368 12:30:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:42.368 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:42.368 12:30:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.368 12:30:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:42.368 12:30:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:42.368 12:30:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:42.368 12:30:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:42.368 12:30:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:42.368 12:30:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:42.368 12:30:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:42.368 12:30:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:42.368 12:30:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:42.368 12:30:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:42.368 12:30:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:42.368 12:30:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:42.368 12:30:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:42.368 12:30:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:42.368 12:30:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:42.368 12:30:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:42.368 12:30:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:42.368 12:30:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:42.368 12:30:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:42.368 12:30:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:42.368 12:30:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:42.368 12:30:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:42.368 12:30:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:42.368 12:30:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:42.368 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:42.368 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.106 ms 00:16:42.368 00:16:42.368 --- 10.0.0.2 ping statistics --- 00:16:42.368 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.368 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:16:42.368 12:30:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:42.649 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:42.649 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:16:42.649 00:16:42.649 --- 10.0.0.1 ping statistics --- 00:16:42.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.649 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:16:42.649 12:30:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:42.649 12:30:36 -- nvmf/common.sh@410 -- # return 0 00:16:42.649 12:30:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:42.649 12:30:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:42.649 12:30:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:42.649 12:30:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:42.649 12:30:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:42.649 12:30:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:42.649 12:30:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:42.649 12:30:36 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:16:42.649 12:30:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:42.649 12:30:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:16:42.649 12:30:36 -- common/autotest_common.sh@10 -- # set +x 00:16:42.649 12:30:36 -- nvmf/common.sh@469 -- # nvmfpid=1282640 00:16:42.649 12:30:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:16:42.649 12:30:36 -- nvmf/common.sh@470 -- # waitforlisten 1282640 00:16:42.649 12:30:36 -- common/autotest_common.sh@819 -- # '[' -z 1282640 ']' 00:16:42.649 12:30:36 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:42.649 12:30:36 -- common/autotest_common.sh@824 -- # local max_retries=100 00:16:42.649 12:30:36 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:42.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:42.649 12:30:36 -- common/autotest_common.sh@828 -- # xtrace_disable 00:16:42.649 12:30:36 -- common/autotest_common.sh@10 -- # set +x 00:16:42.649 [2024-07-12 12:30:36.354649] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:16:42.649 [2024-07-12 12:30:36.354731] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:42.649 EAL: No free 2048 kB hugepages reported on node 1 00:16:42.649 [2024-07-12 12:30:36.423575] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:42.649 [2024-07-12 12:30:36.537133] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:42.649 [2024-07-12 12:30:36.537286] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:42.649 [2024-07-12 12:30:36.537305] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:42.649 [2024-07-12 12:30:36.537327] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:42.649 [2024-07-12 12:30:36.537357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.602 12:30:37 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:16:43.602 12:30:37 -- common/autotest_common.sh@852 -- # return 0 00:16:43.602 12:30:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:43.602 12:30:37 -- common/autotest_common.sh@718 -- # xtrace_disable 00:16:43.602 12:30:37 -- common/autotest_common.sh@10 -- # set +x 00:16:43.602 12:30:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:43.602 12:30:37 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:16:43.602 12:30:37 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:16:43.861 true 00:16:43.861 12:30:37 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:43.861 12:30:37 -- target/tls.sh@82 -- # jq -r .tls_version 00:16:43.861 12:30:37 -- target/tls.sh@82 -- # version=0 00:16:43.861 12:30:37 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:16:43.861 12:30:37 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:44.119 12:30:38 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:44.119 12:30:38 -- target/tls.sh@90 -- # jq -r .tls_version 00:16:44.379 12:30:38 -- target/tls.sh@90 -- # version=13 00:16:44.379 12:30:38 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:16:44.379 12:30:38 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:16:44.638 12:30:38 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:44.638 12:30:38 -- target/tls.sh@98 -- # jq -r .tls_version 00:16:44.897 12:30:38 -- target/tls.sh@98 -- # version=7 00:16:44.897 12:30:38 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:16:44.897 12:30:38 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:44.897 12:30:38 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:16:45.158 12:30:38 -- target/tls.sh@105 -- # ktls=false 00:16:45.158 12:30:38 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:16:45.158 12:30:38 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:16:45.417 12:30:39 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:45.417 12:30:39 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:16:45.674 12:30:39 -- target/tls.sh@113 -- # ktls=true 00:16:45.674 12:30:39 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:16:45.674 12:30:39 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:16:45.934 12:30:39 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:16:45.934 12:30:39 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:16:46.193 12:30:39 -- target/tls.sh@121 -- # ktls=false 00:16:46.193 12:30:39 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:16:46.193 12:30:39 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:16:46.193 12:30:39 -- target/tls.sh@49 -- # local key hash crc 00:16:46.193 12:30:39 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:16:46.193 12:30:39 -- target/tls.sh@51 -- # hash=01 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # gzip -1 -c 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # tail -c8 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # head -c 4 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # crc='p$H�' 00:16:46.193 12:30:39 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:46.193 12:30:39 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:16:46.193 12:30:39 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:46.193 12:30:39 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:46.193 12:30:39 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:16:46.193 12:30:39 -- target/tls.sh@49 -- # local key hash crc 00:16:46.193 12:30:39 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:16:46.193 12:30:39 -- target/tls.sh@51 -- # hash=01 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # tail -c8 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # gzip -1 -c 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # head -c 4 00:16:46.193 12:30:39 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:16:46.193 12:30:39 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:16:46.193 12:30:39 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:16:46.193 12:30:39 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:46.193 12:30:39 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:46.193 12:30:39 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:46.193 12:30:39 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:46.193 12:30:39 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:16:46.193 12:30:39 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:16:46.193 12:30:39 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:46.193 12:30:39 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:16:46.193 12:30:39 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:16:46.450 12:30:40 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:16:46.709 12:30:40 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:46.709 12:30:40 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:46.709 12:30:40 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:46.967 [2024-07-12 12:30:40.874582] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:47.225 12:30:40 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:47.225 12:30:41 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:16:47.482 [2024-07-12 12:30:41.327786] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:47.482 [2024-07-12 12:30:41.328009] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:47.482 12:30:41 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:47.739 malloc0 00:16:47.739 12:30:41 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:47.996 12:30:41 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.254 12:30:42 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:16:48.254 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.451 Initializing NVMe Controllers 00:17:00.451 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:00.451 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:00.451 Initialization complete. Launching workers. 00:17:00.451 ======================================================== 00:17:00.451 Latency(us) 00:17:00.451 Device Information : IOPS MiB/s Average min max 00:17:00.451 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7713.39 30.13 8299.97 1217.19 9369.50 00:17:00.451 ======================================================== 00:17:00.451 Total : 7713.39 30.13 8299.97 1217.19 9369.50 00:17:00.451 00:17:00.451 12:30:52 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:00.451 12:30:52 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:00.451 12:30:52 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:00.451 12:30:52 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:00.451 12:30:52 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:00.451 12:30:52 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:00.451 12:30:52 -- target/tls.sh@28 -- # bdevperf_pid=1284625 00:17:00.451 12:30:52 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:00.451 12:30:52 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:00.451 12:30:52 -- target/tls.sh@31 -- # waitforlisten 1284625 /var/tmp/bdevperf.sock 00:17:00.451 12:30:52 -- common/autotest_common.sh@819 -- # '[' -z 1284625 ']' 00:17:00.451 12:30:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:00.451 12:30:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:00.451 12:30:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:00.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:00.451 12:30:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:00.451 12:30:52 -- common/autotest_common.sh@10 -- # set +x 00:17:00.451 [2024-07-12 12:30:52.205429] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:00.451 [2024-07-12 12:30:52.205505] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1284625 ] 00:17:00.451 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.451 [2024-07-12 12:30:52.264358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:00.451 [2024-07-12 12:30:52.368605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.451 12:30:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:00.451 12:30:53 -- common/autotest_common.sh@852 -- # return 0 00:17:00.451 12:30:53 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:00.451 [2024-07-12 12:30:53.395369] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:00.451 TLSTESTn1 00:17:00.451 12:30:53 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:00.451 Running I/O for 10 seconds... 00:17:10.429 00:17:10.429 Latency(us) 00:17:10.429 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.429 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:10.429 Verification LBA range: start 0x0 length 0x2000 00:17:10.429 TLSTESTn1 : 10.02 4606.79 18.00 0.00 0.00 27740.22 4757.43 42525.58 00:17:10.429 =================================================================================================================== 00:17:10.429 Total : 4606.79 18.00 0.00 0.00 27740.22 4757.43 42525.58 00:17:10.429 0 00:17:10.429 12:31:03 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:10.429 12:31:03 -- target/tls.sh@45 -- # killprocess 1284625 00:17:10.429 12:31:03 -- common/autotest_common.sh@926 -- # '[' -z 1284625 ']' 00:17:10.429 12:31:03 -- common/autotest_common.sh@930 -- # kill -0 1284625 00:17:10.429 12:31:03 -- common/autotest_common.sh@931 -- # uname 00:17:10.429 12:31:03 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:10.429 12:31:03 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1284625 00:17:10.429 12:31:03 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:10.429 12:31:03 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:10.429 12:31:03 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1284625' 00:17:10.429 killing process with pid 1284625 00:17:10.429 12:31:03 -- common/autotest_common.sh@945 -- # kill 1284625 00:17:10.429 Received shutdown signal, test time was about 10.000000 seconds 00:17:10.429 00:17:10.429 Latency(us) 00:17:10.429 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:10.429 =================================================================================================================== 00:17:10.429 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:10.429 12:31:03 -- common/autotest_common.sh@950 -- # wait 1284625 00:17:10.429 12:31:03 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:10.429 12:31:03 -- common/autotest_common.sh@640 -- # local es=0 00:17:10.429 12:31:03 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:10.429 12:31:03 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:10.429 12:31:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:10.429 12:31:03 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:10.429 12:31:03 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:10.429 12:31:03 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:10.429 12:31:03 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:10.429 12:31:03 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:10.429 12:31:03 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:10.429 12:31:03 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:10.429 12:31:03 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:10.429 12:31:03 -- target/tls.sh@28 -- # bdevperf_pid=1286008 00:17:10.429 12:31:03 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:10.429 12:31:03 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:10.429 12:31:03 -- target/tls.sh@31 -- # waitforlisten 1286008 /var/tmp/bdevperf.sock 00:17:10.429 12:31:03 -- common/autotest_common.sh@819 -- # '[' -z 1286008 ']' 00:17:10.429 12:31:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:10.429 12:31:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:10.429 12:31:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:10.429 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:10.429 12:31:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:10.429 12:31:03 -- common/autotest_common.sh@10 -- # set +x 00:17:10.429 [2024-07-12 12:31:03.958564] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:10.429 [2024-07-12 12:31:03.958642] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1286008 ] 00:17:10.429 EAL: No free 2048 kB hugepages reported on node 1 00:17:10.429 [2024-07-12 12:31:04.017624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:10.429 [2024-07-12 12:31:04.123035] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:11.364 12:31:04 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:11.364 12:31:04 -- common/autotest_common.sh@852 -- # return 0 00:17:11.364 12:31:04 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:11.364 [2024-07-12 12:31:05.152663] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:11.364 [2024-07-12 12:31:05.163442] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:11.364 [2024-07-12 12:31:05.163534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc5e870 (107): Transport endpoint is not connected 00:17:11.364 [2024-07-12 12:31:05.164523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc5e870 (9): Bad file descriptor 00:17:11.364 [2024-07-12 12:31:05.165522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:11.364 [2024-07-12 12:31:05.165542] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:11.364 [2024-07-12 12:31:05.165570] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:11.364 request: 00:17:11.364 { 00:17:11.364 "name": "TLSTEST", 00:17:11.364 "trtype": "tcp", 00:17:11.364 "traddr": "10.0.0.2", 00:17:11.364 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:11.364 "adrfam": "ipv4", 00:17:11.364 "trsvcid": "4420", 00:17:11.364 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:11.364 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:11.364 "method": "bdev_nvme_attach_controller", 00:17:11.364 "req_id": 1 00:17:11.364 } 00:17:11.364 Got JSON-RPC error response 00:17:11.364 response: 00:17:11.364 { 00:17:11.364 "code": -32602, 00:17:11.364 "message": "Invalid parameters" 00:17:11.364 } 00:17:11.364 12:31:05 -- target/tls.sh@36 -- # killprocess 1286008 00:17:11.364 12:31:05 -- common/autotest_common.sh@926 -- # '[' -z 1286008 ']' 00:17:11.364 12:31:05 -- common/autotest_common.sh@930 -- # kill -0 1286008 00:17:11.364 12:31:05 -- common/autotest_common.sh@931 -- # uname 00:17:11.364 12:31:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:11.364 12:31:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1286008 00:17:11.364 12:31:05 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:11.364 12:31:05 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:11.364 12:31:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1286008' 00:17:11.364 killing process with pid 1286008 00:17:11.364 12:31:05 -- common/autotest_common.sh@945 -- # kill 1286008 00:17:11.364 Received shutdown signal, test time was about 10.000000 seconds 00:17:11.364 00:17:11.364 Latency(us) 00:17:11.364 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:11.364 =================================================================================================================== 00:17:11.364 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:11.364 12:31:05 -- common/autotest_common.sh@950 -- # wait 1286008 00:17:11.622 12:31:05 -- target/tls.sh@37 -- # return 1 00:17:11.622 12:31:05 -- common/autotest_common.sh@643 -- # es=1 00:17:11.622 12:31:05 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:11.622 12:31:05 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:11.622 12:31:05 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:11.622 12:31:05 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.622 12:31:05 -- common/autotest_common.sh@640 -- # local es=0 00:17:11.622 12:31:05 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.622 12:31:05 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:11.622 12:31:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:11.622 12:31:05 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:11.622 12:31:05 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:11.622 12:31:05 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:11.622 12:31:05 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:11.622 12:31:05 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:11.622 12:31:05 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:11.622 12:31:05 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:11.622 12:31:05 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:11.622 12:31:05 -- target/tls.sh@28 -- # bdevperf_pid=1286156 00:17:11.622 12:31:05 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:11.622 12:31:05 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:11.622 12:31:05 -- target/tls.sh@31 -- # waitforlisten 1286156 /var/tmp/bdevperf.sock 00:17:11.622 12:31:05 -- common/autotest_common.sh@819 -- # '[' -z 1286156 ']' 00:17:11.622 12:31:05 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:11.622 12:31:05 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:11.622 12:31:05 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:11.622 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:11.622 12:31:05 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:11.622 12:31:05 -- common/autotest_common.sh@10 -- # set +x 00:17:11.622 [2024-07-12 12:31:05.523384] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:11.622 [2024-07-12 12:31:05.523462] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1286156 ] 00:17:11.880 EAL: No free 2048 kB hugepages reported on node 1 00:17:11.880 [2024-07-12 12:31:05.582471] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:11.880 [2024-07-12 12:31:05.690190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:12.816 12:31:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:12.816 12:31:06 -- common/autotest_common.sh@852 -- # return 0 00:17:12.816 12:31:06 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.074 [2024-07-12 12:31:06.772662] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:13.074 [2024-07-12 12:31:06.778062] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:13.074 [2024-07-12 12:31:06.778096] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:13.074 [2024-07-12 12:31:06.778153] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:13.074 [2024-07-12 12:31:06.778677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12f1870 (107): Transport endpoint is not connected 00:17:13.074 [2024-07-12 12:31:06.779666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x12f1870 (9): Bad file descriptor 00:17:13.074 [2024-07-12 12:31:06.780664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:13.074 [2024-07-12 12:31:06.780687] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:13.074 [2024-07-12 12:31:06.780716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:13.074 request: 00:17:13.074 { 00:17:13.074 "name": "TLSTEST", 00:17:13.074 "trtype": "tcp", 00:17:13.074 "traddr": "10.0.0.2", 00:17:13.074 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:13.074 "adrfam": "ipv4", 00:17:13.074 "trsvcid": "4420", 00:17:13.074 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:13.074 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:13.074 "method": "bdev_nvme_attach_controller", 00:17:13.074 "req_id": 1 00:17:13.074 } 00:17:13.074 Got JSON-RPC error response 00:17:13.074 response: 00:17:13.074 { 00:17:13.074 "code": -32602, 00:17:13.074 "message": "Invalid parameters" 00:17:13.074 } 00:17:13.074 12:31:06 -- target/tls.sh@36 -- # killprocess 1286156 00:17:13.074 12:31:06 -- common/autotest_common.sh@926 -- # '[' -z 1286156 ']' 00:17:13.074 12:31:06 -- common/autotest_common.sh@930 -- # kill -0 1286156 00:17:13.074 12:31:06 -- common/autotest_common.sh@931 -- # uname 00:17:13.074 12:31:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:13.074 12:31:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1286156 00:17:13.074 12:31:06 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:13.074 12:31:06 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:13.074 12:31:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1286156' 00:17:13.074 killing process with pid 1286156 00:17:13.074 12:31:06 -- common/autotest_common.sh@945 -- # kill 1286156 00:17:13.074 Received shutdown signal, test time was about 10.000000 seconds 00:17:13.074 00:17:13.074 Latency(us) 00:17:13.074 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:13.074 =================================================================================================================== 00:17:13.074 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:13.074 12:31:06 -- common/autotest_common.sh@950 -- # wait 1286156 00:17:13.334 12:31:07 -- target/tls.sh@37 -- # return 1 00:17:13.334 12:31:07 -- common/autotest_common.sh@643 -- # es=1 00:17:13.334 12:31:07 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:13.334 12:31:07 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:13.334 12:31:07 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:13.334 12:31:07 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.334 12:31:07 -- common/autotest_common.sh@640 -- # local es=0 00:17:13.334 12:31:07 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.334 12:31:07 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:13.334 12:31:07 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:13.334 12:31:07 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:13.334 12:31:07 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:13.334 12:31:07 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:13.334 12:31:07 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:13.334 12:31:07 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:13.334 12:31:07 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:13.334 12:31:07 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:13.334 12:31:07 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:13.334 12:31:07 -- target/tls.sh@28 -- # bdevperf_pid=1286428 00:17:13.334 12:31:07 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:13.334 12:31:07 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:13.334 12:31:07 -- target/tls.sh@31 -- # waitforlisten 1286428 /var/tmp/bdevperf.sock 00:17:13.334 12:31:07 -- common/autotest_common.sh@819 -- # '[' -z 1286428 ']' 00:17:13.334 12:31:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:13.334 12:31:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:13.334 12:31:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:13.334 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:13.334 12:31:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:13.334 12:31:07 -- common/autotest_common.sh@10 -- # set +x 00:17:13.334 [2024-07-12 12:31:07.105210] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:13.334 [2024-07-12 12:31:07.105302] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1286428 ] 00:17:13.334 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.334 [2024-07-12 12:31:07.166067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:13.593 [2024-07-12 12:31:07.273055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:14.217 12:31:08 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:14.217 12:31:08 -- common/autotest_common.sh@852 -- # return 0 00:17:14.217 12:31:08 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:14.476 [2024-07-12 12:31:08.335513] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:14.476 [2024-07-12 12:31:08.341627] tcp.c: 866:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:14.476 [2024-07-12 12:31:08.341658] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:14.476 [2024-07-12 12:31:08.341713] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:14.476 [2024-07-12 12:31:08.342476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214a870 (107): Transport endpoint is not connected 00:17:14.476 [2024-07-12 12:31:08.343465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x214a870 (9): Bad file descriptor 00:17:14.476 [2024-07-12 12:31:08.344464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:14.476 [2024-07-12 12:31:08.344483] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:14.476 [2024-07-12 12:31:08.344512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:14.476 request: 00:17:14.476 { 00:17:14.476 "name": "TLSTEST", 00:17:14.476 "trtype": "tcp", 00:17:14.476 "traddr": "10.0.0.2", 00:17:14.476 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:14.476 "adrfam": "ipv4", 00:17:14.476 "trsvcid": "4420", 00:17:14.476 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:14.476 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:14.476 "method": "bdev_nvme_attach_controller", 00:17:14.476 "req_id": 1 00:17:14.476 } 00:17:14.476 Got JSON-RPC error response 00:17:14.476 response: 00:17:14.476 { 00:17:14.476 "code": -32602, 00:17:14.476 "message": "Invalid parameters" 00:17:14.476 } 00:17:14.476 12:31:08 -- target/tls.sh@36 -- # killprocess 1286428 00:17:14.476 12:31:08 -- common/autotest_common.sh@926 -- # '[' -z 1286428 ']' 00:17:14.476 12:31:08 -- common/autotest_common.sh@930 -- # kill -0 1286428 00:17:14.476 12:31:08 -- common/autotest_common.sh@931 -- # uname 00:17:14.476 12:31:08 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:14.476 12:31:08 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1286428 00:17:14.476 12:31:08 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:14.476 12:31:08 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:14.476 12:31:08 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1286428' 00:17:14.476 killing process with pid 1286428 00:17:14.476 12:31:08 -- common/autotest_common.sh@945 -- # kill 1286428 00:17:14.476 Received shutdown signal, test time was about 10.000000 seconds 00:17:14.476 00:17:14.476 Latency(us) 00:17:14.476 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:14.476 =================================================================================================================== 00:17:14.476 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:14.476 12:31:08 -- common/autotest_common.sh@950 -- # wait 1286428 00:17:14.734 12:31:08 -- target/tls.sh@37 -- # return 1 00:17:14.734 12:31:08 -- common/autotest_common.sh@643 -- # es=1 00:17:14.734 12:31:08 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:14.734 12:31:08 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:14.734 12:31:08 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:14.734 12:31:08 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:14.734 12:31:08 -- common/autotest_common.sh@640 -- # local es=0 00:17:14.735 12:31:08 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:14.735 12:31:08 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:14.735 12:31:08 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:14.735 12:31:08 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:14.735 12:31:08 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:14.735 12:31:08 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:14.735 12:31:08 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:14.735 12:31:08 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:14.735 12:31:08 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:14.735 12:31:08 -- target/tls.sh@23 -- # psk= 00:17:14.735 12:31:08 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:14.735 12:31:08 -- target/tls.sh@28 -- # bdevperf_pid=1286583 00:17:14.735 12:31:08 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:14.735 12:31:08 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:14.735 12:31:08 -- target/tls.sh@31 -- # waitforlisten 1286583 /var/tmp/bdevperf.sock 00:17:14.735 12:31:08 -- common/autotest_common.sh@819 -- # '[' -z 1286583 ']' 00:17:14.735 12:31:08 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:14.735 12:31:08 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:14.735 12:31:08 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:14.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:14.735 12:31:08 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:14.735 12:31:08 -- common/autotest_common.sh@10 -- # set +x 00:17:14.994 [2024-07-12 12:31:08.656177] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:14.994 [2024-07-12 12:31:08.656269] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1286583 ] 00:17:14.994 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.994 [2024-07-12 12:31:08.715897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:14.994 [2024-07-12 12:31:08.818543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:15.931 12:31:09 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:15.931 12:31:09 -- common/autotest_common.sh@852 -- # return 0 00:17:15.931 12:31:09 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:15.931 [2024-07-12 12:31:09.825506] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:15.931 [2024-07-12 12:31:09.827468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x20f7330 (9): Bad file descriptor 00:17:15.931 [2024-07-12 12:31:09.828464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:15.931 [2024-07-12 12:31:09.828486] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:15.931 [2024-07-12 12:31:09.828514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:15.931 request: 00:17:15.931 { 00:17:15.931 "name": "TLSTEST", 00:17:15.931 "trtype": "tcp", 00:17:15.931 "traddr": "10.0.0.2", 00:17:15.931 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:15.931 "adrfam": "ipv4", 00:17:15.931 "trsvcid": "4420", 00:17:15.931 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:15.931 "method": "bdev_nvme_attach_controller", 00:17:15.931 "req_id": 1 00:17:15.931 } 00:17:15.931 Got JSON-RPC error response 00:17:15.931 response: 00:17:15.931 { 00:17:15.932 "code": -32602, 00:17:15.932 "message": "Invalid parameters" 00:17:15.932 } 00:17:15.932 12:31:09 -- target/tls.sh@36 -- # killprocess 1286583 00:17:15.932 12:31:09 -- common/autotest_common.sh@926 -- # '[' -z 1286583 ']' 00:17:15.932 12:31:09 -- common/autotest_common.sh@930 -- # kill -0 1286583 00:17:15.932 12:31:09 -- common/autotest_common.sh@931 -- # uname 00:17:15.932 12:31:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:15.932 12:31:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1286583 00:17:16.189 12:31:09 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:16.189 12:31:09 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:16.189 12:31:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1286583' 00:17:16.189 killing process with pid 1286583 00:17:16.189 12:31:09 -- common/autotest_common.sh@945 -- # kill 1286583 00:17:16.189 Received shutdown signal, test time was about 10.000000 seconds 00:17:16.189 00:17:16.189 Latency(us) 00:17:16.189 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:16.189 =================================================================================================================== 00:17:16.189 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:16.189 12:31:09 -- common/autotest_common.sh@950 -- # wait 1286583 00:17:16.449 12:31:10 -- target/tls.sh@37 -- # return 1 00:17:16.449 12:31:10 -- common/autotest_common.sh@643 -- # es=1 00:17:16.449 12:31:10 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:16.449 12:31:10 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:16.449 12:31:10 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:16.449 12:31:10 -- target/tls.sh@167 -- # killprocess 1282640 00:17:16.449 12:31:10 -- common/autotest_common.sh@926 -- # '[' -z 1282640 ']' 00:17:16.449 12:31:10 -- common/autotest_common.sh@930 -- # kill -0 1282640 00:17:16.449 12:31:10 -- common/autotest_common.sh@931 -- # uname 00:17:16.449 12:31:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:16.449 12:31:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1282640 00:17:16.449 12:31:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:16.449 12:31:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:16.449 12:31:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1282640' 00:17:16.449 killing process with pid 1282640 00:17:16.449 12:31:10 -- common/autotest_common.sh@945 -- # kill 1282640 00:17:16.449 12:31:10 -- common/autotest_common.sh@950 -- # wait 1282640 00:17:16.708 12:31:10 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:16.708 12:31:10 -- target/tls.sh@49 -- # local key hash crc 00:17:16.708 12:31:10 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:16.708 12:31:10 -- target/tls.sh@51 -- # hash=02 00:17:16.708 12:31:10 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:16.708 12:31:10 -- target/tls.sh@52 -- # gzip -1 -c 00:17:16.708 12:31:10 -- target/tls.sh@52 -- # tail -c8 00:17:16.708 12:31:10 -- target/tls.sh@52 -- # head -c 4 00:17:16.708 12:31:10 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:16.708 12:31:10 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:16.708 12:31:10 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:16.708 12:31:10 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:16.708 12:31:10 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:16.708 12:31:10 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:16.708 12:31:10 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:16.708 12:31:10 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:16.708 12:31:10 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:16.708 12:31:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:16.708 12:31:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:16.708 12:31:10 -- common/autotest_common.sh@10 -- # set +x 00:17:16.708 12:31:10 -- nvmf/common.sh@469 -- # nvmfpid=1286870 00:17:16.708 12:31:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:16.708 12:31:10 -- nvmf/common.sh@470 -- # waitforlisten 1286870 00:17:16.708 12:31:10 -- common/autotest_common.sh@819 -- # '[' -z 1286870 ']' 00:17:16.708 12:31:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:16.708 12:31:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:16.708 12:31:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:16.708 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:16.708 12:31:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:16.708 12:31:10 -- common/autotest_common.sh@10 -- # set +x 00:17:16.708 [2024-07-12 12:31:10.491229] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:16.708 [2024-07-12 12:31:10.491310] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:16.708 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.708 [2024-07-12 12:31:10.558021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.967 [2024-07-12 12:31:10.672070] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:16.967 [2024-07-12 12:31:10.672245] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:16.967 [2024-07-12 12:31:10.672262] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:16.967 [2024-07-12 12:31:10.672273] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:16.967 [2024-07-12 12:31:10.672301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:17.535 12:31:11 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:17.535 12:31:11 -- common/autotest_common.sh@852 -- # return 0 00:17:17.535 12:31:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:17.535 12:31:11 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:17.535 12:31:11 -- common/autotest_common.sh@10 -- # set +x 00:17:17.794 12:31:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:17.794 12:31:11 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:17.794 12:31:11 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:17.794 12:31:11 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:17.794 [2024-07-12 12:31:11.687792] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:17.794 12:31:11 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:18.052 12:31:11 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:18.310 [2024-07-12 12:31:12.161059] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:18.310 [2024-07-12 12:31:12.161299] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:18.310 12:31:12 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:18.569 malloc0 00:17:18.569 12:31:12 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:19.137 12:31:12 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.137 12:31:13 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:19.137 12:31:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:19.137 12:31:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:19.137 12:31:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:19.137 12:31:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:19.137 12:31:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:19.137 12:31:13 -- target/tls.sh@28 -- # bdevperf_pid=1287179 00:17:19.137 12:31:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:19.137 12:31:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:19.137 12:31:13 -- target/tls.sh@31 -- # waitforlisten 1287179 /var/tmp/bdevperf.sock 00:17:19.137 12:31:13 -- common/autotest_common.sh@819 -- # '[' -z 1287179 ']' 00:17:19.137 12:31:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:19.137 12:31:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:19.137 12:31:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:19.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:19.137 12:31:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:19.137 12:31:13 -- common/autotest_common.sh@10 -- # set +x 00:17:19.137 [2024-07-12 12:31:13.051520] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:19.137 [2024-07-12 12:31:13.051593] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1287179 ] 00:17:19.396 EAL: No free 2048 kB hugepages reported on node 1 00:17:19.396 [2024-07-12 12:31:13.110494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:19.396 [2024-07-12 12:31:13.216607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:20.332 12:31:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:20.332 12:31:14 -- common/autotest_common.sh@852 -- # return 0 00:17:20.332 12:31:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:20.332 [2024-07-12 12:31:14.235899] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:20.591 TLSTESTn1 00:17:20.591 12:31:14 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:20.591 Running I/O for 10 seconds... 00:17:32.795 00:17:32.795 Latency(us) 00:17:32.795 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:32.795 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:32.795 Verification LBA range: start 0x0 length 0x2000 00:17:32.795 TLSTESTn1 : 10.07 3341.73 13.05 0.00 0.00 38201.62 6019.60 79225.74 00:17:32.795 =================================================================================================================== 00:17:32.795 Total : 3341.73 13.05 0.00 0.00 38201.62 6019.60 79225.74 00:17:32.795 0 00:17:32.795 12:31:24 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:32.795 12:31:24 -- target/tls.sh@45 -- # killprocess 1287179 00:17:32.796 12:31:24 -- common/autotest_common.sh@926 -- # '[' -z 1287179 ']' 00:17:32.796 12:31:24 -- common/autotest_common.sh@930 -- # kill -0 1287179 00:17:32.796 12:31:24 -- common/autotest_common.sh@931 -- # uname 00:17:32.796 12:31:24 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:32.796 12:31:24 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1287179 00:17:32.796 12:31:24 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:32.796 12:31:24 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:32.796 12:31:24 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1287179' 00:17:32.796 killing process with pid 1287179 00:17:32.796 12:31:24 -- common/autotest_common.sh@945 -- # kill 1287179 00:17:32.796 Received shutdown signal, test time was about 10.000000 seconds 00:17:32.796 00:17:32.796 Latency(us) 00:17:32.796 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:32.796 =================================================================================================================== 00:17:32.796 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:32.796 12:31:24 -- common/autotest_common.sh@950 -- # wait 1287179 00:17:32.796 12:31:24 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:32.796 12:31:24 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:32.796 12:31:24 -- common/autotest_common.sh@640 -- # local es=0 00:17:32.796 12:31:24 -- common/autotest_common.sh@642 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:32.796 12:31:24 -- common/autotest_common.sh@628 -- # local arg=run_bdevperf 00:17:32.796 12:31:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:32.796 12:31:24 -- common/autotest_common.sh@632 -- # type -t run_bdevperf 00:17:32.796 12:31:24 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:32.796 12:31:24 -- common/autotest_common.sh@643 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:32.796 12:31:24 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:32.796 12:31:24 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:32.796 12:31:24 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:32.796 12:31:24 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:32.796 12:31:24 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:32.796 12:31:24 -- target/tls.sh@28 -- # bdevperf_pid=1288542 00:17:32.796 12:31:24 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:32.796 12:31:24 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:32.796 12:31:24 -- target/tls.sh@31 -- # waitforlisten 1288542 /var/tmp/bdevperf.sock 00:17:32.796 12:31:24 -- common/autotest_common.sh@819 -- # '[' -z 1288542 ']' 00:17:32.796 12:31:24 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:32.796 12:31:24 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:32.796 12:31:24 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:32.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:32.796 12:31:24 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:32.796 12:31:24 -- common/autotest_common.sh@10 -- # set +x 00:17:32.796 [2024-07-12 12:31:24.887335] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:32.796 [2024-07-12 12:31:24.887413] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1288542 ] 00:17:32.796 EAL: No free 2048 kB hugepages reported on node 1 00:17:32.796 [2024-07-12 12:31:24.947548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:32.796 [2024-07-12 12:31:25.051750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:32.796 12:31:25 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:32.796 12:31:25 -- common/autotest_common.sh@852 -- # return 0 00:17:32.796 12:31:25 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:32.796 [2024-07-12 12:31:26.033606] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:32.796 [2024-07-12 12:31:26.033693] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:32.796 request: 00:17:32.796 { 00:17:32.796 "name": "TLSTEST", 00:17:32.796 "trtype": "tcp", 00:17:32.796 "traddr": "10.0.0.2", 00:17:32.796 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:32.796 "adrfam": "ipv4", 00:17:32.796 "trsvcid": "4420", 00:17:32.796 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:32.796 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:32.796 "method": "bdev_nvme_attach_controller", 00:17:32.796 "req_id": 1 00:17:32.796 } 00:17:32.796 Got JSON-RPC error response 00:17:32.796 response: 00:17:32.796 { 00:17:32.796 "code": -22, 00:17:32.796 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:32.796 } 00:17:32.796 12:31:26 -- target/tls.sh@36 -- # killprocess 1288542 00:17:32.796 12:31:26 -- common/autotest_common.sh@926 -- # '[' -z 1288542 ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@930 -- # kill -0 1288542 00:17:32.796 12:31:26 -- common/autotest_common.sh@931 -- # uname 00:17:32.796 12:31:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1288542 00:17:32.796 12:31:26 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:32.796 12:31:26 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1288542' 00:17:32.796 killing process with pid 1288542 00:17:32.796 12:31:26 -- common/autotest_common.sh@945 -- # kill 1288542 00:17:32.796 Received shutdown signal, test time was about 10.000000 seconds 00:17:32.796 00:17:32.796 Latency(us) 00:17:32.796 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:32.796 =================================================================================================================== 00:17:32.796 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:32.796 12:31:26 -- common/autotest_common.sh@950 -- # wait 1288542 00:17:32.796 12:31:26 -- target/tls.sh@37 -- # return 1 00:17:32.796 12:31:26 -- common/autotest_common.sh@643 -- # es=1 00:17:32.796 12:31:26 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:32.796 12:31:26 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:32.796 12:31:26 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:32.796 12:31:26 -- target/tls.sh@183 -- # killprocess 1286870 00:17:32.796 12:31:26 -- common/autotest_common.sh@926 -- # '[' -z 1286870 ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@930 -- # kill -0 1286870 00:17:32.796 12:31:26 -- common/autotest_common.sh@931 -- # uname 00:17:32.796 12:31:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1286870 00:17:32.796 12:31:26 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:32.796 12:31:26 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1286870' 00:17:32.796 killing process with pid 1286870 00:17:32.796 12:31:26 -- common/autotest_common.sh@945 -- # kill 1286870 00:17:32.796 12:31:26 -- common/autotest_common.sh@950 -- # wait 1286870 00:17:32.796 12:31:26 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:17:32.796 12:31:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:32.796 12:31:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:32.796 12:31:26 -- common/autotest_common.sh@10 -- # set +x 00:17:32.796 12:31:26 -- nvmf/common.sh@469 -- # nvmfpid=1288823 00:17:32.796 12:31:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:32.796 12:31:26 -- nvmf/common.sh@470 -- # waitforlisten 1288823 00:17:32.796 12:31:26 -- common/autotest_common.sh@819 -- # '[' -z 1288823 ']' 00:17:32.796 12:31:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:32.796 12:31:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:32.796 12:31:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:32.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:32.796 12:31:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:32.796 12:31:26 -- common/autotest_common.sh@10 -- # set +x 00:17:32.796 [2024-07-12 12:31:26.711644] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:32.796 [2024-07-12 12:31:26.711724] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:33.054 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.054 [2024-07-12 12:31:26.780161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.054 [2024-07-12 12:31:26.893336] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:33.054 [2024-07-12 12:31:26.893504] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:33.054 [2024-07-12 12:31:26.893523] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:33.054 [2024-07-12 12:31:26.893537] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:33.054 [2024-07-12 12:31:26.893580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:33.989 12:31:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:33.989 12:31:27 -- common/autotest_common.sh@852 -- # return 0 00:17:33.989 12:31:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:33.989 12:31:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:33.989 12:31:27 -- common/autotest_common.sh@10 -- # set +x 00:17:33.989 12:31:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:33.990 12:31:27 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.990 12:31:27 -- common/autotest_common.sh@640 -- # local es=0 00:17:33.990 12:31:27 -- common/autotest_common.sh@642 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.990 12:31:27 -- common/autotest_common.sh@628 -- # local arg=setup_nvmf_tgt 00:17:33.990 12:31:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:33.990 12:31:27 -- common/autotest_common.sh@632 -- # type -t setup_nvmf_tgt 00:17:33.990 12:31:27 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:33.990 12:31:27 -- common/autotest_common.sh@643 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.990 12:31:27 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:33.990 12:31:27 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:34.248 [2024-07-12 12:31:27.911476] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:34.248 12:31:27 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:34.507 12:31:28 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:34.765 [2024-07-12 12:31:28.436900] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:34.765 [2024-07-12 12:31:28.437118] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:34.765 12:31:28 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:34.765 malloc0 00:17:35.023 12:31:28 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:35.023 12:31:28 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.282 [2024-07-12 12:31:29.134132] tcp.c:3549:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:17:35.282 [2024-07-12 12:31:29.134174] tcp.c:3618:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:17:35.282 [2024-07-12 12:31:29.134199] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:17:35.282 request: 00:17:35.282 { 00:17:35.282 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:35.282 "host": "nqn.2016-06.io.spdk:host1", 00:17:35.282 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:35.282 "method": "nvmf_subsystem_add_host", 00:17:35.282 "req_id": 1 00:17:35.282 } 00:17:35.282 Got JSON-RPC error response 00:17:35.282 response: 00:17:35.282 { 00:17:35.282 "code": -32603, 00:17:35.282 "message": "Internal error" 00:17:35.282 } 00:17:35.282 12:31:29 -- common/autotest_common.sh@643 -- # es=1 00:17:35.282 12:31:29 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:35.282 12:31:29 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:35.282 12:31:29 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:35.282 12:31:29 -- target/tls.sh@189 -- # killprocess 1288823 00:17:35.282 12:31:29 -- common/autotest_common.sh@926 -- # '[' -z 1288823 ']' 00:17:35.282 12:31:29 -- common/autotest_common.sh@930 -- # kill -0 1288823 00:17:35.282 12:31:29 -- common/autotest_common.sh@931 -- # uname 00:17:35.282 12:31:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:35.282 12:31:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1288823 00:17:35.282 12:31:29 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:35.282 12:31:29 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:35.282 12:31:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1288823' 00:17:35.282 killing process with pid 1288823 00:17:35.282 12:31:29 -- common/autotest_common.sh@945 -- # kill 1288823 00:17:35.282 12:31:29 -- common/autotest_common.sh@950 -- # wait 1288823 00:17:35.851 12:31:29 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:35.851 12:31:29 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:17:35.851 12:31:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:35.851 12:31:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:35.851 12:31:29 -- common/autotest_common.sh@10 -- # set +x 00:17:35.851 12:31:29 -- nvmf/common.sh@469 -- # nvmfpid=1289258 00:17:35.851 12:31:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:35.851 12:31:29 -- nvmf/common.sh@470 -- # waitforlisten 1289258 00:17:35.851 12:31:29 -- common/autotest_common.sh@819 -- # '[' -z 1289258 ']' 00:17:35.851 12:31:29 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:35.851 12:31:29 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:35.851 12:31:29 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:35.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:35.851 12:31:29 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:35.851 12:31:29 -- common/autotest_common.sh@10 -- # set +x 00:17:35.851 [2024-07-12 12:31:29.523974] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:35.851 [2024-07-12 12:31:29.524070] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:35.851 EAL: No free 2048 kB hugepages reported on node 1 00:17:35.851 [2024-07-12 12:31:29.593044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:35.851 [2024-07-12 12:31:29.707078] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:35.851 [2024-07-12 12:31:29.707271] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:35.851 [2024-07-12 12:31:29.707292] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:35.851 [2024-07-12 12:31:29.707306] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:35.851 [2024-07-12 12:31:29.707346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:36.792 12:31:30 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:36.792 12:31:30 -- common/autotest_common.sh@852 -- # return 0 00:17:36.792 12:31:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:36.792 12:31:30 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:36.792 12:31:30 -- common/autotest_common.sh@10 -- # set +x 00:17:36.792 12:31:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:36.792 12:31:30 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:36.792 12:31:30 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:36.792 12:31:30 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:37.052 [2024-07-12 12:31:30.773820] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:37.052 12:31:30 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:37.310 12:31:31 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:37.570 [2024-07-12 12:31:31.315293] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:37.570 [2024-07-12 12:31:31.315515] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:37.570 12:31:31 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:37.829 malloc0 00:17:37.829 12:31:31 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:38.087 12:31:31 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:38.345 12:31:32 -- target/tls.sh@197 -- # bdevperf_pid=1289572 00:17:38.345 12:31:32 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.345 12:31:32 -- target/tls.sh@200 -- # waitforlisten 1289572 /var/tmp/bdevperf.sock 00:17:38.345 12:31:32 -- common/autotest_common.sh@819 -- # '[' -z 1289572 ']' 00:17:38.345 12:31:32 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.345 12:31:32 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.345 12:31:32 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:38.345 12:31:32 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.345 12:31:32 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:38.345 12:31:32 -- common/autotest_common.sh@10 -- # set +x 00:17:38.345 [2024-07-12 12:31:32.184403] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:38.346 [2024-07-12 12:31:32.184475] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1289572 ] 00:17:38.346 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.346 [2024-07-12 12:31:32.246935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.605 [2024-07-12 12:31:32.365216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.542 12:31:33 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:39.542 12:31:33 -- common/autotest_common.sh@852 -- # return 0 00:17:39.542 12:31:33 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:39.542 [2024-07-12 12:31:33.374755] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:39.542 TLSTESTn1 00:17:39.801 12:31:33 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:17:40.059 12:31:33 -- target/tls.sh@205 -- # tgtconf='{ 00:17:40.059 "subsystems": [ 00:17:40.059 { 00:17:40.059 "subsystem": "iobuf", 00:17:40.059 "config": [ 00:17:40.059 { 00:17:40.059 "method": "iobuf_set_options", 00:17:40.059 "params": { 00:17:40.059 "small_pool_count": 8192, 00:17:40.059 "large_pool_count": 1024, 00:17:40.059 "small_bufsize": 8192, 00:17:40.059 "large_bufsize": 135168 00:17:40.059 } 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "sock", 00:17:40.059 "config": [ 00:17:40.059 { 00:17:40.059 "method": "sock_impl_set_options", 00:17:40.059 "params": { 00:17:40.059 "impl_name": "posix", 00:17:40.059 "recv_buf_size": 2097152, 00:17:40.059 "send_buf_size": 2097152, 00:17:40.059 "enable_recv_pipe": true, 00:17:40.059 "enable_quickack": false, 00:17:40.059 "enable_placement_id": 0, 00:17:40.059 "enable_zerocopy_send_server": true, 00:17:40.059 "enable_zerocopy_send_client": false, 00:17:40.059 "zerocopy_threshold": 0, 00:17:40.059 "tls_version": 0, 00:17:40.059 "enable_ktls": false 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "sock_impl_set_options", 00:17:40.059 "params": { 00:17:40.059 "impl_name": "ssl", 00:17:40.059 "recv_buf_size": 4096, 00:17:40.059 "send_buf_size": 4096, 00:17:40.059 "enable_recv_pipe": true, 00:17:40.059 "enable_quickack": false, 00:17:40.059 "enable_placement_id": 0, 00:17:40.059 "enable_zerocopy_send_server": true, 00:17:40.059 "enable_zerocopy_send_client": false, 00:17:40.059 "zerocopy_threshold": 0, 00:17:40.059 "tls_version": 0, 00:17:40.059 "enable_ktls": false 00:17:40.059 } 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "vmd", 00:17:40.059 "config": [] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "accel", 00:17:40.059 "config": [ 00:17:40.059 { 00:17:40.059 "method": "accel_set_options", 00:17:40.059 "params": { 00:17:40.059 "small_cache_size": 128, 00:17:40.059 "large_cache_size": 16, 00:17:40.059 "task_count": 2048, 00:17:40.059 "sequence_count": 2048, 00:17:40.059 "buf_count": 2048 00:17:40.059 } 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "bdev", 00:17:40.059 "config": [ 00:17:40.059 { 00:17:40.059 "method": "bdev_set_options", 00:17:40.059 "params": { 00:17:40.059 "bdev_io_pool_size": 65535, 00:17:40.059 "bdev_io_cache_size": 256, 00:17:40.059 "bdev_auto_examine": true, 00:17:40.059 "iobuf_small_cache_size": 128, 00:17:40.059 "iobuf_large_cache_size": 16 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "bdev_raid_set_options", 00:17:40.059 "params": { 00:17:40.059 "process_window_size_kb": 1024 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "bdev_iscsi_set_options", 00:17:40.059 "params": { 00:17:40.059 "timeout_sec": 30 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "bdev_nvme_set_options", 00:17:40.059 "params": { 00:17:40.059 "action_on_timeout": "none", 00:17:40.059 "timeout_us": 0, 00:17:40.059 "timeout_admin_us": 0, 00:17:40.059 "keep_alive_timeout_ms": 10000, 00:17:40.059 "transport_retry_count": 4, 00:17:40.059 "arbitration_burst": 0, 00:17:40.059 "low_priority_weight": 0, 00:17:40.059 "medium_priority_weight": 0, 00:17:40.059 "high_priority_weight": 0, 00:17:40.059 "nvme_adminq_poll_period_us": 10000, 00:17:40.059 "nvme_ioq_poll_period_us": 0, 00:17:40.059 "io_queue_requests": 0, 00:17:40.059 "delay_cmd_submit": true, 00:17:40.059 "bdev_retry_count": 3, 00:17:40.059 "transport_ack_timeout": 0, 00:17:40.059 "ctrlr_loss_timeout_sec": 0, 00:17:40.059 "reconnect_delay_sec": 0, 00:17:40.059 "fast_io_fail_timeout_sec": 0, 00:17:40.059 "generate_uuids": false, 00:17:40.059 "transport_tos": 0, 00:17:40.059 "io_path_stat": false, 00:17:40.059 "allow_accel_sequence": false 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "bdev_nvme_set_hotplug", 00:17:40.059 "params": { 00:17:40.059 "period_us": 100000, 00:17:40.059 "enable": false 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "bdev_malloc_create", 00:17:40.059 "params": { 00:17:40.059 "name": "malloc0", 00:17:40.059 "num_blocks": 8192, 00:17:40.059 "block_size": 4096, 00:17:40.059 "physical_block_size": 4096, 00:17:40.059 "uuid": "8c08ea3b-c55f-451c-8bd4-cf820f8af14a", 00:17:40.059 "optimal_io_boundary": 0 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "bdev_wait_for_examine" 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "nbd", 00:17:40.059 "config": [] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "scheduler", 00:17:40.059 "config": [ 00:17:40.059 { 00:17:40.059 "method": "framework_set_scheduler", 00:17:40.059 "params": { 00:17:40.059 "name": "static" 00:17:40.059 } 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "subsystem": "nvmf", 00:17:40.059 "config": [ 00:17:40.059 { 00:17:40.059 "method": "nvmf_set_config", 00:17:40.059 "params": { 00:17:40.059 "discovery_filter": "match_any", 00:17:40.059 "admin_cmd_passthru": { 00:17:40.059 "identify_ctrlr": false 00:17:40.059 } 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_set_max_subsystems", 00:17:40.059 "params": { 00:17:40.059 "max_subsystems": 1024 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_set_crdt", 00:17:40.059 "params": { 00:17:40.059 "crdt1": 0, 00:17:40.059 "crdt2": 0, 00:17:40.059 "crdt3": 0 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_create_transport", 00:17:40.059 "params": { 00:17:40.059 "trtype": "TCP", 00:17:40.059 "max_queue_depth": 128, 00:17:40.059 "max_io_qpairs_per_ctrlr": 127, 00:17:40.059 "in_capsule_data_size": 4096, 00:17:40.059 "max_io_size": 131072, 00:17:40.059 "io_unit_size": 131072, 00:17:40.059 "max_aq_depth": 128, 00:17:40.059 "num_shared_buffers": 511, 00:17:40.059 "buf_cache_size": 4294967295, 00:17:40.059 "dif_insert_or_strip": false, 00:17:40.059 "zcopy": false, 00:17:40.059 "c2h_success": false, 00:17:40.059 "sock_priority": 0, 00:17:40.059 "abort_timeout_sec": 1 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_create_subsystem", 00:17:40.059 "params": { 00:17:40.059 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.059 "allow_any_host": false, 00:17:40.059 "serial_number": "SPDK00000000000001", 00:17:40.059 "model_number": "SPDK bdev Controller", 00:17:40.059 "max_namespaces": 10, 00:17:40.059 "min_cntlid": 1, 00:17:40.059 "max_cntlid": 65519, 00:17:40.059 "ana_reporting": false 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_subsystem_add_host", 00:17:40.059 "params": { 00:17:40.059 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.059 "host": "nqn.2016-06.io.spdk:host1", 00:17:40.059 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_subsystem_add_ns", 00:17:40.059 "params": { 00:17:40.059 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.059 "namespace": { 00:17:40.059 "nsid": 1, 00:17:40.059 "bdev_name": "malloc0", 00:17:40.059 "nguid": "8C08EA3BC55F451C8BD4CF820F8AF14A", 00:17:40.059 "uuid": "8c08ea3b-c55f-451c-8bd4-cf820f8af14a" 00:17:40.059 } 00:17:40.059 } 00:17:40.059 }, 00:17:40.059 { 00:17:40.059 "method": "nvmf_subsystem_add_listener", 00:17:40.059 "params": { 00:17:40.059 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.059 "listen_address": { 00:17:40.059 "trtype": "TCP", 00:17:40.059 "adrfam": "IPv4", 00:17:40.059 "traddr": "10.0.0.2", 00:17:40.059 "trsvcid": "4420" 00:17:40.059 }, 00:17:40.059 "secure_channel": true 00:17:40.059 } 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 } 00:17:40.059 ] 00:17:40.059 }' 00:17:40.059 12:31:33 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:40.319 12:31:34 -- target/tls.sh@206 -- # bdevperfconf='{ 00:17:40.319 "subsystems": [ 00:17:40.319 { 00:17:40.319 "subsystem": "iobuf", 00:17:40.319 "config": [ 00:17:40.319 { 00:17:40.319 "method": "iobuf_set_options", 00:17:40.319 "params": { 00:17:40.319 "small_pool_count": 8192, 00:17:40.319 "large_pool_count": 1024, 00:17:40.319 "small_bufsize": 8192, 00:17:40.319 "large_bufsize": 135168 00:17:40.319 } 00:17:40.319 } 00:17:40.319 ] 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "subsystem": "sock", 00:17:40.319 "config": [ 00:17:40.319 { 00:17:40.319 "method": "sock_impl_set_options", 00:17:40.319 "params": { 00:17:40.319 "impl_name": "posix", 00:17:40.319 "recv_buf_size": 2097152, 00:17:40.319 "send_buf_size": 2097152, 00:17:40.319 "enable_recv_pipe": true, 00:17:40.319 "enable_quickack": false, 00:17:40.319 "enable_placement_id": 0, 00:17:40.319 "enable_zerocopy_send_server": true, 00:17:40.319 "enable_zerocopy_send_client": false, 00:17:40.319 "zerocopy_threshold": 0, 00:17:40.319 "tls_version": 0, 00:17:40.319 "enable_ktls": false 00:17:40.319 } 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "method": "sock_impl_set_options", 00:17:40.319 "params": { 00:17:40.319 "impl_name": "ssl", 00:17:40.319 "recv_buf_size": 4096, 00:17:40.319 "send_buf_size": 4096, 00:17:40.319 "enable_recv_pipe": true, 00:17:40.319 "enable_quickack": false, 00:17:40.319 "enable_placement_id": 0, 00:17:40.319 "enable_zerocopy_send_server": true, 00:17:40.319 "enable_zerocopy_send_client": false, 00:17:40.319 "zerocopy_threshold": 0, 00:17:40.319 "tls_version": 0, 00:17:40.319 "enable_ktls": false 00:17:40.319 } 00:17:40.319 } 00:17:40.319 ] 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "subsystem": "vmd", 00:17:40.319 "config": [] 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "subsystem": "accel", 00:17:40.319 "config": [ 00:17:40.319 { 00:17:40.319 "method": "accel_set_options", 00:17:40.319 "params": { 00:17:40.319 "small_cache_size": 128, 00:17:40.319 "large_cache_size": 16, 00:17:40.319 "task_count": 2048, 00:17:40.319 "sequence_count": 2048, 00:17:40.319 "buf_count": 2048 00:17:40.319 } 00:17:40.319 } 00:17:40.319 ] 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "subsystem": "bdev", 00:17:40.319 "config": [ 00:17:40.319 { 00:17:40.319 "method": "bdev_set_options", 00:17:40.319 "params": { 00:17:40.319 "bdev_io_pool_size": 65535, 00:17:40.319 "bdev_io_cache_size": 256, 00:17:40.319 "bdev_auto_examine": true, 00:17:40.319 "iobuf_small_cache_size": 128, 00:17:40.319 "iobuf_large_cache_size": 16 00:17:40.319 } 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "method": "bdev_raid_set_options", 00:17:40.319 "params": { 00:17:40.319 "process_window_size_kb": 1024 00:17:40.319 } 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "method": "bdev_iscsi_set_options", 00:17:40.319 "params": { 00:17:40.319 "timeout_sec": 30 00:17:40.319 } 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "method": "bdev_nvme_set_options", 00:17:40.319 "params": { 00:17:40.319 "action_on_timeout": "none", 00:17:40.319 "timeout_us": 0, 00:17:40.319 "timeout_admin_us": 0, 00:17:40.319 "keep_alive_timeout_ms": 10000, 00:17:40.319 "transport_retry_count": 4, 00:17:40.319 "arbitration_burst": 0, 00:17:40.319 "low_priority_weight": 0, 00:17:40.319 "medium_priority_weight": 0, 00:17:40.319 "high_priority_weight": 0, 00:17:40.319 "nvme_adminq_poll_period_us": 10000, 00:17:40.319 "nvme_ioq_poll_period_us": 0, 00:17:40.319 "io_queue_requests": 512, 00:17:40.319 "delay_cmd_submit": true, 00:17:40.319 "bdev_retry_count": 3, 00:17:40.319 "transport_ack_timeout": 0, 00:17:40.319 "ctrlr_loss_timeout_sec": 0, 00:17:40.319 "reconnect_delay_sec": 0, 00:17:40.319 "fast_io_fail_timeout_sec": 0, 00:17:40.319 "generate_uuids": false, 00:17:40.319 "transport_tos": 0, 00:17:40.319 "io_path_stat": false, 00:17:40.319 "allow_accel_sequence": false 00:17:40.319 } 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "method": "bdev_nvme_attach_controller", 00:17:40.319 "params": { 00:17:40.319 "name": "TLSTEST", 00:17:40.319 "trtype": "TCP", 00:17:40.319 "adrfam": "IPv4", 00:17:40.319 "traddr": "10.0.0.2", 00:17:40.319 "trsvcid": "4420", 00:17:40.319 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.319 "prchk_reftag": false, 00:17:40.319 "prchk_guard": false, 00:17:40.319 "ctrlr_loss_timeout_sec": 0, 00:17:40.319 "reconnect_delay_sec": 0, 00:17:40.319 "fast_io_fail_timeout_sec": 0, 00:17:40.319 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:40.319 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:40.319 "hdgst": false, 00:17:40.319 "ddgst": false 00:17:40.319 } 00:17:40.319 }, 00:17:40.319 { 00:17:40.319 "method": "bdev_nvme_set_hotplug", 00:17:40.319 "params": { 00:17:40.319 "period_us": 100000, 00:17:40.320 "enable": false 00:17:40.320 } 00:17:40.320 }, 00:17:40.320 { 00:17:40.320 "method": "bdev_wait_for_examine" 00:17:40.320 } 00:17:40.320 ] 00:17:40.320 }, 00:17:40.320 { 00:17:40.320 "subsystem": "nbd", 00:17:40.320 "config": [] 00:17:40.320 } 00:17:40.320 ] 00:17:40.320 }' 00:17:40.320 12:31:34 -- target/tls.sh@208 -- # killprocess 1289572 00:17:40.320 12:31:34 -- common/autotest_common.sh@926 -- # '[' -z 1289572 ']' 00:17:40.320 12:31:34 -- common/autotest_common.sh@930 -- # kill -0 1289572 00:17:40.320 12:31:34 -- common/autotest_common.sh@931 -- # uname 00:17:40.320 12:31:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:40.320 12:31:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1289572 00:17:40.320 12:31:34 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:40.320 12:31:34 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:40.320 12:31:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1289572' 00:17:40.320 killing process with pid 1289572 00:17:40.320 12:31:34 -- common/autotest_common.sh@945 -- # kill 1289572 00:17:40.320 Received shutdown signal, test time was about 10.000000 seconds 00:17:40.320 00:17:40.320 Latency(us) 00:17:40.320 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:40.320 =================================================================================================================== 00:17:40.320 Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:40.320 12:31:34 -- common/autotest_common.sh@950 -- # wait 1289572 00:17:40.580 12:31:34 -- target/tls.sh@209 -- # killprocess 1289258 00:17:40.580 12:31:34 -- common/autotest_common.sh@926 -- # '[' -z 1289258 ']' 00:17:40.580 12:31:34 -- common/autotest_common.sh@930 -- # kill -0 1289258 00:17:40.580 12:31:34 -- common/autotest_common.sh@931 -- # uname 00:17:40.580 12:31:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:40.580 12:31:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1289258 00:17:40.580 12:31:34 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:40.580 12:31:34 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:40.580 12:31:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1289258' 00:17:40.580 killing process with pid 1289258 00:17:40.580 12:31:34 -- common/autotest_common.sh@945 -- # kill 1289258 00:17:40.580 12:31:34 -- common/autotest_common.sh@950 -- # wait 1289258 00:17:40.840 12:31:34 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:17:40.840 12:31:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:40.840 12:31:34 -- target/tls.sh@212 -- # echo '{ 00:17:40.840 "subsystems": [ 00:17:40.840 { 00:17:40.840 "subsystem": "iobuf", 00:17:40.840 "config": [ 00:17:40.840 { 00:17:40.840 "method": "iobuf_set_options", 00:17:40.840 "params": { 00:17:40.840 "small_pool_count": 8192, 00:17:40.840 "large_pool_count": 1024, 00:17:40.840 "small_bufsize": 8192, 00:17:40.840 "large_bufsize": 135168 00:17:40.840 } 00:17:40.840 } 00:17:40.840 ] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "sock", 00:17:40.840 "config": [ 00:17:40.840 { 00:17:40.840 "method": "sock_impl_set_options", 00:17:40.840 "params": { 00:17:40.840 "impl_name": "posix", 00:17:40.840 "recv_buf_size": 2097152, 00:17:40.840 "send_buf_size": 2097152, 00:17:40.840 "enable_recv_pipe": true, 00:17:40.840 "enable_quickack": false, 00:17:40.840 "enable_placement_id": 0, 00:17:40.840 "enable_zerocopy_send_server": true, 00:17:40.840 "enable_zerocopy_send_client": false, 00:17:40.840 "zerocopy_threshold": 0, 00:17:40.840 "tls_version": 0, 00:17:40.840 "enable_ktls": false 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "sock_impl_set_options", 00:17:40.840 "params": { 00:17:40.840 "impl_name": "ssl", 00:17:40.840 "recv_buf_size": 4096, 00:17:40.840 "send_buf_size": 4096, 00:17:40.840 "enable_recv_pipe": true, 00:17:40.840 "enable_quickack": false, 00:17:40.840 "enable_placement_id": 0, 00:17:40.840 "enable_zerocopy_send_server": true, 00:17:40.840 "enable_zerocopy_send_client": false, 00:17:40.840 "zerocopy_threshold": 0, 00:17:40.840 "tls_version": 0, 00:17:40.840 "enable_ktls": false 00:17:40.840 } 00:17:40.840 } 00:17:40.840 ] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "vmd", 00:17:40.840 "config": [] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "accel", 00:17:40.840 "config": [ 00:17:40.840 { 00:17:40.840 "method": "accel_set_options", 00:17:40.840 "params": { 00:17:40.840 "small_cache_size": 128, 00:17:40.840 "large_cache_size": 16, 00:17:40.840 "task_count": 2048, 00:17:40.840 "sequence_count": 2048, 00:17:40.840 "buf_count": 2048 00:17:40.840 } 00:17:40.840 } 00:17:40.840 ] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "bdev", 00:17:40.840 "config": [ 00:17:40.840 { 00:17:40.840 "method": "bdev_set_options", 00:17:40.840 "params": { 00:17:40.840 "bdev_io_pool_size": 65535, 00:17:40.840 "bdev_io_cache_size": 256, 00:17:40.840 "bdev_auto_examine": true, 00:17:40.840 "iobuf_small_cache_size": 128, 00:17:40.840 "iobuf_large_cache_size": 16 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "bdev_raid_set_options", 00:17:40.840 "params": { 00:17:40.840 "process_window_size_kb": 1024 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "bdev_iscsi_set_options", 00:17:40.840 "params": { 00:17:40.840 "timeout_sec": 30 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "bdev_nvme_set_options", 00:17:40.840 "params": { 00:17:40.840 "action_on_timeout": "none", 00:17:40.840 "timeout_us": 0, 00:17:40.840 "timeout_admin_us": 0, 00:17:40.840 "keep_alive_timeout_ms": 10000, 00:17:40.840 "transport_retry_count": 4, 00:17:40.840 "arbitration_burst": 0, 00:17:40.840 "low_priority_weight": 0, 00:17:40.840 "medium_priority_weight": 0, 00:17:40.840 "high_priority_weight": 0, 00:17:40.840 "nvme_adminq_poll_period_us": 10000, 00:17:40.840 "nvme_ioq_poll_period_us": 0, 00:17:40.840 "io_queue_requests": 0, 00:17:40.840 "delay_cmd_submit": true, 00:17:40.840 "bdev_retry_count": 3, 00:17:40.840 "transport_ack_timeout": 0, 00:17:40.840 "ctrlr_loss_timeout_sec": 0, 00:17:40.840 "reconnect_delay_sec": 0, 00:17:40.840 "fast_io_fail_timeout_sec": 0, 00:17:40.840 "generate_uuids": false, 00:17:40.840 "transport_tos": 0, 00:17:40.840 "io_path_stat": false, 00:17:40.840 "allow_accel_sequence": false 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "bdev_nvme_set_hotplug", 00:17:40.840 "params": { 00:17:40.840 "period_us": 100000, 00:17:40.840 "enable": false 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "bdev_malloc_create", 00:17:40.840 "params": { 00:17:40.840 "name": "malloc0", 00:17:40.840 "num_blocks": 8192, 00:17:40.840 "block_size": 4096, 00:17:40.840 "physical_block_size": 4096, 00:17:40.840 "uuid": "8c08ea3b-c55f-451c-8bd4-cf820f8af14a", 00:17:40.840 "optimal_io_boundary": 0 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "bdev_wait_for_examine" 00:17:40.840 } 00:17:40.840 ] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "nbd", 00:17:40.840 "config": [] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "scheduler", 00:17:40.840 "config": [ 00:17:40.840 { 00:17:40.840 "method": "framework_set_scheduler", 00:17:40.840 "params": { 00:17:40.840 "name": "static" 00:17:40.840 } 00:17:40.840 } 00:17:40.840 ] 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "subsystem": "nvmf", 00:17:40.840 "config": [ 00:17:40.840 { 00:17:40.840 "method": "nvmf_set_config", 00:17:40.840 "params": { 00:17:40.840 "discovery_filter": "match_any", 00:17:40.840 "admin_cmd_passthru": { 00:17:40.840 "identify_ctrlr": false 00:17:40.840 } 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "nvmf_set_max_subsystems", 00:17:40.840 "params": { 00:17:40.840 "max_subsystems": 1024 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "nvmf_set_crdt", 00:17:40.840 "params": { 00:17:40.840 "crdt1": 0, 00:17:40.840 "crdt2": 0, 00:17:40.840 "crdt3": 0 00:17:40.840 } 00:17:40.840 }, 00:17:40.840 { 00:17:40.840 "method": "nvmf_create_transport", 00:17:40.840 "params": { 00:17:40.840 "trtype": "TCP", 00:17:40.840 "max_queue_depth": 128, 00:17:40.840 "max_io_qpairs_per_ctrlr": 127, 00:17:40.840 "in_capsule_data_size": 4096, 00:17:40.840 "max_io_size": 131072, 00:17:40.840 "io_unit_size": 131072, 00:17:40.841 "max_aq_depth": 128, 00:17:40.841 "num_shared_buffers": 511, 00:17:40.841 "buf_cache_size": 4294967295, 00:17:40.841 "dif_insert_or_strip": false, 00:17:40.841 "zcopy": false, 00:17:40.841 "c2h_success": false, 00:17:40.841 "sock_priority": 0, 00:17:40.841 "abort_timeout_sec": 1 00:17:40.841 } 00:17:40.841 }, 00:17:40.841 { 00:17:40.841 "method": "nvmf_create_subsystem", 00:17:40.841 "params": { 00:17:40.841 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.841 "allow_any_host": false, 00:17:40.841 "serial_number": "SPDK00000000000001", 00:17:40.841 "model_number": "SPDK bdev Controller", 00:17:40.841 "max_namespaces": 10, 00:17:40.841 "min_cntlid": 1, 00:17:40.841 "max_cntlid": 65519, 00:17:40.841 "ana_reporting": false 00:17:40.841 } 00:17:40.841 }, 00:17:40.841 { 00:17:40.841 "method": "nvmf_subsystem_add_host", 00:17:40.841 "params": { 00:17:40.841 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.841 "host": "nqn.2016-06.io.spdk:host1", 00:17:40.841 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:17:40.841 } 00:17:40.841 }, 00:17:40.841 { 00:17:40.841 "method": "nvmf_subsystem_add_ns", 00:17:40.841 "params": { 00:17:40.841 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.841 "namespace": { 00:17:40.841 "nsid": 1, 00:17:40.841 "bdev_name": "malloc0", 00:17:40.841 "nguid": "8C08EA3BC55F451C8BD4CF820F8AF14A", 00:17:40.841 "uuid": "8c08ea3b-c55f-451c-8bd4-cf820f8af14a" 00:17:40.841 } 00:17:40.841 } 00:17:40.841 }, 00:17:40.841 { 00:17:40.841 "method": "nvmf_subsystem_add_listener", 00:17:40.841 "params": { 00:17:40.841 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:40.841 "listen_address": { 00:17:40.841 "trtype": "TCP", 00:17:40.841 "adrfam": "IPv4", 00:17:40.841 "traddr": "10.0.0.2", 00:17:40.841 "trsvcid": "4420" 00:17:40.841 }, 00:17:40.841 "secure_channel": true 00:17:40.841 } 00:17:40.841 } 00:17:40.841 ] 00:17:40.841 } 00:17:40.841 ] 00:17:40.841 }' 00:17:40.841 12:31:34 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:40.841 12:31:34 -- common/autotest_common.sh@10 -- # set +x 00:17:40.841 12:31:34 -- nvmf/common.sh@469 -- # nvmfpid=1289870 00:17:40.841 12:31:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:17:40.841 12:31:34 -- nvmf/common.sh@470 -- # waitforlisten 1289870 00:17:40.841 12:31:34 -- common/autotest_common.sh@819 -- # '[' -z 1289870 ']' 00:17:40.841 12:31:34 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:40.841 12:31:34 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:40.841 12:31:34 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:40.841 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:40.841 12:31:34 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:40.841 12:31:34 -- common/autotest_common.sh@10 -- # set +x 00:17:41.099 [2024-07-12 12:31:34.765478] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:41.099 [2024-07-12 12:31:34.765571] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:41.099 EAL: No free 2048 kB hugepages reported on node 1 00:17:41.099 [2024-07-12 12:31:34.835605] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:41.099 [2024-07-12 12:31:34.950261] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:41.099 [2024-07-12 12:31:34.950422] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:41.099 [2024-07-12 12:31:34.950439] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:41.099 [2024-07-12 12:31:34.950451] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:41.099 [2024-07-12 12:31:34.950485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:41.358 [2024-07-12 12:31:35.175617] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:41.358 [2024-07-12 12:31:35.207664] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:41.358 [2024-07-12 12:31:35.207897] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:41.922 12:31:35 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:41.923 12:31:35 -- common/autotest_common.sh@852 -- # return 0 00:17:41.923 12:31:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:41.923 12:31:35 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:41.923 12:31:35 -- common/autotest_common.sh@10 -- # set +x 00:17:41.923 12:31:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:41.923 12:31:35 -- target/tls.sh@216 -- # bdevperf_pid=1290026 00:17:41.923 12:31:35 -- target/tls.sh@217 -- # waitforlisten 1290026 /var/tmp/bdevperf.sock 00:17:41.923 12:31:35 -- common/autotest_common.sh@819 -- # '[' -z 1290026 ']' 00:17:41.923 12:31:35 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:41.923 12:31:35 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:17:41.923 12:31:35 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:41.923 12:31:35 -- target/tls.sh@213 -- # echo '{ 00:17:41.923 "subsystems": [ 00:17:41.923 { 00:17:41.923 "subsystem": "iobuf", 00:17:41.923 "config": [ 00:17:41.923 { 00:17:41.923 "method": "iobuf_set_options", 00:17:41.923 "params": { 00:17:41.923 "small_pool_count": 8192, 00:17:41.923 "large_pool_count": 1024, 00:17:41.923 "small_bufsize": 8192, 00:17:41.923 "large_bufsize": 135168 00:17:41.923 } 00:17:41.923 } 00:17:41.923 ] 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "subsystem": "sock", 00:17:41.923 "config": [ 00:17:41.923 { 00:17:41.923 "method": "sock_impl_set_options", 00:17:41.923 "params": { 00:17:41.923 "impl_name": "posix", 00:17:41.923 "recv_buf_size": 2097152, 00:17:41.923 "send_buf_size": 2097152, 00:17:41.923 "enable_recv_pipe": true, 00:17:41.923 "enable_quickack": false, 00:17:41.923 "enable_placement_id": 0, 00:17:41.923 "enable_zerocopy_send_server": true, 00:17:41.923 "enable_zerocopy_send_client": false, 00:17:41.923 "zerocopy_threshold": 0, 00:17:41.923 "tls_version": 0, 00:17:41.923 "enable_ktls": false 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "sock_impl_set_options", 00:17:41.923 "params": { 00:17:41.923 "impl_name": "ssl", 00:17:41.923 "recv_buf_size": 4096, 00:17:41.923 "send_buf_size": 4096, 00:17:41.923 "enable_recv_pipe": true, 00:17:41.923 "enable_quickack": false, 00:17:41.923 "enable_placement_id": 0, 00:17:41.923 "enable_zerocopy_send_server": true, 00:17:41.923 "enable_zerocopy_send_client": false, 00:17:41.923 "zerocopy_threshold": 0, 00:17:41.923 "tls_version": 0, 00:17:41.923 "enable_ktls": false 00:17:41.923 } 00:17:41.923 } 00:17:41.923 ] 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "subsystem": "vmd", 00:17:41.923 "config": [] 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "subsystem": "accel", 00:17:41.923 "config": [ 00:17:41.923 { 00:17:41.923 "method": "accel_set_options", 00:17:41.923 "params": { 00:17:41.923 "small_cache_size": 128, 00:17:41.923 "large_cache_size": 16, 00:17:41.923 "task_count": 2048, 00:17:41.923 "sequence_count": 2048, 00:17:41.923 "buf_count": 2048 00:17:41.923 } 00:17:41.923 } 00:17:41.923 ] 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "subsystem": "bdev", 00:17:41.923 "config": [ 00:17:41.923 { 00:17:41.923 "method": "bdev_set_options", 00:17:41.923 "params": { 00:17:41.923 "bdev_io_pool_size": 65535, 00:17:41.923 "bdev_io_cache_size": 256, 00:17:41.923 "bdev_auto_examine": true, 00:17:41.923 "iobuf_small_cache_size": 128, 00:17:41.923 "iobuf_large_cache_size": 16 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "bdev_raid_set_options", 00:17:41.923 "params": { 00:17:41.923 "process_window_size_kb": 1024 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "bdev_iscsi_set_options", 00:17:41.923 "params": { 00:17:41.923 "timeout_sec": 30 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "bdev_nvme_set_options", 00:17:41.923 "params": { 00:17:41.923 "action_on_timeout": "none", 00:17:41.923 "timeout_us": 0, 00:17:41.923 "timeout_admin_us": 0, 00:17:41.923 "keep_alive_timeout_ms": 10000, 00:17:41.923 "transport_retry_count": 4, 00:17:41.923 "arbitration_burst": 0, 00:17:41.923 "low_priority_weight": 0, 00:17:41.923 "medium_priority_weight": 0, 00:17:41.923 "high_priority_weight": 0, 00:17:41.923 "nvme_adminq_poll_period_us": 10000, 00:17:41.923 "nvme_ioq_poll_period_us": 0, 00:17:41.923 "io_queue_requests": 512, 00:17:41.923 "delay_cmd_submit": true, 00:17:41.923 "bdev_retry_count": 3, 00:17:41.923 "transport_ack_timeout": 0, 00:17:41.923 "ctrlr_loss_timeout_sec": 0, 00:17:41.923 "reconnect_delay_sec": 0, 00:17:41.923 "fast_io_fail_timeout_sec": 0, 00:17:41.923 "generate_uuids": false, 00:17:41.923 "transport_tos": 0, 00:17:41.923 "io_path_stat": false, 00:17:41.923 "allow_accel_sequence": false 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "bdev_nvme_attach_controller", 00:17:41.923 "params": { 00:17:41.923 "name": "TLSTEST", 00:17:41.923 "trtype": "TCP", 00:17:41.923 "adrfam": "IPv4", 00:17:41.923 "traddr": "10.0.0.2", 00:17:41.923 "trsvcid": "4420", 00:17:41.923 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:41.923 "prchk_reftag": false, 00:17:41.923 "prchk_guard": false, 00:17:41.923 "ctrlr_loss_timeout_sec": 0, 00:17:41.923 "reconnect_delay_sec": 0, 00:17:41.923 "fast_io_fail_timeout_sec": 0, 00:17:41.923 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:17:41.923 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:41.923 "hdgst": false, 00:17:41.923 "ddgst": false 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "bdev_nvme_set_hotplug", 00:17:41.923 "params": { 00:17:41.923 "period_us": 100000, 00:17:41.923 "enable": false 00:17:41.923 } 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "method": "bdev_wait_for_examine" 00:17:41.923 } 00:17:41.923 ] 00:17:41.923 }, 00:17:41.923 { 00:17:41.923 "subsystem": "nbd", 00:17:41.923 "config": [] 00:17:41.923 } 00:17:41.923 ] 00:17:41.923 }' 00:17:41.923 12:31:35 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:41.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:41.923 12:31:35 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:41.923 12:31:35 -- common/autotest_common.sh@10 -- # set +x 00:17:42.181 [2024-07-12 12:31:35.844984] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:42.181 [2024-07-12 12:31:35.845090] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1290026 ] 00:17:42.181 EAL: No free 2048 kB hugepages reported on node 1 00:17:42.181 [2024-07-12 12:31:35.905107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:42.181 [2024-07-12 12:31:36.014469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:42.439 [2024-07-12 12:31:36.170717] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:43.006 12:31:36 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:43.006 12:31:36 -- common/autotest_common.sh@852 -- # return 0 00:17:43.006 12:31:36 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:43.006 Running I/O for 10 seconds... 00:17:55.233 00:17:55.233 Latency(us) 00:17:55.233 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:55.233 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:55.233 Verification LBA range: start 0x0 length 0x2000 00:17:55.233 TLSTESTn1 : 10.02 4500.21 17.58 0.00 0.00 28401.41 4854.52 44661.57 00:17:55.233 =================================================================================================================== 00:17:55.233 Total : 4500.21 17.58 0.00 0.00 28401.41 4854.52 44661.57 00:17:55.233 0 00:17:55.233 12:31:46 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:55.233 12:31:46 -- target/tls.sh@223 -- # killprocess 1290026 00:17:55.233 12:31:46 -- common/autotest_common.sh@926 -- # '[' -z 1290026 ']' 00:17:55.233 12:31:46 -- common/autotest_common.sh@930 -- # kill -0 1290026 00:17:55.233 12:31:46 -- common/autotest_common.sh@931 -- # uname 00:17:55.233 12:31:46 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:55.233 12:31:46 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1290026 00:17:55.233 12:31:46 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:17:55.233 12:31:46 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:17:55.233 12:31:46 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1290026' 00:17:55.233 killing process with pid 1290026 00:17:55.233 12:31:46 -- common/autotest_common.sh@945 -- # kill 1290026 00:17:55.233 Received shutdown signal, test time was about 10.000000 seconds 00:17:55.233 00:17:55.233 Latency(us) 00:17:55.233 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:55.233 =================================================================================================================== 00:17:55.233 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:55.233 12:31:46 -- common/autotest_common.sh@950 -- # wait 1290026 00:17:55.233 12:31:47 -- target/tls.sh@224 -- # killprocess 1289870 00:17:55.233 12:31:47 -- common/autotest_common.sh@926 -- # '[' -z 1289870 ']' 00:17:55.233 12:31:47 -- common/autotest_common.sh@930 -- # kill -0 1289870 00:17:55.233 12:31:47 -- common/autotest_common.sh@931 -- # uname 00:17:55.233 12:31:47 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:17:55.233 12:31:47 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1289870 00:17:55.233 12:31:47 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:17:55.233 12:31:47 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:17:55.233 12:31:47 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1289870' 00:17:55.233 killing process with pid 1289870 00:17:55.233 12:31:47 -- common/autotest_common.sh@945 -- # kill 1289870 00:17:55.233 12:31:47 -- common/autotest_common.sh@950 -- # wait 1289870 00:17:55.233 12:31:47 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:17:55.233 12:31:47 -- target/tls.sh@227 -- # cleanup 00:17:55.233 12:31:47 -- target/tls.sh@15 -- # process_shm --id 0 00:17:55.233 12:31:47 -- common/autotest_common.sh@796 -- # type=--id 00:17:55.233 12:31:47 -- common/autotest_common.sh@797 -- # id=0 00:17:55.233 12:31:47 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:17:55.233 12:31:47 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:55.233 12:31:47 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:17:55.233 12:31:47 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:17:55.233 12:31:47 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:17:55.233 12:31:47 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:55.233 nvmf_trace.0 00:17:55.233 12:31:47 -- common/autotest_common.sh@811 -- # return 0 00:17:55.233 12:31:47 -- target/tls.sh@16 -- # killprocess 1290026 00:17:55.233 12:31:47 -- common/autotest_common.sh@926 -- # '[' -z 1290026 ']' 00:17:55.233 12:31:47 -- common/autotest_common.sh@930 -- # kill -0 1290026 00:17:55.233 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1290026) - No such process 00:17:55.233 12:31:47 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1290026 is not found' 00:17:55.233 Process with pid 1290026 is not found 00:17:55.233 12:31:47 -- target/tls.sh@17 -- # nvmftestfini 00:17:55.233 12:31:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:55.233 12:31:47 -- nvmf/common.sh@116 -- # sync 00:17:55.233 12:31:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:55.233 12:31:47 -- nvmf/common.sh@119 -- # set +e 00:17:55.233 12:31:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:55.233 12:31:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:55.233 rmmod nvme_tcp 00:17:55.233 rmmod nvme_fabrics 00:17:55.233 rmmod nvme_keyring 00:17:55.233 12:31:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:55.233 12:31:47 -- nvmf/common.sh@123 -- # set -e 00:17:55.233 12:31:47 -- nvmf/common.sh@124 -- # return 0 00:17:55.233 12:31:47 -- nvmf/common.sh@477 -- # '[' -n 1289870 ']' 00:17:55.233 12:31:47 -- nvmf/common.sh@478 -- # killprocess 1289870 00:17:55.233 12:31:47 -- common/autotest_common.sh@926 -- # '[' -z 1289870 ']' 00:17:55.233 12:31:47 -- common/autotest_common.sh@930 -- # kill -0 1289870 00:17:55.233 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1289870) - No such process 00:17:55.233 12:31:47 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1289870 is not found' 00:17:55.233 Process with pid 1289870 is not found 00:17:55.233 12:31:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:55.233 12:31:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:55.233 12:31:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:55.233 12:31:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:55.233 12:31:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:55.233 12:31:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:55.233 12:31:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:55.233 12:31:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:55.802 12:31:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:55.802 12:31:49 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:55.802 00:17:55.802 real 1m15.602s 00:17:55.802 user 1m58.546s 00:17:55.802 sys 0m23.933s 00:17:55.802 12:31:49 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:17:55.802 12:31:49 -- common/autotest_common.sh@10 -- # set +x 00:17:55.802 ************************************ 00:17:55.802 END TEST nvmf_tls 00:17:55.802 ************************************ 00:17:55.802 12:31:49 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:55.802 12:31:49 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:17:55.802 12:31:49 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:17:55.802 12:31:49 -- common/autotest_common.sh@10 -- # set +x 00:17:55.802 ************************************ 00:17:55.802 START TEST nvmf_fips 00:17:55.802 ************************************ 00:17:55.802 12:31:49 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:56.063 * Looking for test storage... 00:17:56.063 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:17:56.063 12:31:49 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:56.063 12:31:49 -- nvmf/common.sh@7 -- # uname -s 00:17:56.063 12:31:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:56.063 12:31:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:56.063 12:31:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:56.063 12:31:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:56.063 12:31:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:56.063 12:31:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:56.063 12:31:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:56.063 12:31:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:56.063 12:31:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:56.063 12:31:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:56.063 12:31:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:56.063 12:31:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:56.063 12:31:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:56.063 12:31:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:56.063 12:31:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:56.063 12:31:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:56.063 12:31:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:56.063 12:31:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:56.063 12:31:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:56.063 12:31:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.063 12:31:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.063 12:31:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.063 12:31:49 -- paths/export.sh@5 -- # export PATH 00:17:56.063 12:31:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:56.063 12:31:49 -- nvmf/common.sh@46 -- # : 0 00:17:56.063 12:31:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:56.063 12:31:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:56.063 12:31:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:56.063 12:31:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:56.063 12:31:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:56.063 12:31:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:56.063 12:31:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:56.063 12:31:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:56.063 12:31:49 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:56.063 12:31:49 -- fips/fips.sh@89 -- # check_openssl_version 00:17:56.063 12:31:49 -- fips/fips.sh@83 -- # local target=3.0.0 00:17:56.063 12:31:49 -- fips/fips.sh@85 -- # openssl version 00:17:56.063 12:31:49 -- fips/fips.sh@85 -- # awk '{print $2}' 00:17:56.063 12:31:49 -- fips/fips.sh@85 -- # ge 3.0.9 3.0.0 00:17:56.063 12:31:49 -- scripts/common.sh@375 -- # cmp_versions 3.0.9 '>=' 3.0.0 00:17:56.063 12:31:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:56.063 12:31:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:56.063 12:31:49 -- scripts/common.sh@335 -- # IFS=.-: 00:17:56.063 12:31:49 -- scripts/common.sh@335 -- # read -ra ver1 00:17:56.063 12:31:49 -- scripts/common.sh@336 -- # IFS=.-: 00:17:56.063 12:31:49 -- scripts/common.sh@336 -- # read -ra ver2 00:17:56.063 12:31:49 -- scripts/common.sh@337 -- # local 'op=>=' 00:17:56.063 12:31:49 -- scripts/common.sh@339 -- # ver1_l=3 00:17:56.063 12:31:49 -- scripts/common.sh@340 -- # ver2_l=3 00:17:56.063 12:31:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:56.063 12:31:49 -- scripts/common.sh@343 -- # case "$op" in 00:17:56.063 12:31:49 -- scripts/common.sh@347 -- # : 1 00:17:56.063 12:31:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:56.063 12:31:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:56.063 12:31:49 -- scripts/common.sh@364 -- # decimal 3 00:17:56.063 12:31:49 -- scripts/common.sh@352 -- # local d=3 00:17:56.063 12:31:49 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:56.063 12:31:49 -- scripts/common.sh@354 -- # echo 3 00:17:56.063 12:31:49 -- scripts/common.sh@364 -- # ver1[v]=3 00:17:56.063 12:31:49 -- scripts/common.sh@365 -- # decimal 3 00:17:56.063 12:31:49 -- scripts/common.sh@352 -- # local d=3 00:17:56.063 12:31:49 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:56.063 12:31:49 -- scripts/common.sh@354 -- # echo 3 00:17:56.063 12:31:49 -- scripts/common.sh@365 -- # ver2[v]=3 00:17:56.063 12:31:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:56.063 12:31:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:56.063 12:31:49 -- scripts/common.sh@363 -- # (( v++ )) 00:17:56.063 12:31:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:56.063 12:31:49 -- scripts/common.sh@364 -- # decimal 0 00:17:56.063 12:31:49 -- scripts/common.sh@352 -- # local d=0 00:17:56.063 12:31:49 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:56.063 12:31:49 -- scripts/common.sh@354 -- # echo 0 00:17:56.063 12:31:49 -- scripts/common.sh@364 -- # ver1[v]=0 00:17:56.063 12:31:49 -- scripts/common.sh@365 -- # decimal 0 00:17:56.063 12:31:49 -- scripts/common.sh@352 -- # local d=0 00:17:56.063 12:31:49 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:56.063 12:31:49 -- scripts/common.sh@354 -- # echo 0 00:17:56.063 12:31:49 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:56.063 12:31:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:56.063 12:31:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:56.063 12:31:49 -- scripts/common.sh@363 -- # (( v++ )) 00:17:56.063 12:31:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:56.063 12:31:49 -- scripts/common.sh@364 -- # decimal 9 00:17:56.063 12:31:49 -- scripts/common.sh@352 -- # local d=9 00:17:56.063 12:31:49 -- scripts/common.sh@353 -- # [[ 9 =~ ^[0-9]+$ ]] 00:17:56.063 12:31:49 -- scripts/common.sh@354 -- # echo 9 00:17:56.063 12:31:49 -- scripts/common.sh@364 -- # ver1[v]=9 00:17:56.063 12:31:49 -- scripts/common.sh@365 -- # decimal 0 00:17:56.063 12:31:49 -- scripts/common.sh@352 -- # local d=0 00:17:56.063 12:31:49 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:56.063 12:31:49 -- scripts/common.sh@354 -- # echo 0 00:17:56.063 12:31:49 -- scripts/common.sh@365 -- # ver2[v]=0 00:17:56.063 12:31:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:56.063 12:31:49 -- scripts/common.sh@366 -- # return 0 00:17:56.063 12:31:49 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:17:56.063 12:31:49 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:56.063 12:31:49 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:17:56.063 12:31:49 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:56.063 12:31:49 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:56.063 12:31:49 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:17:56.063 12:31:49 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:17:56.064 12:31:49 -- fips/fips.sh@105 -- # export OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:17:56.064 12:31:49 -- fips/fips.sh@105 -- # OPENSSL_FORCE_FIPS_MODE=build_openssl_config 00:17:56.064 12:31:49 -- fips/fips.sh@114 -- # build_openssl_config 00:17:56.064 12:31:49 -- fips/fips.sh@37 -- # cat 00:17:56.064 12:31:49 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:17:56.064 12:31:49 -- fips/fips.sh@58 -- # cat - 00:17:56.064 12:31:49 -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:56.064 12:31:49 -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:17:56.064 12:31:49 -- fips/fips.sh@117 -- # mapfile -t providers 00:17:56.064 12:31:49 -- fips/fips.sh@117 -- # OPENSSL_CONF=spdk_fips.conf 00:17:56.064 12:31:49 -- fips/fips.sh@117 -- # openssl list -providers 00:17:56.064 12:31:49 -- fips/fips.sh@117 -- # grep name 00:17:56.064 12:31:49 -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:17:56.064 12:31:49 -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:17:56.064 12:31:49 -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:56.064 12:31:49 -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:17:56.064 12:31:49 -- fips/fips.sh@128 -- # : 00:17:56.064 12:31:49 -- common/autotest_common.sh@640 -- # local es=0 00:17:56.064 12:31:49 -- common/autotest_common.sh@642 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:56.064 12:31:49 -- common/autotest_common.sh@628 -- # local arg=openssl 00:17:56.064 12:31:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:56.064 12:31:49 -- common/autotest_common.sh@632 -- # type -t openssl 00:17:56.064 12:31:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:56.064 12:31:49 -- common/autotest_common.sh@634 -- # type -P openssl 00:17:56.064 12:31:49 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:17:56.064 12:31:49 -- common/autotest_common.sh@634 -- # arg=/usr/bin/openssl 00:17:56.064 12:31:49 -- common/autotest_common.sh@634 -- # [[ -x /usr/bin/openssl ]] 00:17:56.064 12:31:49 -- common/autotest_common.sh@643 -- # openssl md5 /dev/fd/62 00:17:56.064 Error setting digest 00:17:56.064 00B22795857F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:373:Global default library context, Algorithm (MD5 : 97), Properties () 00:17:56.064 00B22795857F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:254: 00:17:56.064 12:31:49 -- common/autotest_common.sh@643 -- # es=1 00:17:56.064 12:31:49 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:17:56.064 12:31:49 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:17:56.064 12:31:49 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:17:56.064 12:31:49 -- fips/fips.sh@131 -- # nvmftestinit 00:17:56.064 12:31:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:56.064 12:31:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:56.064 12:31:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:56.064 12:31:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:56.064 12:31:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:56.064 12:31:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:56.064 12:31:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:56.064 12:31:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:56.064 12:31:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:56.064 12:31:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:56.064 12:31:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:56.064 12:31:49 -- common/autotest_common.sh@10 -- # set +x 00:17:58.601 12:31:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:58.601 12:31:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:58.601 12:31:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:58.601 12:31:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:58.601 12:31:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:58.601 12:31:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:58.601 12:31:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:58.601 12:31:51 -- nvmf/common.sh@294 -- # net_devs=() 00:17:58.601 12:31:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:58.601 12:31:51 -- nvmf/common.sh@295 -- # e810=() 00:17:58.601 12:31:51 -- nvmf/common.sh@295 -- # local -ga e810 00:17:58.601 12:31:51 -- nvmf/common.sh@296 -- # x722=() 00:17:58.601 12:31:51 -- nvmf/common.sh@296 -- # local -ga x722 00:17:58.601 12:31:51 -- nvmf/common.sh@297 -- # mlx=() 00:17:58.601 12:31:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:58.601 12:31:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:58.601 12:31:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:58.601 12:31:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:58.601 12:31:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:58.601 12:31:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:58.601 12:31:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:58.601 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:58.601 12:31:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:58.601 12:31:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:58.601 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:58.601 12:31:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:58.601 12:31:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:58.601 12:31:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:58.601 12:31:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:58.601 12:31:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:58.601 12:31:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:58.601 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:58.601 12:31:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:58.601 12:31:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:58.601 12:31:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:58.601 12:31:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:58.601 12:31:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:58.601 12:31:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:58.601 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:58.601 12:31:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:58.601 12:31:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:58.601 12:31:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:58.601 12:31:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:58.601 12:31:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:58.601 12:31:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:58.601 12:31:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:58.601 12:31:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:58.601 12:31:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:58.601 12:31:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:58.601 12:31:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:58.601 12:31:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:58.601 12:31:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:58.601 12:31:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:58.601 12:31:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:58.601 12:31:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:58.601 12:31:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:58.601 12:31:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:58.601 12:31:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:58.601 12:31:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:58.601 12:31:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:58.601 12:31:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:58.601 12:31:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:58.601 12:31:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:58.601 12:31:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:58.601 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:58.601 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.140 ms 00:17:58.601 00:17:58.601 --- 10.0.0.2 ping statistics --- 00:17:58.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:58.601 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:17:58.601 12:31:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:58.601 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:58.601 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:17:58.601 00:17:58.601 --- 10.0.0.1 ping statistics --- 00:17:58.601 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:58.601 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:17:58.601 12:31:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:58.601 12:31:52 -- nvmf/common.sh@410 -- # return 0 00:17:58.601 12:31:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:58.601 12:31:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:58.601 12:31:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:58.601 12:31:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:58.601 12:31:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:58.601 12:31:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:58.601 12:31:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:58.602 12:31:52 -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:17:58.602 12:31:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:58.602 12:31:52 -- common/autotest_common.sh@712 -- # xtrace_disable 00:17:58.602 12:31:52 -- common/autotest_common.sh@10 -- # set +x 00:17:58.602 12:31:52 -- nvmf/common.sh@469 -- # nvmfpid=1293485 00:17:58.602 12:31:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:58.602 12:31:52 -- nvmf/common.sh@470 -- # waitforlisten 1293485 00:17:58.602 12:31:52 -- common/autotest_common.sh@819 -- # '[' -z 1293485 ']' 00:17:58.602 12:31:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:58.602 12:31:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:58.602 12:31:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:58.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:58.602 12:31:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:58.602 12:31:52 -- common/autotest_common.sh@10 -- # set +x 00:17:58.602 [2024-07-12 12:31:52.144952] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:58.602 [2024-07-12 12:31:52.145033] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:58.602 EAL: No free 2048 kB hugepages reported on node 1 00:17:58.602 [2024-07-12 12:31:52.209225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:58.602 [2024-07-12 12:31:52.313240] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:58.602 [2024-07-12 12:31:52.313388] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:58.602 [2024-07-12 12:31:52.313406] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:58.602 [2024-07-12 12:31:52.313420] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:58.602 [2024-07-12 12:31:52.313456] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:59.537 12:31:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:17:59.537 12:31:53 -- common/autotest_common.sh@852 -- # return 0 00:17:59.537 12:31:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:59.537 12:31:53 -- common/autotest_common.sh@718 -- # xtrace_disable 00:17:59.537 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:17:59.537 12:31:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:59.537 12:31:53 -- fips/fips.sh@134 -- # trap cleanup EXIT 00:17:59.537 12:31:53 -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:59.537 12:31:53 -- fips/fips.sh@138 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:59.537 12:31:53 -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:59.537 12:31:53 -- fips/fips.sh@140 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:59.537 12:31:53 -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:59.537 12:31:53 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:17:59.537 12:31:53 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:59.537 [2024-07-12 12:31:53.329597] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:59.537 [2024-07-12 12:31:53.345588] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:59.537 [2024-07-12 12:31:53.345807] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:59.537 malloc0 00:17:59.537 12:31:53 -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:59.537 12:31:53 -- fips/fips.sh@148 -- # bdevperf_pid=1293642 00:17:59.537 12:31:53 -- fips/fips.sh@146 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:59.537 12:31:53 -- fips/fips.sh@149 -- # waitforlisten 1293642 /var/tmp/bdevperf.sock 00:17:59.537 12:31:53 -- common/autotest_common.sh@819 -- # '[' -z 1293642 ']' 00:17:59.537 12:31:53 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.537 12:31:53 -- common/autotest_common.sh@824 -- # local max_retries=100 00:17:59.537 12:31:53 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.537 12:31:53 -- common/autotest_common.sh@828 -- # xtrace_disable 00:17:59.537 12:31:53 -- common/autotest_common.sh@10 -- # set +x 00:17:59.796 [2024-07-12 12:31:53.466289] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:17:59.796 [2024-07-12 12:31:53.466385] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1293642 ] 00:17:59.796 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.796 [2024-07-12 12:31:53.531774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.796 [2024-07-12 12:31:53.647346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.733 12:31:54 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:00.733 12:31:54 -- common/autotest_common.sh@852 -- # return 0 00:18:00.734 12:31:54 -- fips/fips.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:00.734 [2024-07-12 12:31:54.610476] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:00.993 TLSTESTn1 00:18:00.993 12:31:54 -- fips/fips.sh@155 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:00.993 Running I/O for 10 seconds... 00:18:10.973 00:18:10.973 Latency(us) 00:18:10.973 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:10.973 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:10.973 Verification LBA range: start 0x0 length 0x2000 00:18:10.973 TLSTESTn1 : 10.01 4653.31 18.18 0.00 0.00 27474.07 2767.08 45049.93 00:18:10.973 =================================================================================================================== 00:18:10.973 Total : 4653.31 18.18 0.00 0.00 27474.07 2767.08 45049.93 00:18:10.973 0 00:18:10.973 12:32:04 -- fips/fips.sh@1 -- # cleanup 00:18:10.973 12:32:04 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:10.973 12:32:04 -- common/autotest_common.sh@796 -- # type=--id 00:18:10.973 12:32:04 -- common/autotest_common.sh@797 -- # id=0 00:18:10.973 12:32:04 -- common/autotest_common.sh@798 -- # '[' --id = --pid ']' 00:18:10.973 12:32:04 -- common/autotest_common.sh@802 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:10.973 12:32:04 -- common/autotest_common.sh@802 -- # shm_files=nvmf_trace.0 00:18:10.973 12:32:04 -- common/autotest_common.sh@804 -- # [[ -z nvmf_trace.0 ]] 00:18:10.973 12:32:04 -- common/autotest_common.sh@808 -- # for n in $shm_files 00:18:10.973 12:32:04 -- common/autotest_common.sh@809 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:10.973 nvmf_trace.0 00:18:11.267 12:32:04 -- common/autotest_common.sh@811 -- # return 0 00:18:11.267 12:32:04 -- fips/fips.sh@16 -- # killprocess 1293642 00:18:11.267 12:32:04 -- common/autotest_common.sh@926 -- # '[' -z 1293642 ']' 00:18:11.267 12:32:04 -- common/autotest_common.sh@930 -- # kill -0 1293642 00:18:11.267 12:32:04 -- common/autotest_common.sh@931 -- # uname 00:18:11.267 12:32:04 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:11.267 12:32:04 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1293642 00:18:11.267 12:32:04 -- common/autotest_common.sh@932 -- # process_name=reactor_2 00:18:11.267 12:32:04 -- common/autotest_common.sh@936 -- # '[' reactor_2 = sudo ']' 00:18:11.267 12:32:04 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1293642' 00:18:11.267 killing process with pid 1293642 00:18:11.267 12:32:04 -- common/autotest_common.sh@945 -- # kill 1293642 00:18:11.267 Received shutdown signal, test time was about 10.000000 seconds 00:18:11.267 00:18:11.267 Latency(us) 00:18:11.267 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:11.267 =================================================================================================================== 00:18:11.267 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:11.267 12:32:04 -- common/autotest_common.sh@950 -- # wait 1293642 00:18:11.526 12:32:05 -- fips/fips.sh@17 -- # nvmftestfini 00:18:11.526 12:32:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:11.526 12:32:05 -- nvmf/common.sh@116 -- # sync 00:18:11.526 12:32:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:11.526 12:32:05 -- nvmf/common.sh@119 -- # set +e 00:18:11.526 12:32:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:11.526 12:32:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:11.526 rmmod nvme_tcp 00:18:11.526 rmmod nvme_fabrics 00:18:11.526 rmmod nvme_keyring 00:18:11.526 12:32:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:11.526 12:32:05 -- nvmf/common.sh@123 -- # set -e 00:18:11.526 12:32:05 -- nvmf/common.sh@124 -- # return 0 00:18:11.526 12:32:05 -- nvmf/common.sh@477 -- # '[' -n 1293485 ']' 00:18:11.526 12:32:05 -- nvmf/common.sh@478 -- # killprocess 1293485 00:18:11.526 12:32:05 -- common/autotest_common.sh@926 -- # '[' -z 1293485 ']' 00:18:11.526 12:32:05 -- common/autotest_common.sh@930 -- # kill -0 1293485 00:18:11.526 12:32:05 -- common/autotest_common.sh@931 -- # uname 00:18:11.526 12:32:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:11.526 12:32:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1293485 00:18:11.526 12:32:05 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:18:11.526 12:32:05 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:18:11.526 12:32:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1293485' 00:18:11.526 killing process with pid 1293485 00:18:11.526 12:32:05 -- common/autotest_common.sh@945 -- # kill 1293485 00:18:11.526 12:32:05 -- common/autotest_common.sh@950 -- # wait 1293485 00:18:11.786 12:32:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:11.786 12:32:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:11.786 12:32:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:11.786 12:32:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:11.786 12:32:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:11.786 12:32:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:11.786 12:32:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:11.786 12:32:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.693 12:32:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:13.693 12:32:07 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:13.952 00:18:13.952 real 0m17.896s 00:18:13.952 user 0m23.365s 00:18:13.952 sys 0m5.777s 00:18:13.952 12:32:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:13.952 12:32:07 -- common/autotest_common.sh@10 -- # set +x 00:18:13.952 ************************************ 00:18:13.952 END TEST nvmf_fips 00:18:13.952 ************************************ 00:18:13.952 12:32:07 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:13.952 12:32:07 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:13.952 12:32:07 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:13.952 12:32:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:13.952 12:32:07 -- common/autotest_common.sh@10 -- # set +x 00:18:13.952 ************************************ 00:18:13.952 START TEST nvmf_fuzz 00:18:13.952 ************************************ 00:18:13.952 12:32:07 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:13.952 * Looking for test storage... 00:18:13.952 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:13.952 12:32:07 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:13.952 12:32:07 -- nvmf/common.sh@7 -- # uname -s 00:18:13.952 12:32:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:13.952 12:32:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:13.952 12:32:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:13.952 12:32:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:13.952 12:32:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:13.952 12:32:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:13.952 12:32:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:13.952 12:32:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:13.952 12:32:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:13.952 12:32:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:13.952 12:32:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:13.952 12:32:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:13.952 12:32:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:13.952 12:32:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:13.952 12:32:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:13.952 12:32:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:13.952 12:32:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:13.952 12:32:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:13.952 12:32:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:13.952 12:32:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.952 12:32:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.953 12:32:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.953 12:32:07 -- paths/export.sh@5 -- # export PATH 00:18:13.953 12:32:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:13.953 12:32:07 -- nvmf/common.sh@46 -- # : 0 00:18:13.953 12:32:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:13.953 12:32:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:13.953 12:32:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:13.953 12:32:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:13.953 12:32:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:13.953 12:32:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:13.953 12:32:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:13.953 12:32:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:13.953 12:32:07 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:13.953 12:32:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:13.953 12:32:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:13.953 12:32:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:13.953 12:32:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:13.953 12:32:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:13.953 12:32:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.953 12:32:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.953 12:32:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:13.953 12:32:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:13.953 12:32:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:13.953 12:32:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:13.953 12:32:07 -- common/autotest_common.sh@10 -- # set +x 00:18:15.854 12:32:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:15.854 12:32:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:15.854 12:32:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:15.854 12:32:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:15.854 12:32:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:15.854 12:32:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:15.854 12:32:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:15.854 12:32:09 -- nvmf/common.sh@294 -- # net_devs=() 00:18:15.854 12:32:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:15.854 12:32:09 -- nvmf/common.sh@295 -- # e810=() 00:18:15.854 12:32:09 -- nvmf/common.sh@295 -- # local -ga e810 00:18:15.854 12:32:09 -- nvmf/common.sh@296 -- # x722=() 00:18:15.854 12:32:09 -- nvmf/common.sh@296 -- # local -ga x722 00:18:15.854 12:32:09 -- nvmf/common.sh@297 -- # mlx=() 00:18:15.854 12:32:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:15.854 12:32:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:15.854 12:32:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:15.854 12:32:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:15.854 12:32:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:15.854 12:32:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:15.854 12:32:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:15.854 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:15.854 12:32:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:15.854 12:32:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:15.854 12:32:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:15.855 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:15.855 12:32:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:15.855 12:32:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:15.855 12:32:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:15.855 12:32:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:15.855 12:32:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:15.855 12:32:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:15.855 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:15.855 12:32:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:15.855 12:32:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:15.855 12:32:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:15.855 12:32:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:15.855 12:32:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:15.855 12:32:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:15.855 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:15.855 12:32:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:15.855 12:32:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:15.855 12:32:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:15.855 12:32:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:15.855 12:32:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:15.855 12:32:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:15.855 12:32:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:15.855 12:32:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:15.855 12:32:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:15.855 12:32:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:15.855 12:32:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:15.855 12:32:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:15.855 12:32:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:15.855 12:32:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:15.855 12:32:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:15.855 12:32:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:15.855 12:32:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:15.855 12:32:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:15.855 12:32:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:15.855 12:32:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:15.855 12:32:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:15.855 12:32:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:15.855 12:32:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:15.855 12:32:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:15.855 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:15.855 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:18:15.855 00:18:15.855 --- 10.0.0.2 ping statistics --- 00:18:15.855 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:15.855 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:18:15.855 12:32:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:15.855 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:15.855 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:18:15.855 00:18:15.855 --- 10.0.0.1 ping statistics --- 00:18:15.855 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:15.855 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:18:15.855 12:32:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:15.855 12:32:09 -- nvmf/common.sh@410 -- # return 0 00:18:15.855 12:32:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:15.855 12:32:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:15.855 12:32:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:15.855 12:32:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:15.855 12:32:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:15.855 12:32:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:15.855 12:32:09 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1296960 00:18:15.855 12:32:09 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:15.855 12:32:09 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:15.855 12:32:09 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1296960 00:18:15.855 12:32:09 -- common/autotest_common.sh@819 -- # '[' -z 1296960 ']' 00:18:15.855 12:32:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:15.855 12:32:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:15.855 12:32:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:15.855 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:15.855 12:32:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:15.855 12:32:09 -- common/autotest_common.sh@10 -- # set +x 00:18:16.789 12:32:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:16.789 12:32:10 -- common/autotest_common.sh@852 -- # return 0 00:18:16.789 12:32:10 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:16.789 12:32:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:16.789 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:18:17.046 12:32:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:17.046 12:32:10 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:17.046 12:32:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:17.046 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:18:17.046 Malloc0 00:18:17.046 12:32:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:17.046 12:32:10 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:17.046 12:32:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:17.046 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:18:17.046 12:32:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:17.046 12:32:10 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:17.046 12:32:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:17.046 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:18:17.046 12:32:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:17.047 12:32:10 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:17.047 12:32:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:17.047 12:32:10 -- common/autotest_common.sh@10 -- # set +x 00:18:17.047 12:32:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:17.047 12:32:10 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:17.047 12:32:10 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:18:49.105 Fuzzing completed. Shutting down the fuzz application 00:18:49.105 00:18:49.105 Dumping successful admin opcodes: 00:18:49.105 8, 9, 10, 24, 00:18:49.105 Dumping successful io opcodes: 00:18:49.105 0, 9, 00:18:49.105 NS: 0x200003aeff00 I/O qp, Total commands completed: 466682, total successful commands: 2695, random_seed: 1914649792 00:18:49.105 NS: 0x200003aeff00 admin qp, Total commands completed: 57696, total successful commands: 462, random_seed: 976220736 00:18:49.105 12:32:41 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:18:49.105 Fuzzing completed. Shutting down the fuzz application 00:18:49.105 00:18:49.105 Dumping successful admin opcodes: 00:18:49.105 24, 00:18:49.105 Dumping successful io opcodes: 00:18:49.105 00:18:49.105 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1467850560 00:18:49.105 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1467979227 00:18:49.105 12:32:42 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:49.105 12:32:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:49.105 12:32:42 -- common/autotest_common.sh@10 -- # set +x 00:18:49.105 12:32:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:49.105 12:32:42 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:18:49.105 12:32:42 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:18:49.105 12:32:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:49.105 12:32:42 -- nvmf/common.sh@116 -- # sync 00:18:49.105 12:32:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:49.105 12:32:42 -- nvmf/common.sh@119 -- # set +e 00:18:49.105 12:32:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:49.105 12:32:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:49.105 rmmod nvme_tcp 00:18:49.105 rmmod nvme_fabrics 00:18:49.105 rmmod nvme_keyring 00:18:49.105 12:32:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:49.105 12:32:42 -- nvmf/common.sh@123 -- # set -e 00:18:49.105 12:32:42 -- nvmf/common.sh@124 -- # return 0 00:18:49.105 12:32:42 -- nvmf/common.sh@477 -- # '[' -n 1296960 ']' 00:18:49.105 12:32:42 -- nvmf/common.sh@478 -- # killprocess 1296960 00:18:49.105 12:32:42 -- common/autotest_common.sh@926 -- # '[' -z 1296960 ']' 00:18:49.105 12:32:42 -- common/autotest_common.sh@930 -- # kill -0 1296960 00:18:49.105 12:32:42 -- common/autotest_common.sh@931 -- # uname 00:18:49.105 12:32:42 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:18:49.105 12:32:42 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1296960 00:18:49.105 12:32:42 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:18:49.105 12:32:42 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:18:49.105 12:32:42 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1296960' 00:18:49.105 killing process with pid 1296960 00:18:49.105 12:32:42 -- common/autotest_common.sh@945 -- # kill 1296960 00:18:49.105 12:32:42 -- common/autotest_common.sh@950 -- # wait 1296960 00:18:49.362 12:32:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:49.362 12:32:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:49.362 12:32:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:49.362 12:32:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:49.362 12:32:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:49.362 12:32:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:49.362 12:32:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:49.362 12:32:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.258 12:32:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:51.258 12:32:45 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:18:51.258 00:18:51.258 real 0m37.514s 00:18:51.258 user 0m51.818s 00:18:51.258 sys 0m15.043s 00:18:51.258 12:32:45 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:18:51.258 12:32:45 -- common/autotest_common.sh@10 -- # set +x 00:18:51.258 ************************************ 00:18:51.258 END TEST nvmf_fuzz 00:18:51.258 ************************************ 00:18:51.514 12:32:45 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:51.514 12:32:45 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:18:51.514 12:32:45 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:18:51.514 12:32:45 -- common/autotest_common.sh@10 -- # set +x 00:18:51.514 ************************************ 00:18:51.514 START TEST nvmf_multiconnection 00:18:51.514 ************************************ 00:18:51.514 12:32:45 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:18:51.514 * Looking for test storage... 00:18:51.514 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:51.514 12:32:45 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:51.514 12:32:45 -- nvmf/common.sh@7 -- # uname -s 00:18:51.514 12:32:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:51.514 12:32:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:51.514 12:32:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:51.514 12:32:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:51.514 12:32:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:51.514 12:32:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:51.514 12:32:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:51.514 12:32:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:51.514 12:32:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:51.514 12:32:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:51.514 12:32:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.514 12:32:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:51.514 12:32:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:51.514 12:32:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:51.514 12:32:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:51.514 12:32:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:51.514 12:32:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:51.514 12:32:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:51.514 12:32:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:51.514 12:32:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.514 12:32:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.514 12:32:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.514 12:32:45 -- paths/export.sh@5 -- # export PATH 00:18:51.514 12:32:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:51.514 12:32:45 -- nvmf/common.sh@46 -- # : 0 00:18:51.514 12:32:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:51.514 12:32:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:51.514 12:32:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:51.514 12:32:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:51.514 12:32:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:51.514 12:32:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:51.514 12:32:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:51.514 12:32:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:51.514 12:32:45 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:51.514 12:32:45 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:51.514 12:32:45 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:18:51.514 12:32:45 -- target/multiconnection.sh@16 -- # nvmftestinit 00:18:51.514 12:32:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:51.514 12:32:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:51.514 12:32:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:51.514 12:32:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:51.514 12:32:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:51.514 12:32:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:51.514 12:32:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:51.514 12:32:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:51.514 12:32:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:51.514 12:32:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:51.514 12:32:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:51.514 12:32:45 -- common/autotest_common.sh@10 -- # set +x 00:18:53.420 12:32:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:53.420 12:32:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:53.420 12:32:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:53.420 12:32:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:53.420 12:32:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:53.420 12:32:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:53.420 12:32:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:53.420 12:32:47 -- nvmf/common.sh@294 -- # net_devs=() 00:18:53.420 12:32:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:53.420 12:32:47 -- nvmf/common.sh@295 -- # e810=() 00:18:53.420 12:32:47 -- nvmf/common.sh@295 -- # local -ga e810 00:18:53.420 12:32:47 -- nvmf/common.sh@296 -- # x722=() 00:18:53.420 12:32:47 -- nvmf/common.sh@296 -- # local -ga x722 00:18:53.420 12:32:47 -- nvmf/common.sh@297 -- # mlx=() 00:18:53.420 12:32:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:53.420 12:32:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:53.420 12:32:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:53.420 12:32:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:53.420 12:32:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:53.420 12:32:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.420 12:32:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:53.420 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:53.420 12:32:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:53.420 12:32:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:53.420 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:53.420 12:32:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:53.420 12:32:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.420 12:32:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.420 12:32:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.420 12:32:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.420 12:32:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:53.420 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:53.420 12:32:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.420 12:32:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:53.420 12:32:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:53.420 12:32:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:53.420 12:32:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:53.420 12:32:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:53.420 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:53.420 12:32:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:53.420 12:32:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:53.420 12:32:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:53.420 12:32:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:53.420 12:32:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:53.420 12:32:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:53.420 12:32:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:53.420 12:32:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:53.420 12:32:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:53.420 12:32:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:53.420 12:32:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:53.420 12:32:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:53.420 12:32:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:53.420 12:32:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:53.420 12:32:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:53.420 12:32:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:53.420 12:32:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:53.420 12:32:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:53.420 12:32:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:53.420 12:32:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:53.420 12:32:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:53.420 12:32:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:53.420 12:32:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:53.420 12:32:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:53.420 12:32:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:53.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:53.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:18:53.420 00:18:53.420 --- 10.0.0.2 ping statistics --- 00:18:53.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.420 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:18:53.420 12:32:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:53.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:53.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.099 ms 00:18:53.420 00:18:53.420 --- 10.0.0.1 ping statistics --- 00:18:53.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:53.421 rtt min/avg/max/mdev = 0.099/0.099/0.099/0.000 ms 00:18:53.421 12:32:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:53.421 12:32:47 -- nvmf/common.sh@410 -- # return 0 00:18:53.421 12:32:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:53.421 12:32:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:53.421 12:32:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:53.421 12:32:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:53.421 12:32:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:53.421 12:32:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:53.421 12:32:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:53.678 12:32:47 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:18:53.678 12:32:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:53.678 12:32:47 -- common/autotest_common.sh@712 -- # xtrace_disable 00:18:53.678 12:32:47 -- common/autotest_common.sh@10 -- # set +x 00:18:53.678 12:32:47 -- nvmf/common.sh@469 -- # nvmfpid=1302828 00:18:53.679 12:32:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:53.679 12:32:47 -- nvmf/common.sh@470 -- # waitforlisten 1302828 00:18:53.679 12:32:47 -- common/autotest_common.sh@819 -- # '[' -z 1302828 ']' 00:18:53.679 12:32:47 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:53.679 12:32:47 -- common/autotest_common.sh@824 -- # local max_retries=100 00:18:53.679 12:32:47 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:53.679 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:53.679 12:32:47 -- common/autotest_common.sh@828 -- # xtrace_disable 00:18:53.679 12:32:47 -- common/autotest_common.sh@10 -- # set +x 00:18:53.679 [2024-07-12 12:32:47.392365] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:18:53.679 [2024-07-12 12:32:47.392451] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:53.679 EAL: No free 2048 kB hugepages reported on node 1 00:18:53.679 [2024-07-12 12:32:47.462876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:53.679 [2024-07-12 12:32:47.585790] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:53.679 [2024-07-12 12:32:47.585963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:53.679 [2024-07-12 12:32:47.585985] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:53.679 [2024-07-12 12:32:47.585998] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:53.679 [2024-07-12 12:32:47.586057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:53.679 [2024-07-12 12:32:47.586087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:53.679 [2024-07-12 12:32:47.586115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:53.679 [2024-07-12 12:32:47.586118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:54.611 12:32:48 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:18:54.611 12:32:48 -- common/autotest_common.sh@852 -- # return 0 00:18:54.611 12:32:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:54.611 12:32:48 -- common/autotest_common.sh@718 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:54.611 12:32:48 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 [2024-07-12 12:32:48.345230] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@21 -- # seq 1 11 00:18:54.611 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.611 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 Malloc1 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 [2024-07-12 12:32:48.402278] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.611 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 Malloc2 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.611 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 Malloc3 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.611 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.611 Malloc4 00:18:54.611 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.611 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:18:54.611 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.611 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.868 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 Malloc5 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.868 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 Malloc6 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.868 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 Malloc7 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.868 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.868 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:18:54.868 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.868 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.869 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 Malloc8 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:54.869 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 Malloc9 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:54.869 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:54.869 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:18:54.869 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:54.869 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:55.127 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 Malloc10 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:55.127 12:32:48 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 Malloc11 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:18:55.127 12:32:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:18:55.127 12:32:48 -- common/autotest_common.sh@10 -- # set +x 00:18:55.127 12:32:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:18:55.127 12:32:48 -- target/multiconnection.sh@28 -- # seq 1 11 00:18:55.127 12:32:48 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:55.127 12:32:48 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:55.691 12:32:49 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:18:55.691 12:32:49 -- common/autotest_common.sh@1177 -- # local i=0 00:18:55.691 12:32:49 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:55.691 12:32:49 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:55.691 12:32:49 -- common/autotest_common.sh@1184 -- # sleep 2 00:18:57.630 12:32:51 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:18:57.630 12:32:51 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:18:57.630 12:32:51 -- common/autotest_common.sh@1186 -- # grep -c SPDK1 00:18:57.630 12:32:51 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:18:57.630 12:32:51 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:18:57.630 12:32:51 -- common/autotest_common.sh@1187 -- # return 0 00:18:57.630 12:32:51 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:18:57.630 12:32:51 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:18:58.562 12:32:52 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:18:58.562 12:32:52 -- common/autotest_common.sh@1177 -- # local i=0 00:18:58.562 12:32:52 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:18:58.562 12:32:52 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:18:58.562 12:32:52 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:00.457 12:32:54 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:00.457 12:32:54 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:00.457 12:32:54 -- common/autotest_common.sh@1186 -- # grep -c SPDK2 00:19:00.457 12:32:54 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:00.457 12:32:54 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:00.457 12:32:54 -- common/autotest_common.sh@1187 -- # return 0 00:19:00.457 12:32:54 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:00.457 12:32:54 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:01.388 12:32:54 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:01.388 12:32:54 -- common/autotest_common.sh@1177 -- # local i=0 00:19:01.388 12:32:54 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:01.388 12:32:54 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:01.388 12:32:54 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:03.283 12:32:56 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:03.283 12:32:56 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:03.283 12:32:56 -- common/autotest_common.sh@1186 -- # grep -c SPDK3 00:19:03.283 12:32:56 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:03.283 12:32:56 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:03.283 12:32:56 -- common/autotest_common.sh@1187 -- # return 0 00:19:03.283 12:32:56 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:03.283 12:32:56 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:03.846 12:32:57 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:03.846 12:32:57 -- common/autotest_common.sh@1177 -- # local i=0 00:19:03.846 12:32:57 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:03.846 12:32:57 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:03.846 12:32:57 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:06.368 12:32:59 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:06.368 12:32:59 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:06.368 12:32:59 -- common/autotest_common.sh@1186 -- # grep -c SPDK4 00:19:06.368 12:32:59 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:06.368 12:32:59 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:06.368 12:32:59 -- common/autotest_common.sh@1187 -- # return 0 00:19:06.368 12:32:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:06.369 12:32:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:06.626 12:33:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:06.626 12:33:00 -- common/autotest_common.sh@1177 -- # local i=0 00:19:06.626 12:33:00 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:06.626 12:33:00 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:06.626 12:33:00 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:09.148 12:33:02 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:09.148 12:33:02 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:09.148 12:33:02 -- common/autotest_common.sh@1186 -- # grep -c SPDK5 00:19:09.148 12:33:02 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:09.148 12:33:02 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:09.148 12:33:02 -- common/autotest_common.sh@1187 -- # return 0 00:19:09.148 12:33:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:09.148 12:33:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:09.709 12:33:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:09.709 12:33:03 -- common/autotest_common.sh@1177 -- # local i=0 00:19:09.709 12:33:03 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:09.709 12:33:03 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:09.709 12:33:03 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:11.598 12:33:05 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:11.598 12:33:05 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:11.598 12:33:05 -- common/autotest_common.sh@1186 -- # grep -c SPDK6 00:19:11.598 12:33:05 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:11.598 12:33:05 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:11.598 12:33:05 -- common/autotest_common.sh@1187 -- # return 0 00:19:11.598 12:33:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:11.598 12:33:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:12.528 12:33:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:12.528 12:33:06 -- common/autotest_common.sh@1177 -- # local i=0 00:19:12.528 12:33:06 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:12.528 12:33:06 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:12.528 12:33:06 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:14.422 12:33:08 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:14.422 12:33:08 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:14.422 12:33:08 -- common/autotest_common.sh@1186 -- # grep -c SPDK7 00:19:14.422 12:33:08 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:14.422 12:33:08 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:14.422 12:33:08 -- common/autotest_common.sh@1187 -- # return 0 00:19:14.422 12:33:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:14.422 12:33:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:15.353 12:33:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:15.353 12:33:08 -- common/autotest_common.sh@1177 -- # local i=0 00:19:15.353 12:33:08 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:15.353 12:33:08 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:15.353 12:33:08 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:17.244 12:33:10 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:17.244 12:33:10 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:17.244 12:33:10 -- common/autotest_common.sh@1186 -- # grep -c SPDK8 00:19:17.244 12:33:10 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:17.244 12:33:10 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:17.244 12:33:10 -- common/autotest_common.sh@1187 -- # return 0 00:19:17.244 12:33:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:17.244 12:33:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:17.823 12:33:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:17.823 12:33:11 -- common/autotest_common.sh@1177 -- # local i=0 00:19:17.823 12:33:11 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:17.823 12:33:11 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:17.823 12:33:11 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:20.347 12:33:13 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:20.347 12:33:13 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:20.347 12:33:13 -- common/autotest_common.sh@1186 -- # grep -c SPDK9 00:19:20.347 12:33:13 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:20.347 12:33:13 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:20.347 12:33:13 -- common/autotest_common.sh@1187 -- # return 0 00:19:20.347 12:33:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:20.347 12:33:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:20.910 12:33:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:20.910 12:33:14 -- common/autotest_common.sh@1177 -- # local i=0 00:19:20.910 12:33:14 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:20.910 12:33:14 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:20.910 12:33:14 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:22.802 12:33:16 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:22.802 12:33:16 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:22.802 12:33:16 -- common/autotest_common.sh@1186 -- # grep -c SPDK10 00:19:22.802 12:33:16 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:22.802 12:33:16 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:22.802 12:33:16 -- common/autotest_common.sh@1187 -- # return 0 00:19:22.802 12:33:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:22.802 12:33:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:23.733 12:33:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:23.733 12:33:17 -- common/autotest_common.sh@1177 -- # local i=0 00:19:23.733 12:33:17 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:23.733 12:33:17 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:23.733 12:33:17 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:25.630 12:33:19 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:25.630 12:33:19 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:25.630 12:33:19 -- common/autotest_common.sh@1186 -- # grep -c SPDK11 00:19:25.630 12:33:19 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:25.630 12:33:19 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:25.630 12:33:19 -- common/autotest_common.sh@1187 -- # return 0 00:19:25.630 12:33:19 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:19:25.630 [global] 00:19:25.630 thread=1 00:19:25.630 invalidate=1 00:19:25.630 rw=read 00:19:25.630 time_based=1 00:19:25.630 runtime=10 00:19:25.630 ioengine=libaio 00:19:25.630 direct=1 00:19:25.630 bs=262144 00:19:25.630 iodepth=64 00:19:25.630 norandommap=1 00:19:25.630 numjobs=1 00:19:25.630 00:19:25.630 [job0] 00:19:25.630 filename=/dev/nvme0n1 00:19:25.630 [job1] 00:19:25.630 filename=/dev/nvme10n1 00:19:25.630 [job2] 00:19:25.630 filename=/dev/nvme1n1 00:19:25.630 [job3] 00:19:25.630 filename=/dev/nvme2n1 00:19:25.630 [job4] 00:19:25.630 filename=/dev/nvme3n1 00:19:25.630 [job5] 00:19:25.630 filename=/dev/nvme4n1 00:19:25.630 [job6] 00:19:25.630 filename=/dev/nvme5n1 00:19:25.630 [job7] 00:19:25.630 filename=/dev/nvme6n1 00:19:25.630 [job8] 00:19:25.630 filename=/dev/nvme7n1 00:19:25.630 [job9] 00:19:25.630 filename=/dev/nvme8n1 00:19:25.630 [job10] 00:19:25.630 filename=/dev/nvme9n1 00:19:25.888 Could not set queue depth (nvme0n1) 00:19:25.888 Could not set queue depth (nvme10n1) 00:19:25.888 Could not set queue depth (nvme1n1) 00:19:25.888 Could not set queue depth (nvme2n1) 00:19:25.888 Could not set queue depth (nvme3n1) 00:19:25.888 Could not set queue depth (nvme4n1) 00:19:25.888 Could not set queue depth (nvme5n1) 00:19:25.888 Could not set queue depth (nvme6n1) 00:19:25.888 Could not set queue depth (nvme7n1) 00:19:25.888 Could not set queue depth (nvme8n1) 00:19:25.888 Could not set queue depth (nvme9n1) 00:19:25.888 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:25.888 fio-3.35 00:19:25.888 Starting 11 threads 00:19:38.088 00:19:38.088 job0: (groupid=0, jobs=1): err= 0: pid=1307945: Fri Jul 12 12:33:30 2024 00:19:38.088 read: IOPS=949, BW=237MiB/s (249MB/s)(2381MiB/10033msec) 00:19:38.088 slat (usec): min=9, max=37036, avg=990.73, stdev=2900.67 00:19:38.088 clat (msec): min=4, max=127, avg=66.38, stdev=21.45 00:19:38.088 lat (msec): min=4, max=128, avg=67.37, stdev=21.73 00:19:38.088 clat percentiles (msec): 00:19:38.088 | 1.00th=[ 22], 5.00th=[ 39], 10.00th=[ 43], 20.00th=[ 48], 00:19:38.088 | 30.00th=[ 52], 40.00th=[ 56], 50.00th=[ 63], 60.00th=[ 71], 00:19:38.088 | 70.00th=[ 80], 80.00th=[ 87], 90.00th=[ 97], 95.00th=[ 104], 00:19:38.088 | 99.00th=[ 116], 99.50th=[ 120], 99.90th=[ 127], 99.95th=[ 128], 00:19:38.088 | 99.99th=[ 128] 00:19:38.089 bw ( KiB/s): min=155648, max=399360, per=12.88%, avg=242227.20, stdev=66763.43, samples=20 00:19:38.089 iops : min= 608, max= 1560, avg=946.20, stdev=260.79, samples=20 00:19:38.089 lat (msec) : 10=0.58%, 20=0.41%, 50=26.10%, 100=65.60%, 250=7.32% 00:19:38.089 cpu : usr=0.53%, sys=3.01%, ctx=1687, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=9525,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job1: (groupid=0, jobs=1): err= 0: pid=1307946: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=629, BW=157MiB/s (165MB/s)(1582MiB/10057msec) 00:19:38.089 slat (usec): min=9, max=230775, avg=899.73, stdev=8291.90 00:19:38.089 clat (usec): min=1096, max=530418, avg=100749.75, stdev=90339.51 00:19:38.089 lat (usec): min=1127, max=546209, avg=101649.49, stdev=91632.45 00:19:38.089 clat percentiles (msec): 00:19:38.089 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 16], 20.00th=[ 36], 00:19:38.089 | 30.00th=[ 49], 40.00th=[ 60], 50.00th=[ 74], 60.00th=[ 88], 00:19:38.089 | 70.00th=[ 100], 80.00th=[ 140], 90.00th=[ 262], 95.00th=[ 317], 00:19:38.089 | 99.00th=[ 351], 99.50th=[ 359], 99.90th=[ 363], 99.95th=[ 372], 00:19:38.089 | 99.99th=[ 531] 00:19:38.089 bw ( KiB/s): min=32320, max=340992, per=8.53%, avg=160387.20, stdev=82477.03, samples=20 00:19:38.089 iops : min= 126, max= 1332, avg=626.50, stdev=322.20, samples=20 00:19:38.089 lat (msec) : 2=0.17%, 4=2.01%, 10=4.63%, 20=5.12%, 50=19.60% 00:19:38.089 lat (msec) : 100=38.80%, 250=18.65%, 500=10.98%, 750=0.05% 00:19:38.089 cpu : usr=0.25%, sys=1.69%, ctx=1543, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=6328,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job2: (groupid=0, jobs=1): err= 0: pid=1307949: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=626, BW=157MiB/s (164MB/s)(1582MiB/10095msec) 00:19:38.089 slat (usec): min=8, max=253308, avg=1091.46, stdev=9096.00 00:19:38.089 clat (usec): min=700, max=557119, avg=100963.72, stdev=92099.33 00:19:38.089 lat (usec): min=730, max=565627, avg=102055.19, stdev=93445.76 00:19:38.089 clat percentiles (usec): 00:19:38.089 | 1.00th=[ 1729], 5.00th=[ 10159], 10.00th=[ 18482], 20.00th=[ 34341], 00:19:38.089 | 30.00th=[ 49021], 40.00th=[ 64226], 50.00th=[ 74974], 60.00th=[ 89654], 00:19:38.089 | 70.00th=[101188], 80.00th=[116917], 90.00th=[291505], 95.00th=[325059], 00:19:38.089 | 99.00th=[350225], 99.50th=[358613], 99.90th=[501220], 99.95th=[526386], 00:19:38.089 | 99.99th=[557843] 00:19:38.089 bw ( KiB/s): min=31744, max=367616, per=8.52%, avg=160332.80, stdev=91709.52, samples=20 00:19:38.089 iops : min= 124, max= 1436, avg=626.30, stdev=358.24, samples=20 00:19:38.089 lat (usec) : 750=0.11%, 1000=0.24% 00:19:38.089 lat (msec) : 2=0.82%, 4=1.42%, 10=2.32%, 20=5.47%, 50=20.52% 00:19:38.089 lat (msec) : 100=38.10%, 250=18.07%, 500=12.84%, 750=0.09% 00:19:38.089 cpu : usr=0.30%, sys=1.98%, ctx=1396, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=6326,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job3: (groupid=0, jobs=1): err= 0: pid=1307950: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=448, BW=112MiB/s (118MB/s)(1132MiB/10095msec) 00:19:38.089 slat (usec): min=9, max=250972, avg=1811.27, stdev=12142.59 00:19:38.089 clat (msec): min=3, max=580, avg=140.82, stdev=93.53 00:19:38.089 lat (msec): min=3, max=580, avg=142.63, stdev=95.50 00:19:38.089 clat percentiles (msec): 00:19:38.089 | 1.00th=[ 10], 5.00th=[ 32], 10.00th=[ 49], 20.00th=[ 79], 00:19:38.089 | 30.00th=[ 91], 40.00th=[ 97], 50.00th=[ 104], 60.00th=[ 116], 00:19:38.089 | 70.00th=[ 155], 80.00th=[ 224], 90.00th=[ 313], 95.00th=[ 334], 00:19:38.089 | 99.00th=[ 355], 99.50th=[ 359], 99.90th=[ 531], 99.95th=[ 531], 00:19:38.089 | 99.99th=[ 584] 00:19:38.089 bw ( KiB/s): min=31744, max=221696, per=6.07%, avg=114252.80, stdev=56454.89, samples=20 00:19:38.089 iops : min= 124, max= 866, avg=446.30, stdev=220.53, samples=20 00:19:38.089 lat (msec) : 4=0.09%, 10=0.99%, 20=2.08%, 50=7.20%, 100=35.04% 00:19:38.089 lat (msec) : 250=37.49%, 500=16.92%, 750=0.18% 00:19:38.089 cpu : usr=0.17%, sys=1.40%, ctx=928, majf=0, minf=3721 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=4526,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job4: (groupid=0, jobs=1): err= 0: pid=1307951: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=512, BW=128MiB/s (134MB/s)(1293MiB/10087msec) 00:19:38.089 slat (usec): min=11, max=274914, avg=1653.89, stdev=12722.08 00:19:38.089 clat (msec): min=6, max=601, avg=123.10, stdev=103.31 00:19:38.089 lat (msec): min=6, max=601, avg=124.76, stdev=105.64 00:19:38.089 clat percentiles (msec): 00:19:38.089 | 1.00th=[ 13], 5.00th=[ 22], 10.00th=[ 30], 20.00th=[ 37], 00:19:38.089 | 30.00th=[ 52], 40.00th=[ 67], 50.00th=[ 86], 60.00th=[ 104], 00:19:38.089 | 70.00th=[ 138], 80.00th=[ 224], 90.00th=[ 317], 95.00th=[ 334], 00:19:38.089 | 99.00th=[ 355], 99.50th=[ 359], 99.90th=[ 550], 99.95th=[ 558], 00:19:38.089 | 99.99th=[ 600] 00:19:38.089 bw ( KiB/s): min=31232, max=456192, per=6.95%, avg=130764.80, stdev=112569.96, samples=20 00:19:38.089 iops : min= 122, max= 1782, avg=510.80, stdev=439.73, samples=20 00:19:38.089 lat (msec) : 10=0.27%, 20=3.04%, 50=26.28%, 100=29.14%, 250=24.41% 00:19:38.089 lat (msec) : 500=16.65%, 750=0.21% 00:19:38.089 cpu : usr=0.35%, sys=1.71%, ctx=1032, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=5171,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job5: (groupid=0, jobs=1): err= 0: pid=1307955: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=420, BW=105MiB/s (110MB/s)(1056MiB/10049msec) 00:19:38.089 slat (usec): min=8, max=236214, avg=1986.62, stdev=12094.75 00:19:38.089 clat (msec): min=9, max=554, avg=150.17, stdev=99.09 00:19:38.089 lat (msec): min=9, max=554, avg=152.16, stdev=101.30 00:19:38.089 clat percentiles (msec): 00:19:38.089 | 1.00th=[ 22], 5.00th=[ 52], 10.00th=[ 62], 20.00th=[ 72], 00:19:38.089 | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 120], 00:19:38.089 | 70.00th=[ 178], 80.00th=[ 268], 90.00th=[ 321], 95.00th=[ 342], 00:19:38.089 | 99.00th=[ 359], 99.50th=[ 368], 99.90th=[ 422], 99.95th=[ 531], 00:19:38.089 | 99.99th=[ 558] 00:19:38.089 bw ( KiB/s): min=33280, max=223744, per=5.66%, avg=106527.30, stdev=62551.43, samples=20 00:19:38.089 iops : min= 130, max= 874, avg=416.10, stdev=244.36, samples=20 00:19:38.089 lat (msec) : 10=0.17%, 20=0.71%, 50=3.34%, 100=40.46%, 250=33.81% 00:19:38.089 lat (msec) : 500=21.43%, 750=0.09% 00:19:38.089 cpu : usr=0.18%, sys=1.24%, ctx=921, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=4224,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job6: (groupid=0, jobs=1): err= 0: pid=1307956: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=879, BW=220MiB/s (231MB/s)(2218MiB/10089msec) 00:19:38.089 slat (usec): min=12, max=35990, avg=1048.26, stdev=3108.25 00:19:38.089 clat (msec): min=26, max=354, avg=71.67, stdev=25.70 00:19:38.089 lat (msec): min=26, max=354, avg=72.71, stdev=25.95 00:19:38.089 clat percentiles (msec): 00:19:38.089 | 1.00th=[ 35], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 50], 00:19:38.089 | 30.00th=[ 54], 40.00th=[ 60], 50.00th=[ 68], 60.00th=[ 75], 00:19:38.089 | 70.00th=[ 85], 80.00th=[ 94], 90.00th=[ 105], 95.00th=[ 112], 00:19:38.089 | 99.00th=[ 131], 99.50th=[ 174], 99.90th=[ 205], 99.95th=[ 347], 00:19:38.089 | 99.99th=[ 355] 00:19:38.089 bw ( KiB/s): min=142848, max=327680, per=11.99%, avg=225510.40, stdev=62397.36, samples=20 00:19:38.089 iops : min= 558, max= 1280, avg=880.90, stdev=243.74, samples=20 00:19:38.089 lat (msec) : 50=22.43%, 100=63.53%, 250=13.95%, 500=0.09% 00:19:38.089 cpu : usr=0.54%, sys=2.97%, ctx=1572, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=8873,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job7: (groupid=0, jobs=1): err= 0: pid=1307957: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=533, BW=133MiB/s (140MB/s)(1338MiB/10037msec) 00:19:38.089 slat (usec): min=8, max=280103, avg=1622.64, stdev=12404.68 00:19:38.089 clat (msec): min=2, max=589, avg=118.33, stdev=96.45 00:19:38.089 lat (msec): min=2, max=620, avg=119.95, stdev=98.40 00:19:38.089 clat percentiles (msec): 00:19:38.089 | 1.00th=[ 7], 5.00th=[ 23], 10.00th=[ 32], 20.00th=[ 45], 00:19:38.089 | 30.00th=[ 63], 40.00th=[ 83], 50.00th=[ 93], 60.00th=[ 102], 00:19:38.089 | 70.00th=[ 113], 80.00th=[ 134], 90.00th=[ 309], 95.00th=[ 334], 00:19:38.089 | 99.00th=[ 351], 99.50th=[ 359], 99.90th=[ 542], 99.95th=[ 592], 00:19:38.089 | 99.99th=[ 592] 00:19:38.089 bw ( KiB/s): min=36864, max=298496, per=7.20%, avg=135398.40, stdev=84919.32, samples=20 00:19:38.089 iops : min= 144, max= 1166, avg=528.90, stdev=331.72, samples=20 00:19:38.089 lat (msec) : 4=0.28%, 10=1.42%, 20=2.45%, 50=20.01%, 100=33.89% 00:19:38.089 lat (msec) : 250=26.89%, 500=14.84%, 750=0.22% 00:19:38.089 cpu : usr=0.35%, sys=1.47%, ctx=1005, majf=0, minf=4097 00:19:38.089 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:38.089 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.089 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.089 issued rwts: total=5352,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.089 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.089 job8: (groupid=0, jobs=1): err= 0: pid=1307958: Fri Jul 12 12:33:30 2024 00:19:38.089 read: IOPS=567, BW=142MiB/s (149MB/s)(1426MiB/10057msec) 00:19:38.089 slat (usec): min=9, max=242492, avg=1295.32, stdev=8143.71 00:19:38.089 clat (msec): min=5, max=542, avg=111.44, stdev=90.96 00:19:38.089 lat (msec): min=5, max=568, avg=112.74, stdev=92.61 00:19:38.089 clat percentiles (msec): 00:19:38.090 | 1.00th=[ 16], 5.00th=[ 33], 10.00th=[ 46], 20.00th=[ 57], 00:19:38.090 | 30.00th=[ 66], 40.00th=[ 73], 50.00th=[ 80], 60.00th=[ 86], 00:19:38.090 | 70.00th=[ 97], 80.00th=[ 124], 90.00th=[ 309], 95.00th=[ 334], 00:19:38.090 | 99.00th=[ 359], 99.50th=[ 363], 99.90th=[ 460], 99.95th=[ 531], 00:19:38.090 | 99.99th=[ 542] 00:19:38.090 bw ( KiB/s): min=34304, max=278016, per=7.68%, avg=144435.20, stdev=78044.74, samples=20 00:19:38.090 iops : min= 134, max= 1086, avg=564.20, stdev=304.86, samples=20 00:19:38.090 lat (msec) : 10=0.33%, 20=1.47%, 50=11.50%, 100=58.21%, 250=14.69% 00:19:38.090 lat (msec) : 500=13.74%, 750=0.05% 00:19:38.090 cpu : usr=0.25%, sys=1.62%, ctx=1253, majf=0, minf=4097 00:19:38.090 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:38.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.090 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.090 issued rwts: total=5705,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.090 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.090 job9: (groupid=0, jobs=1): err= 0: pid=1307974: Fri Jul 12 12:33:30 2024 00:19:38.090 read: IOPS=1343, BW=336MiB/s (352MB/s)(3392MiB/10096msec) 00:19:38.090 slat (usec): min=12, max=32608, avg=718.50, stdev=2161.06 00:19:38.090 clat (msec): min=9, max=227, avg=46.86, stdev=26.97 00:19:38.090 lat (msec): min=9, max=234, avg=47.58, stdev=27.34 00:19:38.090 clat percentiles (msec): 00:19:38.090 | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 28], 00:19:38.090 | 30.00th=[ 29], 40.00th=[ 31], 50.00th=[ 32], 60.00th=[ 39], 00:19:38.090 | 70.00th=[ 55], 80.00th=[ 70], 90.00th=[ 90], 95.00th=[ 103], 00:19:38.090 | 99.00th=[ 122], 99.50th=[ 130], 99.90th=[ 218], 99.95th=[ 226], 00:19:38.090 | 99.99th=[ 228] 00:19:38.090 bw ( KiB/s): min=127488, max=539648, per=18.38%, avg=345753.60, stdev=153755.78, samples=20 00:19:38.090 iops : min= 498, max= 2108, avg=1350.60, stdev=600.61, samples=20 00:19:38.090 lat (msec) : 10=0.02%, 20=0.15%, 50=66.86%, 100=27.32%, 250=5.65% 00:19:38.090 cpu : usr=0.73%, sys=4.34%, ctx=2283, majf=0, minf=4097 00:19:38.090 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:19:38.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.090 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.090 issued rwts: total=13569,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.090 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.090 job10: (groupid=0, jobs=1): err= 0: pid=1307989: Fri Jul 12 12:33:30 2024 00:19:38.090 read: IOPS=456, BW=114MiB/s (120MB/s)(1148MiB/10052msec) 00:19:38.090 slat (usec): min=9, max=223507, avg=1873.95, stdev=9270.47 00:19:38.090 clat (msec): min=5, max=483, avg=138.20, stdev=95.36 00:19:38.090 lat (msec): min=5, max=549, avg=140.07, stdev=96.82 00:19:38.090 clat percentiles (msec): 00:19:38.090 | 1.00th=[ 17], 5.00th=[ 41], 10.00th=[ 60], 20.00th=[ 68], 00:19:38.090 | 30.00th=[ 77], 40.00th=[ 86], 50.00th=[ 95], 60.00th=[ 107], 00:19:38.090 | 70.00th=[ 163], 80.00th=[ 234], 90.00th=[ 313], 95.00th=[ 334], 00:19:38.090 | 99.00th=[ 359], 99.50th=[ 363], 99.90th=[ 376], 99.95th=[ 443], 00:19:38.090 | 99.99th=[ 485] 00:19:38.090 bw ( KiB/s): min=37376, max=231936, per=6.16%, avg=115891.20, stdev=62222.17, samples=20 00:19:38.090 iops : min= 146, max= 906, avg=452.70, stdev=243.06, samples=20 00:19:38.090 lat (msec) : 10=0.13%, 20=1.74%, 50=4.53%, 100=49.19%, 250=27.23% 00:19:38.090 lat (msec) : 500=17.17% 00:19:38.090 cpu : usr=0.26%, sys=1.52%, ctx=1001, majf=0, minf=4097 00:19:38.090 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:19:38.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.090 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:38.090 issued rwts: total=4590,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.090 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:38.090 00:19:38.090 Run status group 0 (all jobs): 00:19:38.090 READ: bw=1837MiB/s (1926MB/s), 105MiB/s-336MiB/s (110MB/s-352MB/s), io=18.1GiB (19.4GB), run=10033-10096msec 00:19:38.090 00:19:38.090 Disk stats (read/write): 00:19:38.090 nvme0n1: ios=18776/0, merge=0/0, ticks=1238617/0, in_queue=1238617, util=97.11% 00:19:38.090 nvme10n1: ios=12378/0, merge=0/0, ticks=1245238/0, in_queue=1245238, util=97.31% 00:19:38.090 nvme1n1: ios=12463/0, merge=0/0, ticks=1238693/0, in_queue=1238693, util=97.61% 00:19:38.090 nvme2n1: ios=8859/0, merge=0/0, ticks=1233832/0, in_queue=1233832, util=97.76% 00:19:38.090 nvme3n1: ios=10078/0, merge=0/0, ticks=1232578/0, in_queue=1232578, util=97.83% 00:19:38.090 nvme4n1: ios=8194/0, merge=0/0, ticks=1237144/0, in_queue=1237144, util=98.18% 00:19:38.090 nvme5n1: ios=17574/0, merge=0/0, ticks=1237256/0, in_queue=1237256, util=98.35% 00:19:38.090 nvme6n1: ios=10393/0, merge=0/0, ticks=1233785/0, in_queue=1233785, util=98.46% 00:19:38.090 nvme7n1: ios=11147/0, merge=0/0, ticks=1235082/0, in_queue=1235082, util=98.86% 00:19:38.090 nvme8n1: ios=26967/0, merge=0/0, ticks=1234882/0, in_queue=1234882, util=99.07% 00:19:38.090 nvme9n1: ios=8954/0, merge=0/0, ticks=1234156/0, in_queue=1234156, util=99.24% 00:19:38.090 12:33:30 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:19:38.090 [global] 00:19:38.090 thread=1 00:19:38.090 invalidate=1 00:19:38.090 rw=randwrite 00:19:38.090 time_based=1 00:19:38.090 runtime=10 00:19:38.090 ioengine=libaio 00:19:38.090 direct=1 00:19:38.090 bs=262144 00:19:38.090 iodepth=64 00:19:38.090 norandommap=1 00:19:38.090 numjobs=1 00:19:38.090 00:19:38.090 [job0] 00:19:38.090 filename=/dev/nvme0n1 00:19:38.090 [job1] 00:19:38.090 filename=/dev/nvme10n1 00:19:38.090 [job2] 00:19:38.090 filename=/dev/nvme1n1 00:19:38.090 [job3] 00:19:38.090 filename=/dev/nvme2n1 00:19:38.090 [job4] 00:19:38.090 filename=/dev/nvme3n1 00:19:38.090 [job5] 00:19:38.090 filename=/dev/nvme4n1 00:19:38.090 [job6] 00:19:38.090 filename=/dev/nvme5n1 00:19:38.090 [job7] 00:19:38.090 filename=/dev/nvme6n1 00:19:38.090 [job8] 00:19:38.090 filename=/dev/nvme7n1 00:19:38.090 [job9] 00:19:38.090 filename=/dev/nvme8n1 00:19:38.090 [job10] 00:19:38.090 filename=/dev/nvme9n1 00:19:38.090 Could not set queue depth (nvme0n1) 00:19:38.090 Could not set queue depth (nvme10n1) 00:19:38.090 Could not set queue depth (nvme1n1) 00:19:38.090 Could not set queue depth (nvme2n1) 00:19:38.090 Could not set queue depth (nvme3n1) 00:19:38.090 Could not set queue depth (nvme4n1) 00:19:38.090 Could not set queue depth (nvme5n1) 00:19:38.090 Could not set queue depth (nvme6n1) 00:19:38.090 Could not set queue depth (nvme7n1) 00:19:38.090 Could not set queue depth (nvme8n1) 00:19:38.090 Could not set queue depth (nvme9n1) 00:19:38.090 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:19:38.090 fio-3.35 00:19:38.090 Starting 11 threads 00:19:48.060 00:19:48.060 job0: (groupid=0, jobs=1): err= 0: pid=1309154: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=381, BW=95.4MiB/s (100.0MB/s)(970MiB/10175msec); 0 zone resets 00:19:48.060 slat (usec): min=18, max=114419, avg=2102.92, stdev=5736.57 00:19:48.060 clat (usec): min=937, max=381240, avg=165589.87, stdev=87660.59 00:19:48.060 lat (usec): min=955, max=381273, avg=167692.79, stdev=88710.03 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 6], 5.00th=[ 21], 10.00th=[ 55], 20.00th=[ 83], 00:19:48.060 | 30.00th=[ 103], 40.00th=[ 134], 50.00th=[ 163], 60.00th=[ 197], 00:19:48.060 | 70.00th=[ 226], 80.00th=[ 249], 90.00th=[ 284], 95.00th=[ 313], 00:19:48.060 | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 372], 99.95th=[ 376], 00:19:48.060 | 99.99th=[ 380] 00:19:48.060 bw ( KiB/s): min=45056, max=162304, per=6.98%, avg=97740.80, stdev=36654.15, samples=20 00:19:48.060 iops : min= 176, max= 634, avg=381.80, stdev=143.18, samples=20 00:19:48.060 lat (usec) : 1000=0.03% 00:19:48.060 lat (msec) : 2=0.05%, 4=0.46%, 10=1.83%, 20=2.47%, 50=4.72% 00:19:48.060 lat (msec) : 100=19.76%, 250=51.56%, 500=19.12% 00:19:48.060 cpu : usr=1.31%, sys=1.27%, ctx=1800, majf=0, minf=1 00:19:48.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:19:48.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.060 issued rwts: total=0,3881,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.060 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.060 job1: (groupid=0, jobs=1): err= 0: pid=1309172: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=471, BW=118MiB/s (124MB/s)(1199MiB/10175msec); 0 zone resets 00:19:48.060 slat (usec): min=18, max=95179, avg=1616.00, stdev=4670.94 00:19:48.060 clat (usec): min=1095, max=414590, avg=134112.29, stdev=90757.86 00:19:48.060 lat (usec): min=1129, max=414629, avg=135728.29, stdev=92039.22 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 18], 20.00th=[ 45], 00:19:48.060 | 30.00th=[ 73], 40.00th=[ 92], 50.00th=[ 122], 60.00th=[ 155], 00:19:48.060 | 70.00th=[ 184], 80.00th=[ 232], 90.00th=[ 262], 95.00th=[ 279], 00:19:48.060 | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 401], 99.95th=[ 401], 00:19:48.060 | 99.99th=[ 414] 00:19:48.060 bw ( KiB/s): min=43008, max=227840, per=8.65%, avg=121139.20, stdev=52703.78, samples=20 00:19:48.060 iops : min= 168, max= 890, avg=473.20, stdev=205.87, samples=20 00:19:48.060 lat (msec) : 2=0.27%, 4=1.98%, 10=3.73%, 20=4.78%, 50=11.16% 00:19:48.060 lat (msec) : 100=20.27%, 250=44.23%, 500=13.58% 00:19:48.060 cpu : usr=1.59%, sys=1.80%, ctx=2696, majf=0, minf=1 00:19:48.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:48.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.060 issued rwts: total=0,4795,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.060 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.060 job2: (groupid=0, jobs=1): err= 0: pid=1309173: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=440, BW=110MiB/s (116MB/s)(1112MiB/10089msec); 0 zone resets 00:19:48.060 slat (usec): min=13, max=60968, avg=1555.28, stdev=4362.48 00:19:48.060 clat (usec): min=1487, max=341950, avg=143587.75, stdev=80709.87 00:19:48.060 lat (usec): min=1579, max=342060, avg=145143.03, stdev=81806.52 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 24], 20.00th=[ 63], 00:19:48.060 | 30.00th=[ 89], 40.00th=[ 125], 50.00th=[ 155], 60.00th=[ 171], 00:19:48.060 | 70.00th=[ 194], 80.00th=[ 213], 90.00th=[ 247], 95.00th=[ 271], 00:19:48.060 | 99.00th=[ 313], 99.50th=[ 326], 99.90th=[ 334], 99.95th=[ 338], 00:19:48.060 | 99.99th=[ 342] 00:19:48.060 bw ( KiB/s): min=65536, max=215040, per=8.02%, avg=112229.70, stdev=38042.72, samples=20 00:19:48.060 iops : min= 256, max= 840, avg=438.35, stdev=148.62, samples=20 00:19:48.060 lat (msec) : 2=0.04%, 4=0.67%, 10=3.76%, 20=4.27%, 50=7.29% 00:19:48.060 lat (msec) : 100=17.38%, 250=57.48%, 500=9.11% 00:19:48.060 cpu : usr=1.57%, sys=1.83%, ctx=2677, majf=0, minf=1 00:19:48.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:48.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.060 issued rwts: total=0,4447,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.060 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.060 job3: (groupid=0, jobs=1): err= 0: pid=1309174: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=570, BW=143MiB/s (150MB/s)(1454MiB/10184msec); 0 zone resets 00:19:48.060 slat (usec): min=21, max=88646, avg=1057.33, stdev=3559.90 00:19:48.060 clat (usec): min=816, max=335546, avg=110910.46, stdev=75348.67 00:19:48.060 lat (usec): min=857, max=339585, avg=111967.79, stdev=76201.78 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 23], 20.00th=[ 46], 00:19:48.060 | 30.00th=[ 63], 40.00th=[ 78], 50.00th=[ 88], 60.00th=[ 115], 00:19:48.060 | 70.00th=[ 146], 80.00th=[ 184], 90.00th=[ 232], 95.00th=[ 255], 00:19:48.060 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 321], 99.95th=[ 330], 00:19:48.060 | 99.99th=[ 338] 00:19:48.060 bw ( KiB/s): min=59392, max=268800, per=10.52%, avg=147244.80, stdev=58714.75, samples=20 00:19:48.060 iops : min= 232, max= 1050, avg=575.10, stdev=229.38, samples=20 00:19:48.060 lat (usec) : 1000=0.09% 00:19:48.060 lat (msec) : 2=0.22%, 4=0.86%, 10=2.65%, 20=4.73%, 50=14.57% 00:19:48.060 lat (msec) : 100=32.69%, 250=37.70%, 500=6.50% 00:19:48.060 cpu : usr=1.69%, sys=2.31%, ctx=3703, majf=0, minf=1 00:19:48.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:48.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.060 issued rwts: total=0,5815,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.060 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.060 job4: (groupid=0, jobs=1): err= 0: pid=1309175: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=622, BW=156MiB/s (163MB/s)(1569MiB/10087msec); 0 zone resets 00:19:48.060 slat (usec): min=17, max=98999, avg=1048.05, stdev=3541.56 00:19:48.060 clat (usec): min=773, max=346627, avg=101708.20, stdev=71787.63 00:19:48.060 lat (usec): min=845, max=346688, avg=102756.25, stdev=72587.05 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 3], 5.00th=[ 8], 10.00th=[ 16], 20.00th=[ 38], 00:19:48.060 | 30.00th=[ 55], 40.00th=[ 77], 50.00th=[ 89], 60.00th=[ 108], 00:19:48.060 | 70.00th=[ 127], 80.00th=[ 155], 90.00th=[ 207], 95.00th=[ 255], 00:19:48.060 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 347], 99.95th=[ 347], 00:19:48.060 | 99.99th=[ 347] 00:19:48.060 bw ( KiB/s): min=75776, max=308736, per=11.36%, avg=159065.00, stdev=70083.67, samples=20 00:19:48.060 iops : min= 296, max= 1206, avg=621.30, stdev=273.79, samples=20 00:19:48.060 lat (usec) : 1000=0.13% 00:19:48.060 lat (msec) : 2=0.43%, 4=1.90%, 10=4.22%, 20=5.53%, 50=15.66% 00:19:48.060 lat (msec) : 100=27.00%, 250=39.70%, 500=5.43% 00:19:48.060 cpu : usr=2.02%, sys=2.23%, ctx=3739, majf=0, minf=1 00:19:48.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:48.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.060 issued rwts: total=0,6277,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.060 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.060 job5: (groupid=0, jobs=1): err= 0: pid=1309176: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=453, BW=113MiB/s (119MB/s)(1145MiB/10086msec); 0 zone resets 00:19:48.060 slat (usec): min=17, max=103079, avg=1797.97, stdev=4881.68 00:19:48.060 clat (usec): min=942, max=340078, avg=139137.65, stdev=79023.74 00:19:48.060 lat (usec): min=981, max=340130, avg=140935.62, stdev=80205.28 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 5], 5.00th=[ 17], 10.00th=[ 40], 20.00th=[ 67], 00:19:48.060 | 30.00th=[ 90], 40.00th=[ 110], 50.00th=[ 131], 60.00th=[ 163], 00:19:48.060 | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 255], 95.00th=[ 275], 00:19:48.060 | 99.00th=[ 317], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 338], 00:19:48.060 | 99.99th=[ 342] 00:19:48.060 bw ( KiB/s): min=49152, max=243712, per=8.26%, avg=115584.00, stdev=50285.56, samples=20 00:19:48.060 iops : min= 192, max= 952, avg=451.50, stdev=196.43, samples=20 00:19:48.060 lat (usec) : 1000=0.02% 00:19:48.060 lat (msec) : 2=0.17%, 4=0.74%, 10=2.53%, 20=2.18%, 50=10.62% 00:19:48.060 lat (msec) : 100=18.83%, 250=53.54%, 500=11.36% 00:19:48.060 cpu : usr=1.73%, sys=1.43%, ctx=2252, majf=0, minf=1 00:19:48.060 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:19:48.060 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.060 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.060 issued rwts: total=0,4578,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.060 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.060 job6: (groupid=0, jobs=1): err= 0: pid=1309177: Fri Jul 12 12:33:41 2024 00:19:48.060 write: IOPS=432, BW=108MiB/s (113MB/s)(1102MiB/10178msec); 0 zone resets 00:19:48.060 slat (usec): min=19, max=141141, avg=1657.33, stdev=5751.84 00:19:48.060 clat (usec): min=1758, max=431387, avg=146076.17, stdev=90810.21 00:19:48.060 lat (usec): min=1795, max=431446, avg=147733.50, stdev=91996.94 00:19:48.060 clat percentiles (msec): 00:19:48.060 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 35], 20.00th=[ 72], 00:19:48.061 | 30.00th=[ 88], 40.00th=[ 103], 50.00th=[ 126], 60.00th=[ 161], 00:19:48.061 | 70.00th=[ 194], 80.00th=[ 232], 90.00th=[ 292], 95.00th=[ 313], 00:19:48.061 | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 405], 99.95th=[ 422], 00:19:48.061 | 99.99th=[ 430] 00:19:48.061 bw ( KiB/s): min=51200, max=201728, per=7.94%, avg=111180.80, stdev=44520.07, samples=20 00:19:48.061 iops : min= 200, max= 788, avg=434.30, stdev=173.91, samples=20 00:19:48.061 lat (msec) : 2=0.07%, 4=0.79%, 10=2.22%, 20=2.95%, 50=8.81% 00:19:48.061 lat (msec) : 100=23.49%, 250=45.10%, 500=16.57% 00:19:48.061 cpu : usr=1.24%, sys=1.53%, ctx=2609, majf=0, minf=1 00:19:48.061 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:19:48.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.061 issued rwts: total=0,4406,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.061 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.061 job7: (groupid=0, jobs=1): err= 0: pid=1309178: Fri Jul 12 12:33:41 2024 00:19:48.061 write: IOPS=481, BW=120MiB/s (126MB/s)(1219MiB/10135msec); 0 zone resets 00:19:48.061 slat (usec): min=19, max=120330, avg=1221.09, stdev=4290.23 00:19:48.061 clat (usec): min=1089, max=378292, avg=131759.48, stdev=78621.24 00:19:48.061 lat (usec): min=1149, max=378373, avg=132980.57, stdev=79683.09 00:19:48.061 clat percentiles (msec): 00:19:48.061 | 1.00th=[ 8], 5.00th=[ 22], 10.00th=[ 34], 20.00th=[ 57], 00:19:48.061 | 30.00th=[ 84], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 142], 00:19:48.061 | 70.00th=[ 165], 80.00th=[ 201], 90.00th=[ 251], 95.00th=[ 279], 00:19:48.061 | 99.00th=[ 326], 99.50th=[ 351], 99.90th=[ 363], 99.95th=[ 368], 00:19:48.061 | 99.99th=[ 380] 00:19:48.061 bw ( KiB/s): min=61440, max=226304, per=8.80%, avg=123187.20, stdev=43718.29, samples=20 00:19:48.061 iops : min= 240, max= 884, avg=481.20, stdev=170.77, samples=20 00:19:48.061 lat (msec) : 2=0.12%, 4=0.27%, 10=1.07%, 20=2.83%, 50=13.07% 00:19:48.061 lat (msec) : 100=17.91%, 250=54.75%, 500=9.99% 00:19:48.061 cpu : usr=1.49%, sys=2.03%, ctx=3246, majf=0, minf=1 00:19:48.061 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:48.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.061 issued rwts: total=0,4875,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.061 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.061 job8: (groupid=0, jobs=1): err= 0: pid=1309179: Fri Jul 12 12:33:41 2024 00:19:48.061 write: IOPS=619, BW=155MiB/s (162MB/s)(1576MiB/10177msec); 0 zone resets 00:19:48.061 slat (usec): min=15, max=81460, avg=1084.70, stdev=3711.87 00:19:48.061 clat (usec): min=1114, max=473334, avg=102207.14, stdev=83186.23 00:19:48.061 lat (usec): min=1268, max=473397, avg=103291.84, stdev=84180.80 00:19:48.061 clat percentiles (msec): 00:19:48.061 | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 14], 20.00th=[ 33], 00:19:48.061 | 30.00th=[ 44], 40.00th=[ 55], 50.00th=[ 80], 60.00th=[ 102], 00:19:48.061 | 70.00th=[ 128], 80.00th=[ 182], 90.00th=[ 236], 95.00th=[ 255], 00:19:48.061 | 99.00th=[ 317], 99.50th=[ 338], 99.90th=[ 447], 99.95th=[ 464], 00:19:48.061 | 99.99th=[ 472] 00:19:48.061 bw ( KiB/s): min=58368, max=291398, per=11.41%, avg=159734.70, stdev=76303.87, samples=20 00:19:48.061 iops : min= 228, max= 1138, avg=623.95, stdev=298.04, samples=20 00:19:48.061 lat (msec) : 2=0.14%, 4=0.98%, 10=6.57%, 20=5.31%, 50=25.19% 00:19:48.061 lat (msec) : 100=21.42%, 250=34.40%, 500=5.98% 00:19:48.061 cpu : usr=1.99%, sys=2.15%, ctx=3816, majf=0, minf=1 00:19:48.061 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:19:48.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.061 issued rwts: total=0,6303,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.061 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.061 job9: (groupid=0, jobs=1): err= 0: pid=1309180: Fri Jul 12 12:33:41 2024 00:19:48.061 write: IOPS=471, BW=118MiB/s (124MB/s)(1184MiB/10038msec); 0 zone resets 00:19:48.061 slat (usec): min=18, max=82841, avg=1496.25, stdev=4695.47 00:19:48.061 clat (usec): min=1375, max=336246, avg=134128.71, stdev=88844.83 00:19:48.061 lat (msec): min=2, max=336, avg=135.62, stdev=90.08 00:19:48.061 clat percentiles (msec): 00:19:48.061 | 1.00th=[ 7], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 33], 00:19:48.061 | 30.00th=[ 66], 40.00th=[ 107], 50.00th=[ 129], 60.00th=[ 155], 00:19:48.061 | 70.00th=[ 186], 80.00th=[ 230], 90.00th=[ 262], 95.00th=[ 275], 00:19:48.061 | 99.00th=[ 309], 99.50th=[ 313], 99.90th=[ 330], 99.95th=[ 334], 00:19:48.061 | 99.99th=[ 338] 00:19:48.061 bw ( KiB/s): min=64512, max=236032, per=8.54%, avg=119603.20, stdev=49516.24, samples=20 00:19:48.061 iops : min= 252, max= 922, avg=467.20, stdev=193.42, samples=20 00:19:48.061 lat (msec) : 2=0.02%, 4=0.51%, 10=2.11%, 20=7.41%, 50=16.07% 00:19:48.061 lat (msec) : 100=10.94%, 250=48.85%, 500=14.09% 00:19:48.061 cpu : usr=1.67%, sys=1.69%, ctx=2978, majf=0, minf=1 00:19:48.061 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:19:48.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.061 issued rwts: total=0,4735,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.061 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.061 job10: (groupid=0, jobs=1): err= 0: pid=1309181: Fri Jul 12 12:33:41 2024 00:19:48.061 write: IOPS=552, BW=138MiB/s (145MB/s)(1394MiB/10086msec); 0 zone resets 00:19:48.061 slat (usec): min=14, max=83274, avg=1252.12, stdev=3870.95 00:19:48.061 clat (usec): min=891, max=331532, avg=114387.95, stdev=74142.19 00:19:48.061 lat (usec): min=974, max=337704, avg=115640.07, stdev=75054.97 00:19:48.061 clat percentiles (msec): 00:19:48.061 | 1.00th=[ 6], 5.00th=[ 20], 10.00th=[ 35], 20.00th=[ 54], 00:19:48.061 | 30.00th=[ 70], 40.00th=[ 83], 50.00th=[ 93], 60.00th=[ 113], 00:19:48.061 | 70.00th=[ 134], 80.00th=[ 178], 90.00th=[ 232], 95.00th=[ 264], 00:19:48.061 | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 326], 99.95th=[ 330], 00:19:48.061 | 99.99th=[ 334] 00:19:48.061 bw ( KiB/s): min=55296, max=249344, per=10.08%, avg=141124.05, stdev=58846.62, samples=20 00:19:48.061 iops : min= 216, max= 974, avg=551.25, stdev=229.88, samples=20 00:19:48.061 lat (usec) : 1000=0.04% 00:19:48.061 lat (msec) : 2=0.23%, 4=0.41%, 10=1.76%, 20=2.65%, 50=12.98% 00:19:48.061 lat (msec) : 100=35.81%, 250=38.34%, 500=7.77% 00:19:48.061 cpu : usr=2.02%, sys=2.06%, ctx=3083, majf=0, minf=1 00:19:48.061 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:48.061 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:48.061 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:19:48.061 issued rwts: total=0,5576,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:48.061 latency : target=0, window=0, percentile=100.00%, depth=64 00:19:48.061 00:19:48.061 Run status group 0 (all jobs): 00:19:48.061 WRITE: bw=1367MiB/s (1433MB/s), 95.4MiB/s-156MiB/s (100.0MB/s-163MB/s), io=13.6GiB (14.6GB), run=10038-10184msec 00:19:48.061 00:19:48.061 Disk stats (read/write): 00:19:48.061 nvme0n1: ios=50/7733, merge=0/0, ticks=1025/1237556, in_queue=1238581, util=100.00% 00:19:48.061 nvme10n1: ios=48/9561, merge=0/0, ticks=242/1239168, in_queue=1239410, util=99.20% 00:19:48.061 nvme1n1: ios=0/8663, merge=0/0, ticks=0/1215133, in_queue=1215133, util=97.37% 00:19:48.061 nvme2n1: ios=42/11592, merge=0/0, ticks=951/1247343, in_queue=1248294, util=100.00% 00:19:48.061 nvme3n1: ios=46/12308, merge=0/0, ticks=2940/1200666, in_queue=1203606, util=100.00% 00:19:48.061 nvme4n1: ios=44/8930, merge=0/0, ticks=2189/1202937, in_queue=1205126, util=100.00% 00:19:48.061 nvme5n1: ios=0/8777, merge=0/0, ticks=0/1242189, in_queue=1242189, util=98.21% 00:19:48.061 nvme6n1: ios=42/9497, merge=0/0, ticks=668/1213696, in_queue=1214364, util=100.00% 00:19:48.061 nvme7n1: ios=0/12580, merge=0/0, ticks=0/1243554, in_queue=1243554, util=98.81% 00:19:48.061 nvme8n1: ios=39/9030, merge=0/0, ticks=624/1215628, in_queue=1216252, util=100.00% 00:19:48.061 nvme9n1: ios=44/10851, merge=0/0, ticks=604/1219226, in_queue=1219830, util=99.91% 00:19:48.061 12:33:41 -- target/multiconnection.sh@36 -- # sync 00:19:48.061 12:33:41 -- target/multiconnection.sh@37 -- # seq 1 11 00:19:48.061 12:33:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.061 12:33:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:48.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:48.061 12:33:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:19:48.061 12:33:41 -- common/autotest_common.sh@1198 -- # local i=0 00:19:48.061 12:33:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:48.061 12:33:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK1 00:19:48.061 12:33:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:48.061 12:33:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK1 00:19:48.061 12:33:41 -- common/autotest_common.sh@1210 -- # return 0 00:19:48.061 12:33:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:48.061 12:33:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:48.061 12:33:41 -- common/autotest_common.sh@10 -- # set +x 00:19:48.061 12:33:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:48.061 12:33:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.061 12:33:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:19:48.061 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:19:48.061 12:33:41 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:19:48.061 12:33:41 -- common/autotest_common.sh@1198 -- # local i=0 00:19:48.061 12:33:41 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:48.061 12:33:41 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK2 00:19:48.061 12:33:41 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:48.061 12:33:41 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK2 00:19:48.061 12:33:41 -- common/autotest_common.sh@1210 -- # return 0 00:19:48.061 12:33:41 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:19:48.061 12:33:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:48.061 12:33:41 -- common/autotest_common.sh@10 -- # set +x 00:19:48.061 12:33:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:48.061 12:33:41 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.061 12:33:41 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:19:48.627 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:19:48.627 12:33:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:19:48.627 12:33:42 -- common/autotest_common.sh@1198 -- # local i=0 00:19:48.627 12:33:42 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:48.627 12:33:42 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK3 00:19:48.627 12:33:42 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:48.627 12:33:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK3 00:19:48.627 12:33:42 -- common/autotest_common.sh@1210 -- # return 0 00:19:48.627 12:33:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:19:48.627 12:33:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:48.627 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:19:48.627 12:33:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:48.627 12:33:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.627 12:33:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:19:48.885 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:19:48.885 12:33:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:19:48.885 12:33:42 -- common/autotest_common.sh@1198 -- # local i=0 00:19:48.885 12:33:42 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:48.885 12:33:42 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK4 00:19:48.885 12:33:42 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:48.885 12:33:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK4 00:19:48.885 12:33:42 -- common/autotest_common.sh@1210 -- # return 0 00:19:48.885 12:33:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:19:48.885 12:33:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:48.885 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:19:48.885 12:33:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:48.885 12:33:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.885 12:33:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:19:48.885 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:19:48.885 12:33:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:19:48.885 12:33:42 -- common/autotest_common.sh@1198 -- # local i=0 00:19:48.885 12:33:42 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:48.885 12:33:42 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK5 00:19:48.885 12:33:42 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:48.885 12:33:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK5 00:19:48.885 12:33:42 -- common/autotest_common.sh@1210 -- # return 0 00:19:48.885 12:33:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:19:48.885 12:33:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:48.885 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:19:48.885 12:33:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:48.885 12:33:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:48.885 12:33:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:19:49.143 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:19:49.143 12:33:42 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:19:49.143 12:33:42 -- common/autotest_common.sh@1198 -- # local i=0 00:19:49.143 12:33:42 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:49.143 12:33:42 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK6 00:19:49.143 12:33:42 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:49.143 12:33:42 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK6 00:19:49.143 12:33:42 -- common/autotest_common.sh@1210 -- # return 0 00:19:49.143 12:33:42 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:19:49.143 12:33:42 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:49.143 12:33:42 -- common/autotest_common.sh@10 -- # set +x 00:19:49.143 12:33:42 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:49.143 12:33:42 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.143 12:33:42 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:19:49.400 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:19:49.400 12:33:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:19:49.400 12:33:43 -- common/autotest_common.sh@1198 -- # local i=0 00:19:49.400 12:33:43 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:49.400 12:33:43 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK7 00:19:49.400 12:33:43 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:49.400 12:33:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK7 00:19:49.400 12:33:43 -- common/autotest_common.sh@1210 -- # return 0 00:19:49.400 12:33:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:19:49.400 12:33:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:49.400 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:19:49.400 12:33:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:49.400 12:33:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.400 12:33:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:19:49.657 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:19:49.657 12:33:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:19:49.657 12:33:43 -- common/autotest_common.sh@1198 -- # local i=0 00:19:49.657 12:33:43 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:49.657 12:33:43 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK8 00:19:49.657 12:33:43 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:49.657 12:33:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK8 00:19:49.657 12:33:43 -- common/autotest_common.sh@1210 -- # return 0 00:19:49.657 12:33:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:19:49.657 12:33:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:49.657 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:19:49.657 12:33:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:49.657 12:33:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.657 12:33:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:19:49.914 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:19:49.914 12:33:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:19:49.914 12:33:43 -- common/autotest_common.sh@1198 -- # local i=0 00:19:49.914 12:33:43 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:49.914 12:33:43 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK9 00:19:49.914 12:33:43 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:49.914 12:33:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK9 00:19:49.914 12:33:43 -- common/autotest_common.sh@1210 -- # return 0 00:19:49.914 12:33:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:19:49.914 12:33:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:49.914 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:19:49.914 12:33:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:49.914 12:33:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.914 12:33:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:19:49.914 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:19:49.914 12:33:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:19:49.914 12:33:43 -- common/autotest_common.sh@1198 -- # local i=0 00:19:49.914 12:33:43 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:49.914 12:33:43 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK10 00:19:49.914 12:33:43 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:49.914 12:33:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK10 00:19:49.914 12:33:43 -- common/autotest_common.sh@1210 -- # return 0 00:19:49.914 12:33:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:19:49.914 12:33:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:49.914 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:19:49.914 12:33:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:49.914 12:33:43 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.914 12:33:43 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:19:50.172 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:19:50.172 12:33:43 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:19:50.172 12:33:43 -- common/autotest_common.sh@1198 -- # local i=0 00:19:50.172 12:33:43 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:19:50.172 12:33:43 -- common/autotest_common.sh@1199 -- # grep -q -w SPDK11 00:19:50.172 12:33:43 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:19:50.172 12:33:43 -- common/autotest_common.sh@1206 -- # grep -q -w SPDK11 00:19:50.172 12:33:43 -- common/autotest_common.sh@1210 -- # return 0 00:19:50.172 12:33:43 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:19:50.172 12:33:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:50.172 12:33:43 -- common/autotest_common.sh@10 -- # set +x 00:19:50.172 12:33:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:50.172 12:33:43 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:19:50.172 12:33:43 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:19:50.172 12:33:43 -- target/multiconnection.sh@47 -- # nvmftestfini 00:19:50.172 12:33:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:50.172 12:33:43 -- nvmf/common.sh@116 -- # sync 00:19:50.172 12:33:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:50.172 12:33:43 -- nvmf/common.sh@119 -- # set +e 00:19:50.172 12:33:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:50.172 12:33:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:50.172 rmmod nvme_tcp 00:19:50.172 rmmod nvme_fabrics 00:19:50.172 rmmod nvme_keyring 00:19:50.172 12:33:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:50.172 12:33:43 -- nvmf/common.sh@123 -- # set -e 00:19:50.172 12:33:43 -- nvmf/common.sh@124 -- # return 0 00:19:50.172 12:33:43 -- nvmf/common.sh@477 -- # '[' -n 1302828 ']' 00:19:50.172 12:33:43 -- nvmf/common.sh@478 -- # killprocess 1302828 00:19:50.172 12:33:43 -- common/autotest_common.sh@926 -- # '[' -z 1302828 ']' 00:19:50.172 12:33:43 -- common/autotest_common.sh@930 -- # kill -0 1302828 00:19:50.172 12:33:43 -- common/autotest_common.sh@931 -- # uname 00:19:50.172 12:33:43 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:19:50.172 12:33:43 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1302828 00:19:50.173 12:33:43 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:19:50.173 12:33:43 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:19:50.173 12:33:43 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1302828' 00:19:50.173 killing process with pid 1302828 00:19:50.173 12:33:43 -- common/autotest_common.sh@945 -- # kill 1302828 00:19:50.173 12:33:43 -- common/autotest_common.sh@950 -- # wait 1302828 00:19:50.746 12:33:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:50.746 12:33:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:50.746 12:33:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:50.746 12:33:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:50.746 12:33:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:50.746 12:33:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:50.746 12:33:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:50.747 12:33:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:52.673 12:33:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:52.673 00:19:52.673 real 1m1.366s 00:19:52.673 user 3m27.120s 00:19:52.673 sys 0m24.011s 00:19:52.673 12:33:46 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:19:52.673 12:33:46 -- common/autotest_common.sh@10 -- # set +x 00:19:52.673 ************************************ 00:19:52.673 END TEST nvmf_multiconnection 00:19:52.673 ************************************ 00:19:52.673 12:33:46 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:52.673 12:33:46 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:19:52.673 12:33:46 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:19:52.673 12:33:46 -- common/autotest_common.sh@10 -- # set +x 00:19:52.673 ************************************ 00:19:52.673 START TEST nvmf_initiator_timeout 00:19:52.673 ************************************ 00:19:52.673 12:33:46 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:19:52.931 * Looking for test storage... 00:19:52.931 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:52.931 12:33:46 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:52.931 12:33:46 -- nvmf/common.sh@7 -- # uname -s 00:19:52.931 12:33:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:52.931 12:33:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:52.931 12:33:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:52.931 12:33:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:52.931 12:33:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:52.931 12:33:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:52.931 12:33:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:52.931 12:33:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:52.931 12:33:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:52.931 12:33:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:52.931 12:33:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:52.931 12:33:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:52.931 12:33:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:52.931 12:33:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:52.931 12:33:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:52.931 12:33:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:52.931 12:33:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:52.931 12:33:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:52.931 12:33:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:52.931 12:33:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.931 12:33:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.931 12:33:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.931 12:33:46 -- paths/export.sh@5 -- # export PATH 00:19:52.931 12:33:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.931 12:33:46 -- nvmf/common.sh@46 -- # : 0 00:19:52.931 12:33:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:52.931 12:33:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:52.931 12:33:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:52.931 12:33:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:52.931 12:33:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:52.931 12:33:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:52.931 12:33:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:52.931 12:33:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:52.931 12:33:46 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:52.931 12:33:46 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:52.931 12:33:46 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:19:52.931 12:33:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:52.931 12:33:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:52.931 12:33:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:52.931 12:33:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:52.931 12:33:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:52.931 12:33:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:52.931 12:33:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:52.932 12:33:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:52.932 12:33:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:52.932 12:33:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:52.932 12:33:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:52.932 12:33:46 -- common/autotest_common.sh@10 -- # set +x 00:19:54.832 12:33:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:54.832 12:33:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:54.832 12:33:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:54.832 12:33:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:54.832 12:33:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:54.832 12:33:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:54.832 12:33:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:54.832 12:33:48 -- nvmf/common.sh@294 -- # net_devs=() 00:19:54.832 12:33:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:54.832 12:33:48 -- nvmf/common.sh@295 -- # e810=() 00:19:54.832 12:33:48 -- nvmf/common.sh@295 -- # local -ga e810 00:19:54.832 12:33:48 -- nvmf/common.sh@296 -- # x722=() 00:19:54.832 12:33:48 -- nvmf/common.sh@296 -- # local -ga x722 00:19:54.832 12:33:48 -- nvmf/common.sh@297 -- # mlx=() 00:19:54.832 12:33:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:54.832 12:33:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:54.832 12:33:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:54.832 12:33:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:54.832 12:33:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:54.832 12:33:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:54.832 12:33:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:54.832 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:54.832 12:33:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:54.832 12:33:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:54.832 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:54.832 12:33:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:54.832 12:33:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:54.832 12:33:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:54.832 12:33:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:54.832 12:33:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:54.832 12:33:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:54.832 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:54.832 12:33:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:54.832 12:33:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:54.832 12:33:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:54.832 12:33:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:54.832 12:33:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:54.832 12:33:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:54.832 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:54.832 12:33:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:54.832 12:33:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:54.832 12:33:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:54.832 12:33:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:54.832 12:33:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:54.832 12:33:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:54.832 12:33:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:54.832 12:33:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:54.832 12:33:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:54.832 12:33:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:54.832 12:33:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:54.832 12:33:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:54.832 12:33:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:54.832 12:33:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:54.832 12:33:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:54.832 12:33:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:54.832 12:33:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:54.832 12:33:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:54.832 12:33:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:54.832 12:33:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:54.832 12:33:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:54.832 12:33:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:55.091 12:33:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:55.091 12:33:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:55.091 12:33:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:55.091 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:55.091 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.115 ms 00:19:55.091 00:19:55.091 --- 10.0.0.2 ping statistics --- 00:19:55.091 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:55.091 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:19:55.091 12:33:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:55.091 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:55.091 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:19:55.091 00:19:55.091 --- 10.0.0.1 ping statistics --- 00:19:55.091 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:55.091 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:19:55.091 12:33:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:55.091 12:33:48 -- nvmf/common.sh@410 -- # return 0 00:19:55.091 12:33:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:55.091 12:33:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:55.091 12:33:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:55.091 12:33:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:55.091 12:33:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:55.091 12:33:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:55.091 12:33:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:55.091 12:33:48 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:19:55.091 12:33:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:55.091 12:33:48 -- common/autotest_common.sh@712 -- # xtrace_disable 00:19:55.091 12:33:48 -- common/autotest_common.sh@10 -- # set +x 00:19:55.091 12:33:48 -- nvmf/common.sh@469 -- # nvmfpid=1312687 00:19:55.091 12:33:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:55.091 12:33:48 -- nvmf/common.sh@470 -- # waitforlisten 1312687 00:19:55.091 12:33:48 -- common/autotest_common.sh@819 -- # '[' -z 1312687 ']' 00:19:55.091 12:33:48 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:55.091 12:33:48 -- common/autotest_common.sh@824 -- # local max_retries=100 00:19:55.091 12:33:48 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:55.091 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:55.091 12:33:48 -- common/autotest_common.sh@828 -- # xtrace_disable 00:19:55.091 12:33:48 -- common/autotest_common.sh@10 -- # set +x 00:19:55.091 [2024-07-12 12:33:48.852622] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:19:55.091 [2024-07-12 12:33:48.852686] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:55.091 EAL: No free 2048 kB hugepages reported on node 1 00:19:55.091 [2024-07-12 12:33:48.919064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:55.349 [2024-07-12 12:33:49.041108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:55.349 [2024-07-12 12:33:49.041266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:55.349 [2024-07-12 12:33:49.041286] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:55.349 [2024-07-12 12:33:49.041300] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:55.349 [2024-07-12 12:33:49.041404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:55.349 [2024-07-12 12:33:49.044888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:55.349 [2024-07-12 12:33:49.044924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:55.349 [2024-07-12 12:33:49.044929] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:55.915 12:33:49 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:19:55.915 12:33:49 -- common/autotest_common.sh@852 -- # return 0 00:19:55.915 12:33:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:55.915 12:33:49 -- common/autotest_common.sh@718 -- # xtrace_disable 00:19:55.915 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:55.915 12:33:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:55.915 12:33:49 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:19:55.915 12:33:49 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:55.915 12:33:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:55.915 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:56.172 Malloc0 00:19:56.172 12:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.172 12:33:49 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:19:56.172 12:33:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.172 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:56.172 Delay0 00:19:56.172 12:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.172 12:33:49 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:56.172 12:33:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.172 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:56.172 [2024-07-12 12:33:49.847033] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:56.172 12:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.172 12:33:49 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:56.172 12:33:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.172 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:56.172 12:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.172 12:33:49 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:19:56.172 12:33:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.172 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:56.172 12:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.172 12:33:49 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:56.172 12:33:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:19:56.173 12:33:49 -- common/autotest_common.sh@10 -- # set +x 00:19:56.173 [2024-07-12 12:33:49.875350] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:56.173 12:33:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:19:56.173 12:33:49 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:56.747 12:33:50 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:19:56.747 12:33:50 -- common/autotest_common.sh@1177 -- # local i=0 00:19:56.747 12:33:50 -- common/autotest_common.sh@1178 -- # local nvme_device_counter=1 nvme_devices=0 00:19:56.747 12:33:50 -- common/autotest_common.sh@1179 -- # [[ -n '' ]] 00:19:56.747 12:33:50 -- common/autotest_common.sh@1184 -- # sleep 2 00:19:58.643 12:33:52 -- common/autotest_common.sh@1185 -- # (( i++ <= 15 )) 00:19:58.643 12:33:52 -- common/autotest_common.sh@1186 -- # lsblk -l -o NAME,SERIAL 00:19:58.643 12:33:52 -- common/autotest_common.sh@1186 -- # grep -c SPDKISFASTANDAWESOME 00:19:58.643 12:33:52 -- common/autotest_common.sh@1186 -- # nvme_devices=1 00:19:58.643 12:33:52 -- common/autotest_common.sh@1187 -- # (( nvme_devices == nvme_device_counter )) 00:19:58.643 12:33:52 -- common/autotest_common.sh@1187 -- # return 0 00:19:58.643 12:33:52 -- target/initiator_timeout.sh@35 -- # fio_pid=1313135 00:19:58.643 12:33:52 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:19:58.643 12:33:52 -- target/initiator_timeout.sh@37 -- # sleep 3 00:19:58.643 [global] 00:19:58.643 thread=1 00:19:58.643 invalidate=1 00:19:58.643 rw=write 00:19:58.643 time_based=1 00:19:58.643 runtime=60 00:19:58.643 ioengine=libaio 00:19:58.643 direct=1 00:19:58.643 bs=4096 00:19:58.643 iodepth=1 00:19:58.643 norandommap=0 00:19:58.643 numjobs=1 00:19:58.643 00:19:58.643 verify_dump=1 00:19:58.643 verify_backlog=512 00:19:58.643 verify_state_save=0 00:19:58.643 do_verify=1 00:19:58.643 verify=crc32c-intel 00:19:58.643 [job0] 00:19:58.643 filename=/dev/nvme0n1 00:19:58.643 Could not set queue depth (nvme0n1) 00:19:58.900 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:58.900 fio-3.35 00:19:58.900 Starting 1 thread 00:20:02.176 12:33:55 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:02.176 12:33:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:02.176 12:33:55 -- common/autotest_common.sh@10 -- # set +x 00:20:02.176 true 00:20:02.176 12:33:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:02.176 12:33:55 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:02.176 12:33:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:02.176 12:33:55 -- common/autotest_common.sh@10 -- # set +x 00:20:02.176 true 00:20:02.176 12:33:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:02.176 12:33:55 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:02.176 12:33:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:02.176 12:33:55 -- common/autotest_common.sh@10 -- # set +x 00:20:02.176 true 00:20:02.176 12:33:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:02.176 12:33:55 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:02.176 12:33:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:02.176 12:33:55 -- common/autotest_common.sh@10 -- # set +x 00:20:02.176 true 00:20:02.176 12:33:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:02.176 12:33:55 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:04.701 12:33:58 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:04.701 12:33:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.701 12:33:58 -- common/autotest_common.sh@10 -- # set +x 00:20:04.701 true 00:20:04.701 12:33:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.701 12:33:58 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:04.701 12:33:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.701 12:33:58 -- common/autotest_common.sh@10 -- # set +x 00:20:04.701 true 00:20:04.701 12:33:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.701 12:33:58 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:04.701 12:33:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.701 12:33:58 -- common/autotest_common.sh@10 -- # set +x 00:20:04.701 true 00:20:04.701 12:33:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.701 12:33:58 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:04.701 12:33:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:20:04.701 12:33:58 -- common/autotest_common.sh@10 -- # set +x 00:20:04.701 true 00:20:04.701 12:33:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:20:04.701 12:33:58 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:04.701 12:33:58 -- target/initiator_timeout.sh@54 -- # wait 1313135 00:21:00.899 00:21:00.899 job0: (groupid=0, jobs=1): err= 0: pid=1313204: Fri Jul 12 12:34:52 2024 00:21:00.899 read: IOPS=198, BW=793KiB/s (812kB/s)(46.4MiB/60001msec) 00:21:00.899 slat (nsec): min=4898, max=71591, avg=13359.50, stdev=8371.84 00:21:00.899 clat (usec): min=208, max=40969k, avg=4804.36, stdev=375800.03 00:21:00.899 lat (usec): min=215, max=40969k, avg=4817.71, stdev=375800.09 00:21:00.899 clat percentiles (usec): 00:21:00.899 | 1.00th=[ 229], 5.00th=[ 235], 10.00th=[ 241], 20.00th=[ 247], 00:21:00.899 | 30.00th=[ 253], 40.00th=[ 262], 50.00th=[ 273], 60.00th=[ 281], 00:21:00.899 | 70.00th=[ 297], 80.00th=[ 314], 90.00th=[ 334], 95.00th=[ 363], 00:21:00.899 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:21:00.899 | 99.99th=[42730] 00:21:00.899 write: IOPS=204, BW=819KiB/s (839kB/s)(48.0MiB/60001msec); 0 zone resets 00:21:00.899 slat (nsec): min=5707, max=84070, avg=13074.89, stdev=7106.92 00:21:00.899 clat (usec): min=161, max=1969, avg=201.47, stdev=30.03 00:21:00.899 lat (usec): min=168, max=2021, avg=214.55, stdev=34.14 00:21:00.899 clat percentiles (usec): 00:21:00.899 | 1.00th=[ 169], 5.00th=[ 176], 10.00th=[ 180], 20.00th=[ 184], 00:21:00.899 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 200], 00:21:00.899 | 70.00th=[ 206], 80.00th=[ 215], 90.00th=[ 229], 95.00th=[ 243], 00:21:00.899 | 99.00th=[ 306], 99.50th=[ 343], 99.90th=[ 408], 99.95th=[ 412], 00:21:00.899 | 99.99th=[ 437] 00:21:00.899 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=1839.04, samples=16 00:21:00.899 iops : min= 1024, max= 2048, avg=1536.00, stdev=459.76, samples=16 00:21:00.899 lat (usec) : 250=61.73%, 500=36.96%, 750=0.01% 00:21:00.899 lat (msec) : 2=0.01%, 50=1.29%, >=2000=0.01% 00:21:00.899 cpu : usr=0.36%, sys=0.61%, ctx=24177, majf=0, minf=2 00:21:00.899 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:00.899 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:00.899 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:00.899 issued rwts: total=11888,12288,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:00.899 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:00.899 00:21:00.899 Run status group 0 (all jobs): 00:21:00.899 READ: bw=793KiB/s (812kB/s), 793KiB/s-793KiB/s (812kB/s-812kB/s), io=46.4MiB (48.7MB), run=60001-60001msec 00:21:00.899 WRITE: bw=819KiB/s (839kB/s), 819KiB/s-819KiB/s (839kB/s-839kB/s), io=48.0MiB (50.3MB), run=60001-60001msec 00:21:00.899 00:21:00.899 Disk stats (read/write): 00:21:00.899 nvme0n1: ios=11970/12288, merge=0/0, ticks=15968/2424, in_queue=18392, util=99.86% 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:00.899 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:00.899 12:34:52 -- common/autotest_common.sh@1198 -- # local i=0 00:21:00.899 12:34:52 -- common/autotest_common.sh@1199 -- # lsblk -o NAME,SERIAL 00:21:00.899 12:34:52 -- common/autotest_common.sh@1199 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:00.899 12:34:52 -- common/autotest_common.sh@1206 -- # lsblk -l -o NAME,SERIAL 00:21:00.899 12:34:52 -- common/autotest_common.sh@1206 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:00.899 12:34:52 -- common/autotest_common.sh@1210 -- # return 0 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:00.899 nvmf hotplug test: fio successful as expected 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:00.899 12:34:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:00.899 12:34:52 -- common/autotest_common.sh@10 -- # set +x 00:21:00.899 12:34:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:00.899 12:34:52 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:00.899 12:34:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:00.899 12:34:52 -- nvmf/common.sh@116 -- # sync 00:21:00.899 12:34:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:00.899 12:34:52 -- nvmf/common.sh@119 -- # set +e 00:21:00.899 12:34:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:00.899 12:34:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:00.899 rmmod nvme_tcp 00:21:00.899 rmmod nvme_fabrics 00:21:00.899 rmmod nvme_keyring 00:21:00.899 12:34:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:00.899 12:34:52 -- nvmf/common.sh@123 -- # set -e 00:21:00.899 12:34:52 -- nvmf/common.sh@124 -- # return 0 00:21:00.899 12:34:52 -- nvmf/common.sh@477 -- # '[' -n 1312687 ']' 00:21:00.899 12:34:52 -- nvmf/common.sh@478 -- # killprocess 1312687 00:21:00.899 12:34:52 -- common/autotest_common.sh@926 -- # '[' -z 1312687 ']' 00:21:00.899 12:34:52 -- common/autotest_common.sh@930 -- # kill -0 1312687 00:21:00.899 12:34:52 -- common/autotest_common.sh@931 -- # uname 00:21:00.899 12:34:52 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:00.899 12:34:52 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1312687 00:21:00.899 12:34:53 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:00.899 12:34:53 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:00.899 12:34:53 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1312687' 00:21:00.899 killing process with pid 1312687 00:21:00.899 12:34:53 -- common/autotest_common.sh@945 -- # kill 1312687 00:21:00.899 12:34:53 -- common/autotest_common.sh@950 -- # wait 1312687 00:21:00.899 12:34:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:00.899 12:34:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:00.899 12:34:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:00.899 12:34:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:00.899 12:34:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:00.899 12:34:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:00.899 12:34:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:00.899 12:34:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:01.496 12:34:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:01.496 00:21:01.496 real 1m8.761s 00:21:01.496 user 4m12.439s 00:21:01.496 sys 0m7.338s 00:21:01.496 12:34:55 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:01.496 12:34:55 -- common/autotest_common.sh@10 -- # set +x 00:21:01.496 ************************************ 00:21:01.496 END TEST nvmf_initiator_timeout 00:21:01.496 ************************************ 00:21:01.496 12:34:55 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:01.496 12:34:55 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:01.496 12:34:55 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:01.496 12:34:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:01.496 12:34:55 -- common/autotest_common.sh@10 -- # set +x 00:21:04.030 12:34:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:04.030 12:34:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:04.030 12:34:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:04.030 12:34:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:04.030 12:34:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:04.030 12:34:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:04.030 12:34:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:04.030 12:34:57 -- nvmf/common.sh@294 -- # net_devs=() 00:21:04.030 12:34:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:04.030 12:34:57 -- nvmf/common.sh@295 -- # e810=() 00:21:04.030 12:34:57 -- nvmf/common.sh@295 -- # local -ga e810 00:21:04.030 12:34:57 -- nvmf/common.sh@296 -- # x722=() 00:21:04.030 12:34:57 -- nvmf/common.sh@296 -- # local -ga x722 00:21:04.030 12:34:57 -- nvmf/common.sh@297 -- # mlx=() 00:21:04.030 12:34:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:04.030 12:34:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:04.030 12:34:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:04.030 12:34:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:04.030 12:34:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:04.030 12:34:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:04.030 12:34:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:04.030 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:04.030 12:34:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:04.030 12:34:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:04.030 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:04.030 12:34:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:04.030 12:34:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:04.030 12:34:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:04.030 12:34:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:04.030 12:34:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:04.030 12:34:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:04.030 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:04.030 12:34:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:04.030 12:34:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:04.030 12:34:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:04.030 12:34:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:04.030 12:34:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:04.030 12:34:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:04.030 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:04.030 12:34:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:04.030 12:34:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:04.030 12:34:57 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:04.030 12:34:57 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:04.030 12:34:57 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:04.030 12:34:57 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:04.030 12:34:57 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:04.030 12:34:57 -- common/autotest_common.sh@10 -- # set +x 00:21:04.030 ************************************ 00:21:04.030 START TEST nvmf_perf_adq 00:21:04.030 ************************************ 00:21:04.030 12:34:57 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:04.030 * Looking for test storage... 00:21:04.030 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:04.030 12:34:57 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:04.030 12:34:57 -- nvmf/common.sh@7 -- # uname -s 00:21:04.030 12:34:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:04.030 12:34:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:04.030 12:34:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:04.030 12:34:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:04.030 12:34:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:04.030 12:34:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:04.030 12:34:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:04.030 12:34:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:04.030 12:34:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:04.030 12:34:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:04.030 12:34:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:04.030 12:34:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:04.030 12:34:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:04.030 12:34:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:04.030 12:34:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:04.030 12:34:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:04.030 12:34:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:04.030 12:34:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:04.030 12:34:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:04.030 12:34:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.031 12:34:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.031 12:34:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.031 12:34:57 -- paths/export.sh@5 -- # export PATH 00:21:04.031 12:34:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:04.031 12:34:57 -- nvmf/common.sh@46 -- # : 0 00:21:04.031 12:34:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:04.031 12:34:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:04.031 12:34:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:04.031 12:34:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:04.031 12:34:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:04.031 12:34:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:04.031 12:34:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:04.031 12:34:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:04.031 12:34:57 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:04.031 12:34:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:04.031 12:34:57 -- common/autotest_common.sh@10 -- # set +x 00:21:05.934 12:34:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:05.934 12:34:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:05.934 12:34:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:05.934 12:34:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:05.934 12:34:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:05.934 12:34:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:05.934 12:34:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:05.934 12:34:59 -- nvmf/common.sh@294 -- # net_devs=() 00:21:05.934 12:34:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:05.934 12:34:59 -- nvmf/common.sh@295 -- # e810=() 00:21:05.934 12:34:59 -- nvmf/common.sh@295 -- # local -ga e810 00:21:05.934 12:34:59 -- nvmf/common.sh@296 -- # x722=() 00:21:05.934 12:34:59 -- nvmf/common.sh@296 -- # local -ga x722 00:21:05.934 12:34:59 -- nvmf/common.sh@297 -- # mlx=() 00:21:05.934 12:34:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:05.934 12:34:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:05.934 12:34:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:05.934 12:34:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:05.934 12:34:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:05.934 12:34:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:05.934 12:34:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:05.934 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:05.934 12:34:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:05.934 12:34:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:05.934 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:05.934 12:34:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:05.934 12:34:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:05.934 12:34:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:05.934 12:34:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:05.934 12:34:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:05.934 12:34:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:05.934 12:34:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:05.934 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:05.934 12:34:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:05.934 12:34:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:05.934 12:34:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:05.934 12:34:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:05.934 12:34:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:05.935 12:34:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:05.935 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:05.935 12:34:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:05.935 12:34:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:05.935 12:34:59 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:05.935 12:34:59 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:05.935 12:34:59 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:05.935 12:34:59 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:05.935 12:34:59 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:06.501 12:35:00 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:08.402 12:35:02 -- target/perf_adq.sh@54 -- # sleep 5 00:21:13.670 12:35:07 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:13.670 12:35:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:13.670 12:35:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:13.670 12:35:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:13.670 12:35:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:13.670 12:35:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:13.670 12:35:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:13.670 12:35:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:13.670 12:35:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:13.670 12:35:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:13.670 12:35:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:13.670 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.670 12:35:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:13.670 12:35:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:13.670 12:35:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:13.670 12:35:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:13.670 12:35:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:13.670 12:35:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:13.670 12:35:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:13.670 12:35:07 -- nvmf/common.sh@294 -- # net_devs=() 00:21:13.670 12:35:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:13.670 12:35:07 -- nvmf/common.sh@295 -- # e810=() 00:21:13.670 12:35:07 -- nvmf/common.sh@295 -- # local -ga e810 00:21:13.670 12:35:07 -- nvmf/common.sh@296 -- # x722=() 00:21:13.670 12:35:07 -- nvmf/common.sh@296 -- # local -ga x722 00:21:13.670 12:35:07 -- nvmf/common.sh@297 -- # mlx=() 00:21:13.670 12:35:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:13.670 12:35:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:13.670 12:35:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:13.670 12:35:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:13.670 12:35:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:13.670 12:35:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:13.670 12:35:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:13.670 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:13.670 12:35:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:13.670 12:35:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:13.670 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:13.670 12:35:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:13.670 12:35:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:13.670 12:35:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:13.670 12:35:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:13.670 12:35:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:13.670 12:35:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:13.670 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:13.670 12:35:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:13.670 12:35:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:13.670 12:35:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:13.670 12:35:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:13.670 12:35:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:13.670 12:35:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:13.670 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:13.670 12:35:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:13.670 12:35:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:13.670 12:35:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:13.670 12:35:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:13.670 12:35:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:13.670 12:35:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:13.670 12:35:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:13.670 12:35:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:13.671 12:35:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:13.671 12:35:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:13.671 12:35:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:13.671 12:35:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:13.671 12:35:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:13.671 12:35:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:13.671 12:35:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:13.671 12:35:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:13.671 12:35:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:13.671 12:35:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:13.671 12:35:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:13.671 12:35:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:13.671 12:35:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:13.671 12:35:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:13.671 12:35:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:13.671 12:35:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:13.671 12:35:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:13.671 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:13.671 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:21:13.671 00:21:13.671 --- 10.0.0.2 ping statistics --- 00:21:13.671 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:13.671 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:21:13.671 12:35:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:13.671 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:13.671 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:21:13.671 00:21:13.671 --- 10.0.0.1 ping statistics --- 00:21:13.671 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:13.671 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:21:13.671 12:35:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:13.671 12:35:07 -- nvmf/common.sh@410 -- # return 0 00:21:13.671 12:35:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:13.671 12:35:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:13.671 12:35:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:13.671 12:35:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:13.671 12:35:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:13.671 12:35:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:13.671 12:35:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:13.671 12:35:07 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:13.671 12:35:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:13.671 12:35:07 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:13.671 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.671 12:35:07 -- nvmf/common.sh@469 -- # nvmfpid=1324997 00:21:13.671 12:35:07 -- nvmf/common.sh@470 -- # waitforlisten 1324997 00:21:13.671 12:35:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:13.671 12:35:07 -- common/autotest_common.sh@819 -- # '[' -z 1324997 ']' 00:21:13.671 12:35:07 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:13.671 12:35:07 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:13.671 12:35:07 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:13.671 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:13.671 12:35:07 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:13.671 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.671 [2024-07-12 12:35:07.241731] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:13.671 [2024-07-12 12:35:07.241821] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:13.671 EAL: No free 2048 kB hugepages reported on node 1 00:21:13.671 [2024-07-12 12:35:07.312536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:13.671 [2024-07-12 12:35:07.420998] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:13.671 [2024-07-12 12:35:07.421149] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:13.671 [2024-07-12 12:35:07.421183] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:13.671 [2024-07-12 12:35:07.421196] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:13.671 [2024-07-12 12:35:07.421247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:13.671 [2024-07-12 12:35:07.421308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:13.671 [2024-07-12 12:35:07.421374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:13.671 [2024-07-12 12:35:07.421377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:13.671 12:35:07 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:13.671 12:35:07 -- common/autotest_common.sh@852 -- # return 0 00:21:13.671 12:35:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:13.671 12:35:07 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:13.671 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.671 12:35:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:13.671 12:35:07 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:13.671 12:35:07 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:13.671 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.671 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.671 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.671 12:35:07 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:13.671 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.671 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.929 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.929 12:35:07 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:13.929 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.929 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.929 [2024-07-12 12:35:07.594975] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:13.929 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.929 12:35:07 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:13.929 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.929 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.929 Malloc1 00:21:13.929 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.929 12:35:07 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:13.929 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.929 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.929 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.929 12:35:07 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:13.929 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.929 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.929 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.929 12:35:07 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:13.929 12:35:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:13.929 12:35:07 -- common/autotest_common.sh@10 -- # set +x 00:21:13.929 [2024-07-12 12:35:07.648492] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:13.929 12:35:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:13.929 12:35:07 -- target/perf_adq.sh@73 -- # perfpid=1325138 00:21:13.929 12:35:07 -- target/perf_adq.sh@74 -- # sleep 2 00:21:13.929 12:35:07 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:13.929 EAL: No free 2048 kB hugepages reported on node 1 00:21:15.830 12:35:09 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:15.830 12:35:09 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:15.830 12:35:09 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:15.830 12:35:09 -- target/perf_adq.sh@76 -- # wc -l 00:21:15.830 12:35:09 -- common/autotest_common.sh@10 -- # set +x 00:21:15.830 12:35:09 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:15.830 12:35:09 -- target/perf_adq.sh@76 -- # count=4 00:21:15.830 12:35:09 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:15.830 12:35:09 -- target/perf_adq.sh@81 -- # wait 1325138 00:21:25.796 Initializing NVMe Controllers 00:21:25.796 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:25.796 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:25.796 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:25.796 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:25.796 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:25.796 Initialization complete. Launching workers. 00:21:25.796 ======================================================== 00:21:25.796 Latency(us) 00:21:25.796 Device Information : IOPS MiB/s Average min max 00:21:25.796 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11299.60 44.14 5664.60 1455.30 9749.68 00:21:25.796 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11175.90 43.66 5726.93 1814.35 9610.34 00:21:25.796 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11305.30 44.16 5661.08 1631.63 9595.43 00:21:25.796 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11148.10 43.55 5741.19 1931.80 9689.00 00:21:25.796 ======================================================== 00:21:25.796 Total : 44928.89 175.50 5698.22 1455.30 9749.68 00:21:25.796 00:21:25.796 12:35:17 -- target/perf_adq.sh@82 -- # nvmftestfini 00:21:25.796 12:35:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:25.796 12:35:17 -- nvmf/common.sh@116 -- # sync 00:21:25.796 12:35:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:25.796 12:35:17 -- nvmf/common.sh@119 -- # set +e 00:21:25.796 12:35:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:25.796 12:35:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:25.796 rmmod nvme_tcp 00:21:25.796 rmmod nvme_fabrics 00:21:25.796 rmmod nvme_keyring 00:21:25.796 12:35:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:25.796 12:35:17 -- nvmf/common.sh@123 -- # set -e 00:21:25.796 12:35:17 -- nvmf/common.sh@124 -- # return 0 00:21:25.796 12:35:17 -- nvmf/common.sh@477 -- # '[' -n 1324997 ']' 00:21:25.796 12:35:17 -- nvmf/common.sh@478 -- # killprocess 1324997 00:21:25.796 12:35:17 -- common/autotest_common.sh@926 -- # '[' -z 1324997 ']' 00:21:25.796 12:35:17 -- common/autotest_common.sh@930 -- # kill -0 1324997 00:21:25.796 12:35:17 -- common/autotest_common.sh@931 -- # uname 00:21:25.796 12:35:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:25.796 12:35:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1324997 00:21:25.796 12:35:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:25.796 12:35:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:25.796 12:35:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1324997' 00:21:25.796 killing process with pid 1324997 00:21:25.796 12:35:17 -- common/autotest_common.sh@945 -- # kill 1324997 00:21:25.796 12:35:17 -- common/autotest_common.sh@950 -- # wait 1324997 00:21:25.796 12:35:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:25.796 12:35:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:25.796 12:35:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:25.796 12:35:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:25.796 12:35:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:25.796 12:35:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:25.796 12:35:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:25.796 12:35:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:26.729 12:35:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:26.729 12:35:20 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:21:26.729 12:35:20 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:26.987 12:35:20 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:29.513 12:35:22 -- target/perf_adq.sh@54 -- # sleep 5 00:21:34.823 12:35:27 -- target/perf_adq.sh@87 -- # nvmftestinit 00:21:34.823 12:35:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:34.823 12:35:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:34.823 12:35:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:34.823 12:35:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:34.823 12:35:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:34.823 12:35:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:34.823 12:35:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:34.823 12:35:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:34.823 12:35:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:34.823 12:35:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:34.823 12:35:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:34.823 12:35:27 -- common/autotest_common.sh@10 -- # set +x 00:21:34.823 12:35:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:34.823 12:35:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:34.823 12:35:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:34.823 12:35:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:34.823 12:35:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:34.823 12:35:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:34.823 12:35:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:34.823 12:35:27 -- nvmf/common.sh@294 -- # net_devs=() 00:21:34.823 12:35:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:34.823 12:35:27 -- nvmf/common.sh@295 -- # e810=() 00:21:34.823 12:35:27 -- nvmf/common.sh@295 -- # local -ga e810 00:21:34.823 12:35:27 -- nvmf/common.sh@296 -- # x722=() 00:21:34.823 12:35:27 -- nvmf/common.sh@296 -- # local -ga x722 00:21:34.823 12:35:27 -- nvmf/common.sh@297 -- # mlx=() 00:21:34.823 12:35:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:34.823 12:35:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:34.823 12:35:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:34.824 12:35:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:34.824 12:35:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:34.824 12:35:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.824 12:35:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:34.824 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:34.824 12:35:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:34.824 12:35:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:34.824 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:34.824 12:35:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:34.824 12:35:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.824 12:35:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.824 12:35:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.824 12:35:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.824 12:35:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:34.824 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:34.824 12:35:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.824 12:35:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:34.824 12:35:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:34.824 12:35:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:34.824 12:35:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:34.824 12:35:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:34.824 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:34.824 12:35:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:34.824 12:35:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:34.824 12:35:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:34.824 12:35:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:34.824 12:35:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:34.824 12:35:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:34.824 12:35:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:34.824 12:35:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:34.824 12:35:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:34.824 12:35:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:34.824 12:35:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:34.824 12:35:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:34.824 12:35:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:34.824 12:35:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:34.824 12:35:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:34.824 12:35:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:34.824 12:35:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:34.824 12:35:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:34.824 12:35:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:34.824 12:35:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:34.824 12:35:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:34.824 12:35:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:34.824 12:35:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:34.824 12:35:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:34.824 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:34.824 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.165 ms 00:21:34.824 00:21:34.824 --- 10.0.0.2 ping statistics --- 00:21:34.824 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:34.824 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:21:34.824 12:35:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:34.824 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:34.824 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:21:34.824 00:21:34.824 --- 10.0.0.1 ping statistics --- 00:21:34.824 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:34.824 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:21:34.824 12:35:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:34.824 12:35:27 -- nvmf/common.sh@410 -- # return 0 00:21:34.824 12:35:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:34.824 12:35:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:34.824 12:35:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:34.824 12:35:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:34.824 12:35:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:34.824 12:35:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:34.824 12:35:28 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:21:34.824 12:35:28 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:21:34.824 12:35:28 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:21:34.824 12:35:28 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:21:34.824 net.core.busy_poll = 1 00:21:34.824 12:35:28 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:21:34.824 net.core.busy_read = 1 00:21:34.824 12:35:28 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:21:34.824 12:35:28 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:21:34.824 12:35:28 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:21:34.824 12:35:28 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:21:34.824 12:35:28 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:21:34.824 12:35:28 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:34.824 12:35:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:34.824 12:35:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 12:35:28 -- nvmf/common.sh@469 -- # nvmfpid=1327838 00:21:34.824 12:35:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:34.824 12:35:28 -- nvmf/common.sh@470 -- # waitforlisten 1327838 00:21:34.824 12:35:28 -- common/autotest_common.sh@819 -- # '[' -z 1327838 ']' 00:21:34.824 12:35:28 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:34.824 12:35:28 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:34.824 12:35:28 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:34.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:34.824 12:35:28 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 [2024-07-12 12:35:28.171711] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:34.824 [2024-07-12 12:35:28.171793] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:34.824 EAL: No free 2048 kB hugepages reported on node 1 00:21:34.824 [2024-07-12 12:35:28.234871] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:34.824 [2024-07-12 12:35:28.339455] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:34.824 [2024-07-12 12:35:28.339608] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:34.824 [2024-07-12 12:35:28.339625] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:34.824 [2024-07-12 12:35:28.339638] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:34.824 [2024-07-12 12:35:28.339688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:34.824 [2024-07-12 12:35:28.339748] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:34.824 [2024-07-12 12:35:28.339816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:34.824 [2024-07-12 12:35:28.339818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:34.824 12:35:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:34.824 12:35:28 -- common/autotest_common.sh@852 -- # return 0 00:21:34.824 12:35:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:34.824 12:35:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 12:35:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:34.824 12:35:28 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:21:34.824 12:35:28 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:21:34.824 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.824 12:35:28 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:34.824 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.824 12:35:28 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:21:34.824 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 [2024-07-12 12:35:28.508379] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:34.824 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.824 12:35:28 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:34.824 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.824 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.824 Malloc1 00:21:34.824 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.825 12:35:28 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:34.825 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.825 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.825 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.825 12:35:28 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:34.825 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.825 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.825 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.825 12:35:28 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:34.825 12:35:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:34.825 12:35:28 -- common/autotest_common.sh@10 -- # set +x 00:21:34.825 [2024-07-12 12:35:28.558905] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:34.825 12:35:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:34.825 12:35:28 -- target/perf_adq.sh@94 -- # perfpid=1327861 00:21:34.825 12:35:28 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:34.825 12:35:28 -- target/perf_adq.sh@95 -- # sleep 2 00:21:34.825 EAL: No free 2048 kB hugepages reported on node 1 00:21:36.729 12:35:30 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:21:36.729 12:35:30 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:21:36.729 12:35:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:36.729 12:35:30 -- target/perf_adq.sh@97 -- # wc -l 00:21:36.729 12:35:30 -- common/autotest_common.sh@10 -- # set +x 00:21:36.729 12:35:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:36.729 12:35:30 -- target/perf_adq.sh@97 -- # count=2 00:21:36.729 12:35:30 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:21:36.729 12:35:30 -- target/perf_adq.sh@103 -- # wait 1327861 00:21:44.844 Initializing NVMe Controllers 00:21:44.844 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:21:44.844 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:21:44.844 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:21:44.844 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:21:44.844 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:21:44.844 Initialization complete. Launching workers. 00:21:44.844 ======================================================== 00:21:44.844 Latency(us) 00:21:44.844 Device Information : IOPS MiB/s Average min max 00:21:44.844 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5218.00 20.38 12268.39 1002.57 58615.43 00:21:44.844 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5592.70 21.85 11446.58 1159.89 60266.76 00:21:44.844 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 12606.40 49.24 5077.04 1231.12 46646.33 00:21:44.844 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 4972.70 19.42 12877.78 1112.99 57996.10 00:21:44.844 ======================================================== 00:21:44.844 Total : 28389.80 110.90 9019.94 1002.57 60266.76 00:21:44.844 00:21:44.844 12:35:38 -- target/perf_adq.sh@104 -- # nvmftestfini 00:21:44.844 12:35:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:44.844 12:35:38 -- nvmf/common.sh@116 -- # sync 00:21:44.844 12:35:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:44.844 12:35:38 -- nvmf/common.sh@119 -- # set +e 00:21:44.844 12:35:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:44.844 12:35:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:44.844 rmmod nvme_tcp 00:21:44.844 rmmod nvme_fabrics 00:21:44.844 rmmod nvme_keyring 00:21:44.844 12:35:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:44.844 12:35:38 -- nvmf/common.sh@123 -- # set -e 00:21:44.844 12:35:38 -- nvmf/common.sh@124 -- # return 0 00:21:44.844 12:35:38 -- nvmf/common.sh@477 -- # '[' -n 1327838 ']' 00:21:44.844 12:35:38 -- nvmf/common.sh@478 -- # killprocess 1327838 00:21:44.844 12:35:38 -- common/autotest_common.sh@926 -- # '[' -z 1327838 ']' 00:21:44.844 12:35:38 -- common/autotest_common.sh@930 -- # kill -0 1327838 00:21:44.844 12:35:38 -- common/autotest_common.sh@931 -- # uname 00:21:44.844 12:35:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:44.844 12:35:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1327838 00:21:45.101 12:35:38 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:21:45.101 12:35:38 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:21:45.101 12:35:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1327838' 00:21:45.101 killing process with pid 1327838 00:21:45.101 12:35:38 -- common/autotest_common.sh@945 -- # kill 1327838 00:21:45.101 12:35:38 -- common/autotest_common.sh@950 -- # wait 1327838 00:21:45.357 12:35:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:45.357 12:35:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:45.357 12:35:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:45.357 12:35:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:45.357 12:35:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:45.357 12:35:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:45.357 12:35:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:45.357 12:35:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.641 12:35:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:48.641 12:35:42 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:21:48.641 00:21:48.641 real 0m44.747s 00:21:48.641 user 2m37.560s 00:21:48.641 sys 0m10.465s 00:21:48.641 12:35:42 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:21:48.641 12:35:42 -- common/autotest_common.sh@10 -- # set +x 00:21:48.641 ************************************ 00:21:48.641 END TEST nvmf_perf_adq 00:21:48.641 ************************************ 00:21:48.641 12:35:42 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:48.641 12:35:42 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:21:48.641 12:35:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:48.641 12:35:42 -- common/autotest_common.sh@10 -- # set +x 00:21:48.641 ************************************ 00:21:48.641 START TEST nvmf_shutdown 00:21:48.641 ************************************ 00:21:48.641 12:35:42 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:21:48.641 * Looking for test storage... 00:21:48.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:48.641 12:35:42 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:48.641 12:35:42 -- nvmf/common.sh@7 -- # uname -s 00:21:48.641 12:35:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:48.641 12:35:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:48.641 12:35:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:48.641 12:35:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:48.641 12:35:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:48.641 12:35:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:48.641 12:35:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:48.641 12:35:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:48.641 12:35:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:48.641 12:35:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:48.641 12:35:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:48.641 12:35:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:48.641 12:35:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:48.641 12:35:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:48.641 12:35:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:48.641 12:35:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:48.641 12:35:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:48.641 12:35:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:48.641 12:35:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:48.641 12:35:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.641 12:35:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.641 12:35:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.641 12:35:42 -- paths/export.sh@5 -- # export PATH 00:21:48.641 12:35:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:48.641 12:35:42 -- nvmf/common.sh@46 -- # : 0 00:21:48.641 12:35:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:48.641 12:35:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:48.641 12:35:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:48.641 12:35:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:48.641 12:35:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:48.641 12:35:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:48.641 12:35:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:48.641 12:35:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:48.641 12:35:42 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:48.641 12:35:42 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:48.641 12:35:42 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:21:48.641 12:35:42 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:21:48.641 12:35:42 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:21:48.641 12:35:42 -- common/autotest_common.sh@10 -- # set +x 00:21:48.641 ************************************ 00:21:48.641 START TEST nvmf_shutdown_tc1 00:21:48.641 ************************************ 00:21:48.641 12:35:42 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc1 00:21:48.641 12:35:42 -- target/shutdown.sh@74 -- # starttarget 00:21:48.641 12:35:42 -- target/shutdown.sh@15 -- # nvmftestinit 00:21:48.641 12:35:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:48.641 12:35:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:48.641 12:35:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:48.641 12:35:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:48.641 12:35:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:48.641 12:35:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:48.641 12:35:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:48.641 12:35:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:48.641 12:35:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:48.641 12:35:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:48.641 12:35:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:48.641 12:35:42 -- common/autotest_common.sh@10 -- # set +x 00:21:50.540 12:35:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:50.540 12:35:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:50.540 12:35:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:50.540 12:35:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:50.540 12:35:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:50.540 12:35:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:50.540 12:35:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:50.540 12:35:44 -- nvmf/common.sh@294 -- # net_devs=() 00:21:50.540 12:35:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:50.540 12:35:44 -- nvmf/common.sh@295 -- # e810=() 00:21:50.540 12:35:44 -- nvmf/common.sh@295 -- # local -ga e810 00:21:50.540 12:35:44 -- nvmf/common.sh@296 -- # x722=() 00:21:50.540 12:35:44 -- nvmf/common.sh@296 -- # local -ga x722 00:21:50.540 12:35:44 -- nvmf/common.sh@297 -- # mlx=() 00:21:50.540 12:35:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:50.540 12:35:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:50.540 12:35:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:50.540 12:35:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:50.540 12:35:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:50.540 12:35:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:50.540 12:35:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:50.540 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:50.540 12:35:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:50.540 12:35:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:50.540 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:50.540 12:35:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:50.540 12:35:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:50.540 12:35:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:50.540 12:35:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:50.540 12:35:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:50.540 12:35:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:50.540 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:50.540 12:35:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:50.540 12:35:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:50.540 12:35:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:50.540 12:35:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:50.540 12:35:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:50.540 12:35:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:50.540 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:50.540 12:35:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:50.540 12:35:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:50.540 12:35:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:50.540 12:35:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:50.540 12:35:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:50.540 12:35:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:50.540 12:35:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:50.540 12:35:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:50.540 12:35:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:50.540 12:35:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:50.540 12:35:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:50.540 12:35:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:50.540 12:35:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:50.540 12:35:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:50.540 12:35:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:50.540 12:35:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:50.540 12:35:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:50.540 12:35:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:50.540 12:35:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:50.540 12:35:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:50.540 12:35:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:50.540 12:35:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:50.540 12:35:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:50.540 12:35:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:50.540 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:50.540 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:21:50.540 00:21:50.540 --- 10.0.0.2 ping statistics --- 00:21:50.540 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:50.540 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:21:50.540 12:35:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:50.540 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:50.540 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:21:50.540 00:21:50.540 --- 10.0.0.1 ping statistics --- 00:21:50.540 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:50.540 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:21:50.540 12:35:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:50.540 12:35:44 -- nvmf/common.sh@410 -- # return 0 00:21:50.540 12:35:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:50.540 12:35:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:50.540 12:35:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:50.540 12:35:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:50.540 12:35:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:50.540 12:35:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:50.540 12:35:44 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:21:50.540 12:35:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:50.540 12:35:44 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:50.540 12:35:44 -- common/autotest_common.sh@10 -- # set +x 00:21:50.540 12:35:44 -- nvmf/common.sh@469 -- # nvmfpid=1331205 00:21:50.540 12:35:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:21:50.540 12:35:44 -- nvmf/common.sh@470 -- # waitforlisten 1331205 00:21:50.540 12:35:44 -- common/autotest_common.sh@819 -- # '[' -z 1331205 ']' 00:21:50.540 12:35:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:50.540 12:35:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:50.540 12:35:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:50.540 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:50.541 12:35:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:50.541 12:35:44 -- common/autotest_common.sh@10 -- # set +x 00:21:50.541 [2024-07-12 12:35:44.320172] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:50.541 [2024-07-12 12:35:44.320262] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:50.541 EAL: No free 2048 kB hugepages reported on node 1 00:21:50.541 [2024-07-12 12:35:44.389170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:50.798 [2024-07-12 12:35:44.504770] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:50.798 [2024-07-12 12:35:44.504953] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:50.798 [2024-07-12 12:35:44.504973] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:50.798 [2024-07-12 12:35:44.504987] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:50.798 [2024-07-12 12:35:44.505084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:50.798 [2024-07-12 12:35:44.505136] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:50.798 [2024-07-12 12:35:44.505194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:21:50.798 [2024-07-12 12:35:44.505196] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:51.361 12:35:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:51.361 12:35:45 -- common/autotest_common.sh@852 -- # return 0 00:21:51.361 12:35:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:51.361 12:35:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:51.361 12:35:45 -- common/autotest_common.sh@10 -- # set +x 00:21:51.361 12:35:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:51.361 12:35:45 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:51.361 12:35:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.361 12:35:45 -- common/autotest_common.sh@10 -- # set +x 00:21:51.361 [2024-07-12 12:35:45.266236] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:51.361 12:35:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.361 12:35:45 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:21:51.361 12:35:45 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:21:51.361 12:35:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:21:51.361 12:35:45 -- common/autotest_common.sh@10 -- # set +x 00:21:51.361 12:35:45 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:51.361 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.361 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.361 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:21:51.619 12:35:45 -- target/shutdown.sh@28 -- # cat 00:21:51.619 12:35:45 -- target/shutdown.sh@35 -- # rpc_cmd 00:21:51.619 12:35:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:51.619 12:35:45 -- common/autotest_common.sh@10 -- # set +x 00:21:51.619 Malloc1 00:21:51.619 [2024-07-12 12:35:45.341476] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:51.619 Malloc2 00:21:51.619 Malloc3 00:21:51.619 Malloc4 00:21:51.619 Malloc5 00:21:51.877 Malloc6 00:21:51.877 Malloc7 00:21:51.877 Malloc8 00:21:51.877 Malloc9 00:21:51.877 Malloc10 00:21:51.877 12:35:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:51.877 12:35:45 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:21:51.877 12:35:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:21:51.877 12:35:45 -- common/autotest_common.sh@10 -- # set +x 00:21:52.136 12:35:45 -- target/shutdown.sh@78 -- # perfpid=1331394 00:21:52.136 12:35:45 -- target/shutdown.sh@79 -- # waitforlisten 1331394 /var/tmp/bdevperf.sock 00:21:52.136 12:35:45 -- common/autotest_common.sh@819 -- # '[' -z 1331394 ']' 00:21:52.136 12:35:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:52.136 12:35:45 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:21:52.136 12:35:45 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:52.136 12:35:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:21:52.136 12:35:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:52.136 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:52.136 12:35:45 -- nvmf/common.sh@520 -- # config=() 00:21:52.136 12:35:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:21:52.136 12:35:45 -- nvmf/common.sh@520 -- # local subsystem config 00:21:52.136 12:35:45 -- common/autotest_common.sh@10 -- # set +x 00:21:52.136 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.136 { 00:21:52.136 "params": { 00:21:52.136 "name": "Nvme$subsystem", 00:21:52.136 "trtype": "$TEST_TRANSPORT", 00:21:52.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.136 "adrfam": "ipv4", 00:21:52.136 "trsvcid": "$NVMF_PORT", 00:21:52.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.136 "hdgst": ${hdgst:-false}, 00:21:52.136 "ddgst": ${ddgst:-false} 00:21:52.136 }, 00:21:52.136 "method": "bdev_nvme_attach_controller" 00:21:52.136 } 00:21:52.136 EOF 00:21:52.136 )") 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.136 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.136 { 00:21:52.136 "params": { 00:21:52.136 "name": "Nvme$subsystem", 00:21:52.136 "trtype": "$TEST_TRANSPORT", 00:21:52.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.136 "adrfam": "ipv4", 00:21:52.136 "trsvcid": "$NVMF_PORT", 00:21:52.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.136 "hdgst": ${hdgst:-false}, 00:21:52.136 "ddgst": ${ddgst:-false} 00:21:52.136 }, 00:21:52.136 "method": "bdev_nvme_attach_controller" 00:21:52.136 } 00:21:52.136 EOF 00:21:52.136 )") 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.136 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.136 { 00:21:52.136 "params": { 00:21:52.136 "name": "Nvme$subsystem", 00:21:52.136 "trtype": "$TEST_TRANSPORT", 00:21:52.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.136 "adrfam": "ipv4", 00:21:52.136 "trsvcid": "$NVMF_PORT", 00:21:52.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.136 "hdgst": ${hdgst:-false}, 00:21:52.136 "ddgst": ${ddgst:-false} 00:21:52.136 }, 00:21:52.136 "method": "bdev_nvme_attach_controller" 00:21:52.136 } 00:21:52.136 EOF 00:21:52.136 )") 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.136 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.136 { 00:21:52.136 "params": { 00:21:52.136 "name": "Nvme$subsystem", 00:21:52.136 "trtype": "$TEST_TRANSPORT", 00:21:52.136 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.136 "adrfam": "ipv4", 00:21:52.136 "trsvcid": "$NVMF_PORT", 00:21:52.136 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.136 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.136 "hdgst": ${hdgst:-false}, 00:21:52.136 "ddgst": ${ddgst:-false} 00:21:52.136 }, 00:21:52.136 "method": "bdev_nvme_attach_controller" 00:21:52.136 } 00:21:52.136 EOF 00:21:52.136 )") 00:21:52.136 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.136 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.137 { 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme$subsystem", 00:21:52.137 "trtype": "$TEST_TRANSPORT", 00:21:52.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "$NVMF_PORT", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.137 "hdgst": ${hdgst:-false}, 00:21:52.137 "ddgst": ${ddgst:-false} 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 } 00:21:52.137 EOF 00:21:52.137 )") 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.137 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.137 { 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme$subsystem", 00:21:52.137 "trtype": "$TEST_TRANSPORT", 00:21:52.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "$NVMF_PORT", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.137 "hdgst": ${hdgst:-false}, 00:21:52.137 "ddgst": ${ddgst:-false} 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 } 00:21:52.137 EOF 00:21:52.137 )") 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.137 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.137 { 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme$subsystem", 00:21:52.137 "trtype": "$TEST_TRANSPORT", 00:21:52.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "$NVMF_PORT", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.137 "hdgst": ${hdgst:-false}, 00:21:52.137 "ddgst": ${ddgst:-false} 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 } 00:21:52.137 EOF 00:21:52.137 )") 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.137 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.137 { 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme$subsystem", 00:21:52.137 "trtype": "$TEST_TRANSPORT", 00:21:52.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "$NVMF_PORT", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.137 "hdgst": ${hdgst:-false}, 00:21:52.137 "ddgst": ${ddgst:-false} 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 } 00:21:52.137 EOF 00:21:52.137 )") 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.137 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.137 { 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme$subsystem", 00:21:52.137 "trtype": "$TEST_TRANSPORT", 00:21:52.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "$NVMF_PORT", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.137 "hdgst": ${hdgst:-false}, 00:21:52.137 "ddgst": ${ddgst:-false} 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 } 00:21:52.137 EOF 00:21:52.137 )") 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.137 12:35:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:52.137 { 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme$subsystem", 00:21:52.137 "trtype": "$TEST_TRANSPORT", 00:21:52.137 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "$NVMF_PORT", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:52.137 "hdgst": ${hdgst:-false}, 00:21:52.137 "ddgst": ${ddgst:-false} 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 } 00:21:52.137 EOF 00:21:52.137 )") 00:21:52.137 12:35:45 -- nvmf/common.sh@542 -- # cat 00:21:52.137 12:35:45 -- nvmf/common.sh@544 -- # jq . 00:21:52.137 12:35:45 -- nvmf/common.sh@545 -- # IFS=, 00:21:52.137 12:35:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme1", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme2", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme3", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme4", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme5", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme6", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme7", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme8", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme9", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 },{ 00:21:52.137 "params": { 00:21:52.137 "name": "Nvme10", 00:21:52.137 "trtype": "tcp", 00:21:52.137 "traddr": "10.0.0.2", 00:21:52.137 "adrfam": "ipv4", 00:21:52.137 "trsvcid": "4420", 00:21:52.137 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:52.137 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:52.137 "hdgst": false, 00:21:52.137 "ddgst": false 00:21:52.137 }, 00:21:52.137 "method": "bdev_nvme_attach_controller" 00:21:52.137 }' 00:21:52.137 [2024-07-12 12:35:45.842699] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:52.137 [2024-07-12 12:35:45.842771] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:21:52.137 EAL: No free 2048 kB hugepages reported on node 1 00:21:52.137 [2024-07-12 12:35:45.906209] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:52.137 [2024-07-12 12:35:46.015167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:54.037 12:35:47 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:21:54.037 12:35:47 -- common/autotest_common.sh@852 -- # return 0 00:21:54.037 12:35:47 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:21:54.037 12:35:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:21:54.037 12:35:47 -- common/autotest_common.sh@10 -- # set +x 00:21:54.037 12:35:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:21:54.037 12:35:47 -- target/shutdown.sh@83 -- # kill -9 1331394 00:21:54.037 12:35:47 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:21:54.037 12:35:47 -- target/shutdown.sh@87 -- # sleep 1 00:21:54.969 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1331394 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:21:54.969 12:35:48 -- target/shutdown.sh@88 -- # kill -0 1331205 00:21:54.969 12:35:48 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:21:54.969 12:35:48 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:21:54.969 12:35:48 -- nvmf/common.sh@520 -- # config=() 00:21:54.969 12:35:48 -- nvmf/common.sh@520 -- # local subsystem config 00:21:54.969 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.969 { 00:21:54.969 "params": { 00:21:54.969 "name": "Nvme$subsystem", 00:21:54.969 "trtype": "$TEST_TRANSPORT", 00:21:54.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.969 "adrfam": "ipv4", 00:21:54.969 "trsvcid": "$NVMF_PORT", 00:21:54.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.969 "hdgst": ${hdgst:-false}, 00:21:54.969 "ddgst": ${ddgst:-false} 00:21:54.969 }, 00:21:54.969 "method": "bdev_nvme_attach_controller" 00:21:54.969 } 00:21:54.969 EOF 00:21:54.969 )") 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.969 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.969 { 00:21:54.969 "params": { 00:21:54.969 "name": "Nvme$subsystem", 00:21:54.969 "trtype": "$TEST_TRANSPORT", 00:21:54.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.969 "adrfam": "ipv4", 00:21:54.969 "trsvcid": "$NVMF_PORT", 00:21:54.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.969 "hdgst": ${hdgst:-false}, 00:21:54.969 "ddgst": ${ddgst:-false} 00:21:54.969 }, 00:21:54.969 "method": "bdev_nvme_attach_controller" 00:21:54.969 } 00:21:54.969 EOF 00:21:54.969 )") 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.969 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.969 { 00:21:54.969 "params": { 00:21:54.969 "name": "Nvme$subsystem", 00:21:54.969 "trtype": "$TEST_TRANSPORT", 00:21:54.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.969 "adrfam": "ipv4", 00:21:54.969 "trsvcid": "$NVMF_PORT", 00:21:54.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.969 "hdgst": ${hdgst:-false}, 00:21:54.969 "ddgst": ${ddgst:-false} 00:21:54.969 }, 00:21:54.969 "method": "bdev_nvme_attach_controller" 00:21:54.969 } 00:21:54.969 EOF 00:21:54.969 )") 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.969 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.969 { 00:21:54.969 "params": { 00:21:54.969 "name": "Nvme$subsystem", 00:21:54.969 "trtype": "$TEST_TRANSPORT", 00:21:54.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.969 "adrfam": "ipv4", 00:21:54.969 "trsvcid": "$NVMF_PORT", 00:21:54.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.969 "hdgst": ${hdgst:-false}, 00:21:54.969 "ddgst": ${ddgst:-false} 00:21:54.969 }, 00:21:54.969 "method": "bdev_nvme_attach_controller" 00:21:54.969 } 00:21:54.969 EOF 00:21:54.969 )") 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.969 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.969 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.969 { 00:21:54.969 "params": { 00:21:54.969 "name": "Nvme$subsystem", 00:21:54.969 "trtype": "$TEST_TRANSPORT", 00:21:54.969 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.969 "adrfam": "ipv4", 00:21:54.969 "trsvcid": "$NVMF_PORT", 00:21:54.969 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.969 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.969 "hdgst": ${hdgst:-false}, 00:21:54.969 "ddgst": ${ddgst:-false} 00:21:54.969 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 } 00:21:54.970 EOF 00:21:54.970 )") 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.970 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.970 { 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme$subsystem", 00:21:54.970 "trtype": "$TEST_TRANSPORT", 00:21:54.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "$NVMF_PORT", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.970 "hdgst": ${hdgst:-false}, 00:21:54.970 "ddgst": ${ddgst:-false} 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 } 00:21:54.970 EOF 00:21:54.970 )") 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.970 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.970 { 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme$subsystem", 00:21:54.970 "trtype": "$TEST_TRANSPORT", 00:21:54.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "$NVMF_PORT", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.970 "hdgst": ${hdgst:-false}, 00:21:54.970 "ddgst": ${ddgst:-false} 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 } 00:21:54.970 EOF 00:21:54.970 )") 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.970 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.970 { 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme$subsystem", 00:21:54.970 "trtype": "$TEST_TRANSPORT", 00:21:54.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "$NVMF_PORT", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.970 "hdgst": ${hdgst:-false}, 00:21:54.970 "ddgst": ${ddgst:-false} 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 } 00:21:54.970 EOF 00:21:54.970 )") 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.970 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.970 { 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme$subsystem", 00:21:54.970 "trtype": "$TEST_TRANSPORT", 00:21:54.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "$NVMF_PORT", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.970 "hdgst": ${hdgst:-false}, 00:21:54.970 "ddgst": ${ddgst:-false} 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 } 00:21:54.970 EOF 00:21:54.970 )") 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.970 12:35:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:21:54.970 { 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme$subsystem", 00:21:54.970 "trtype": "$TEST_TRANSPORT", 00:21:54.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "$NVMF_PORT", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:21:54.970 "hdgst": ${hdgst:-false}, 00:21:54.970 "ddgst": ${ddgst:-false} 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 } 00:21:54.970 EOF 00:21:54.970 )") 00:21:54.970 12:35:48 -- nvmf/common.sh@542 -- # cat 00:21:54.970 12:35:48 -- nvmf/common.sh@544 -- # jq . 00:21:54.970 12:35:48 -- nvmf/common.sh@545 -- # IFS=, 00:21:54.970 12:35:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme1", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme2", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme3", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme4", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme5", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme6", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme7", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme8", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme9", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 },{ 00:21:54.970 "params": { 00:21:54.970 "name": "Nvme10", 00:21:54.970 "trtype": "tcp", 00:21:54.970 "traddr": "10.0.0.2", 00:21:54.970 "adrfam": "ipv4", 00:21:54.970 "trsvcid": "4420", 00:21:54.970 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:21:54.970 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:21:54.970 "hdgst": false, 00:21:54.970 "ddgst": false 00:21:54.970 }, 00:21:54.970 "method": "bdev_nvme_attach_controller" 00:21:54.970 }' 00:21:54.970 [2024-07-12 12:35:48.587682] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:21:54.970 [2024-07-12 12:35:48.587755] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1331829 ] 00:21:54.970 EAL: No free 2048 kB hugepages reported on node 1 00:21:54.970 [2024-07-12 12:35:48.652360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:54.970 [2024-07-12 12:35:48.760404] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:56.341 Running I/O for 1 seconds... 00:21:57.724 00:21:57.724 Latency(us) 00:21:57.724 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:57.724 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme1n1 : 1.08 402.65 25.17 0.00 0.00 156412.47 14369.37 119615.34 00:21:57.724 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme2n1 : 1.06 374.36 23.40 0.00 0.00 163759.25 49516.09 141363.58 00:21:57.724 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme3n1 : 1.08 401.55 25.10 0.00 0.00 154673.13 15631.55 117285.17 00:21:57.724 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme4n1 : 1.09 399.63 24.98 0.00 0.00 154349.42 15340.28 118838.61 00:21:57.724 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme5n1 : 1.09 398.04 24.88 0.00 0.00 153745.40 16311.18 117285.17 00:21:57.724 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme6n1 : 1.10 395.50 24.72 0.00 0.00 154054.57 13107.20 121945.51 00:21:57.724 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme7n1 : 1.10 394.09 24.63 0.00 0.00 153496.86 13398.47 123498.95 00:21:57.724 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme8n1 : 1.10 393.05 24.57 0.00 0.00 153129.69 11213.94 125829.12 00:21:57.724 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme9n1 : 1.11 392.45 24.53 0.00 0.00 152464.04 10291.58 128159.29 00:21:57.724 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:21:57.724 Verification LBA range: start 0x0 length 0x400 00:21:57.724 Nvme10n1 : 1.11 391.65 24.48 0.00 0.00 151948.39 8592.50 142917.03 00:21:57.724 =================================================================================================================== 00:21:57.724 Total : 3942.96 246.44 0.00 0.00 154728.41 8592.50 142917.03 00:21:58.018 12:35:51 -- target/shutdown.sh@93 -- # stoptarget 00:21:58.018 12:35:51 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:21:58.018 12:35:51 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:21:58.018 12:35:51 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:21:58.018 12:35:51 -- target/shutdown.sh@45 -- # nvmftestfini 00:21:58.018 12:35:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:58.018 12:35:51 -- nvmf/common.sh@116 -- # sync 00:21:58.018 12:35:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:58.018 12:35:51 -- nvmf/common.sh@119 -- # set +e 00:21:58.018 12:35:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:58.018 12:35:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:58.018 rmmod nvme_tcp 00:21:58.018 rmmod nvme_fabrics 00:21:58.018 rmmod nvme_keyring 00:21:58.018 12:35:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:58.018 12:35:51 -- nvmf/common.sh@123 -- # set -e 00:21:58.018 12:35:51 -- nvmf/common.sh@124 -- # return 0 00:21:58.018 12:35:51 -- nvmf/common.sh@477 -- # '[' -n 1331205 ']' 00:21:58.018 12:35:51 -- nvmf/common.sh@478 -- # killprocess 1331205 00:21:58.018 12:35:51 -- common/autotest_common.sh@926 -- # '[' -z 1331205 ']' 00:21:58.018 12:35:51 -- common/autotest_common.sh@930 -- # kill -0 1331205 00:21:58.018 12:35:51 -- common/autotest_common.sh@931 -- # uname 00:21:58.018 12:35:51 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:21:58.018 12:35:51 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1331205 00:21:58.018 12:35:51 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:21:58.018 12:35:51 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:21:58.018 12:35:51 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1331205' 00:21:58.018 killing process with pid 1331205 00:21:58.018 12:35:51 -- common/autotest_common.sh@945 -- # kill 1331205 00:21:58.018 12:35:51 -- common/autotest_common.sh@950 -- # wait 1331205 00:21:58.585 12:35:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:58.585 12:35:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:58.585 12:35:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:58.585 12:35:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:58.585 12:35:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:58.585 12:35:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:58.585 12:35:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:58.585 12:35:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:00.483 12:35:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:00.483 00:22:00.483 real 0m12.081s 00:22:00.483 user 0m35.668s 00:22:00.483 sys 0m3.116s 00:22:00.483 12:35:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:00.483 12:35:54 -- common/autotest_common.sh@10 -- # set +x 00:22:00.483 ************************************ 00:22:00.483 END TEST nvmf_shutdown_tc1 00:22:00.483 ************************************ 00:22:00.483 12:35:54 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:00.483 12:35:54 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:00.483 12:35:54 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:00.483 12:35:54 -- common/autotest_common.sh@10 -- # set +x 00:22:00.483 ************************************ 00:22:00.483 START TEST nvmf_shutdown_tc2 00:22:00.483 ************************************ 00:22:00.483 12:35:54 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc2 00:22:00.483 12:35:54 -- target/shutdown.sh@98 -- # starttarget 00:22:00.483 12:35:54 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:00.483 12:35:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:00.483 12:35:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:00.483 12:35:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:00.483 12:35:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:00.483 12:35:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:00.483 12:35:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:00.483 12:35:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:00.483 12:35:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:00.483 12:35:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:00.483 12:35:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:00.483 12:35:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:00.483 12:35:54 -- common/autotest_common.sh@10 -- # set +x 00:22:00.483 12:35:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:00.483 12:35:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:00.483 12:35:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:00.483 12:35:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:00.483 12:35:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:00.483 12:35:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:00.483 12:35:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:00.483 12:35:54 -- nvmf/common.sh@294 -- # net_devs=() 00:22:00.483 12:35:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:00.483 12:35:54 -- nvmf/common.sh@295 -- # e810=() 00:22:00.483 12:35:54 -- nvmf/common.sh@295 -- # local -ga e810 00:22:00.483 12:35:54 -- nvmf/common.sh@296 -- # x722=() 00:22:00.483 12:35:54 -- nvmf/common.sh@296 -- # local -ga x722 00:22:00.483 12:35:54 -- nvmf/common.sh@297 -- # mlx=() 00:22:00.483 12:35:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:00.483 12:35:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:00.483 12:35:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:00.483 12:35:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:00.483 12:35:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:00.483 12:35:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:00.483 12:35:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:00.483 12:35:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:00.483 12:35:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:00.483 12:35:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:00.483 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:00.483 12:35:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:00.483 12:35:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:00.484 12:35:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:00.484 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:00.484 12:35:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:00.484 12:35:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:00.484 12:35:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.484 12:35:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:00.484 12:35:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.484 12:35:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:00.484 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:00.484 12:35:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.484 12:35:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:00.484 12:35:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:00.484 12:35:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:00.484 12:35:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:00.484 12:35:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:00.484 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:00.484 12:35:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:00.484 12:35:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:00.484 12:35:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:00.484 12:35:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:00.484 12:35:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:00.484 12:35:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:00.484 12:35:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:00.484 12:35:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:00.484 12:35:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:00.484 12:35:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:00.484 12:35:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:00.484 12:35:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:00.484 12:35:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:00.484 12:35:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:00.484 12:35:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:00.484 12:35:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:00.484 12:35:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:00.484 12:35:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:00.484 12:35:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:00.484 12:35:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:00.484 12:35:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:00.484 12:35:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:00.742 12:35:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:00.742 12:35:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:00.742 12:35:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:00.742 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:00.742 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:22:00.742 00:22:00.742 --- 10.0.0.2 ping statistics --- 00:22:00.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:00.742 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:22:00.742 12:35:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:00.742 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:00.742 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:22:00.742 00:22:00.742 --- 10.0.0.1 ping statistics --- 00:22:00.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:00.742 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:22:00.742 12:35:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:00.742 12:35:54 -- nvmf/common.sh@410 -- # return 0 00:22:00.742 12:35:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:00.742 12:35:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:00.742 12:35:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:00.742 12:35:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:00.742 12:35:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:00.742 12:35:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:00.742 12:35:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:00.742 12:35:54 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:00.742 12:35:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:00.742 12:35:54 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:00.742 12:35:54 -- common/autotest_common.sh@10 -- # set +x 00:22:00.742 12:35:54 -- nvmf/common.sh@469 -- # nvmfpid=1332617 00:22:00.742 12:35:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:00.742 12:35:54 -- nvmf/common.sh@470 -- # waitforlisten 1332617 00:22:00.742 12:35:54 -- common/autotest_common.sh@819 -- # '[' -z 1332617 ']' 00:22:00.742 12:35:54 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:00.742 12:35:54 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:00.742 12:35:54 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:00.742 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:00.742 12:35:54 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:00.742 12:35:54 -- common/autotest_common.sh@10 -- # set +x 00:22:00.742 [2024-07-12 12:35:54.533498] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:00.742 [2024-07-12 12:35:54.533579] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:00.742 EAL: No free 2048 kB hugepages reported on node 1 00:22:00.742 [2024-07-12 12:35:54.600798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:00.999 [2024-07-12 12:35:54.716182] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:00.999 [2024-07-12 12:35:54.716382] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:00.999 [2024-07-12 12:35:54.716401] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:00.999 [2024-07-12 12:35:54.716414] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:00.999 [2024-07-12 12:35:54.716575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:00.999 [2024-07-12 12:35:54.716697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:00.999 [2024-07-12 12:35:54.716763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:00.999 [2024-07-12 12:35:54.716765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:01.563 12:35:55 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:01.563 12:35:55 -- common/autotest_common.sh@852 -- # return 0 00:22:01.563 12:35:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:01.563 12:35:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:01.563 12:35:55 -- common/autotest_common.sh@10 -- # set +x 00:22:01.563 12:35:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:01.563 12:35:55 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:01.563 12:35:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:01.563 12:35:55 -- common/autotest_common.sh@10 -- # set +x 00:22:01.563 [2024-07-12 12:35:55.477268] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:01.821 12:35:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:01.821 12:35:55 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:01.821 12:35:55 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:01.821 12:35:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:01.821 12:35:55 -- common/autotest_common.sh@10 -- # set +x 00:22:01.821 12:35:55 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:01.821 12:35:55 -- target/shutdown.sh@28 -- # cat 00:22:01.821 12:35:55 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:01.821 12:35:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:01.821 12:35:55 -- common/autotest_common.sh@10 -- # set +x 00:22:01.821 Malloc1 00:22:01.821 [2024-07-12 12:35:55.552435] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:01.821 Malloc2 00:22:01.821 Malloc3 00:22:01.821 Malloc4 00:22:01.821 Malloc5 00:22:02.080 Malloc6 00:22:02.080 Malloc7 00:22:02.080 Malloc8 00:22:02.080 Malloc9 00:22:02.080 Malloc10 00:22:02.080 12:35:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:02.080 12:35:55 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:02.080 12:35:55 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:02.080 12:35:55 -- common/autotest_common.sh@10 -- # set +x 00:22:02.338 12:35:56 -- target/shutdown.sh@102 -- # perfpid=1332804 00:22:02.338 12:35:56 -- target/shutdown.sh@103 -- # waitforlisten 1332804 /var/tmp/bdevperf.sock 00:22:02.338 12:35:56 -- common/autotest_common.sh@819 -- # '[' -z 1332804 ']' 00:22:02.338 12:35:56 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:02.339 12:35:56 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:02.339 12:35:56 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:02.339 12:35:56 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:02.339 12:35:56 -- nvmf/common.sh@520 -- # config=() 00:22:02.339 12:35:56 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:02.339 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:02.339 12:35:56 -- nvmf/common.sh@520 -- # local subsystem config 00:22:02.339 12:35:56 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:02.339 12:35:56 -- common/autotest_common.sh@10 -- # set +x 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:02.339 { 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme$subsystem", 00:22:02.339 "trtype": "$TEST_TRANSPORT", 00:22:02.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "$NVMF_PORT", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:02.339 "hdgst": ${hdgst:-false}, 00:22:02.339 "ddgst": ${ddgst:-false} 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 } 00:22:02.339 EOF 00:22:02.339 )") 00:22:02.339 12:35:56 -- nvmf/common.sh@542 -- # cat 00:22:02.339 12:35:56 -- nvmf/common.sh@544 -- # jq . 00:22:02.339 12:35:56 -- nvmf/common.sh@545 -- # IFS=, 00:22:02.339 12:35:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme1", 00:22:02.339 "trtype": "tcp", 00:22:02.339 "traddr": "10.0.0.2", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "4420", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:02.339 "hdgst": false, 00:22:02.339 "ddgst": false 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 },{ 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme2", 00:22:02.339 "trtype": "tcp", 00:22:02.339 "traddr": "10.0.0.2", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "4420", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:02.339 "hdgst": false, 00:22:02.339 "ddgst": false 00:22:02.339 }, 00:22:02.339 "method": "bdev_nvme_attach_controller" 00:22:02.339 },{ 00:22:02.339 "params": { 00:22:02.339 "name": "Nvme3", 00:22:02.339 "trtype": "tcp", 00:22:02.339 "traddr": "10.0.0.2", 00:22:02.339 "adrfam": "ipv4", 00:22:02.339 "trsvcid": "4420", 00:22:02.339 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:02.339 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:02.339 "hdgst": false, 00:22:02.339 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme4", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme5", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme6", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme7", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme8", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme9", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 },{ 00:22:02.340 "params": { 00:22:02.340 "name": "Nvme10", 00:22:02.340 "trtype": "tcp", 00:22:02.340 "traddr": "10.0.0.2", 00:22:02.340 "adrfam": "ipv4", 00:22:02.340 "trsvcid": "4420", 00:22:02.340 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:02.340 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:02.340 "hdgst": false, 00:22:02.340 "ddgst": false 00:22:02.340 }, 00:22:02.340 "method": "bdev_nvme_attach_controller" 00:22:02.340 }' 00:22:02.340 [2024-07-12 12:35:56.062768] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:02.340 [2024-07-12 12:35:56.062839] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1332804 ] 00:22:02.340 EAL: No free 2048 kB hugepages reported on node 1 00:22:02.340 [2024-07-12 12:35:56.126140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:02.340 [2024-07-12 12:35:56.236202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:04.237 Running I/O for 10 seconds... 00:22:04.804 12:35:58 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:04.804 12:35:58 -- common/autotest_common.sh@852 -- # return 0 00:22:04.804 12:35:58 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:04.804 12:35:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:04.804 12:35:58 -- common/autotest_common.sh@10 -- # set +x 00:22:04.804 12:35:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:04.804 12:35:58 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:04.804 12:35:58 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:04.804 12:35:58 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:04.804 12:35:58 -- target/shutdown.sh@57 -- # local ret=1 00:22:04.804 12:35:58 -- target/shutdown.sh@58 -- # local i 00:22:04.804 12:35:58 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:04.804 12:35:58 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:04.804 12:35:58 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:04.804 12:35:58 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:04.804 12:35:58 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:04.804 12:35:58 -- common/autotest_common.sh@10 -- # set +x 00:22:04.804 12:35:58 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:04.804 12:35:58 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:04.804 12:35:58 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:04.804 12:35:58 -- target/shutdown.sh@64 -- # ret=0 00:22:04.804 12:35:58 -- target/shutdown.sh@65 -- # break 00:22:04.804 12:35:58 -- target/shutdown.sh@69 -- # return 0 00:22:04.804 12:35:58 -- target/shutdown.sh@109 -- # killprocess 1332804 00:22:04.804 12:35:58 -- common/autotest_common.sh@926 -- # '[' -z 1332804 ']' 00:22:04.804 12:35:58 -- common/autotest_common.sh@930 -- # kill -0 1332804 00:22:04.804 12:35:58 -- common/autotest_common.sh@931 -- # uname 00:22:04.804 12:35:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:04.804 12:35:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1332804 00:22:04.804 12:35:58 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:04.804 12:35:58 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:04.804 12:35:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1332804' 00:22:04.804 killing process with pid 1332804 00:22:04.804 12:35:58 -- common/autotest_common.sh@945 -- # kill 1332804 00:22:04.804 12:35:58 -- common/autotest_common.sh@950 -- # wait 1332804 00:22:04.804 Received shutdown signal, test time was about 0.526422 seconds 00:22:04.804 00:22:04.804 Latency(us) 00:22:04.804 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:04.804 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.804 Verification LBA range: start 0x0 length 0x400 00:22:04.804 Nvme1n1 : 0.53 433.79 27.11 0.00 0.00 142361.74 18738.44 146800.64 00:22:04.804 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.804 Verification LBA range: start 0x0 length 0x400 00:22:04.804 Nvme2n1 : 0.50 382.06 23.88 0.00 0.00 158373.05 24758.04 152237.70 00:22:04.805 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme3n1 : 0.52 439.69 27.48 0.00 0.00 136734.33 16602.45 113401.55 00:22:04.805 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme4n1 : 0.52 438.58 27.41 0.00 0.00 135016.51 16214.09 114178.28 00:22:04.805 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme5n1 : 0.52 437.49 27.34 0.00 0.00 133345.53 16311.18 114955.00 00:22:04.805 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme6n1 : 0.49 387.34 24.21 0.00 0.00 146632.01 22039.51 118838.61 00:22:04.805 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme7n1 : 0.52 434.91 27.18 0.00 0.00 130204.57 15922.82 115731.72 00:22:04.805 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme8n1 : 0.49 386.06 24.13 0.00 0.00 141501.55 25826.04 119615.34 00:22:04.805 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme9n1 : 0.51 373.01 23.31 0.00 0.00 143721.34 31263.10 125052.40 00:22:04.805 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:04.805 Verification LBA range: start 0x0 length 0x400 00:22:04.805 Nvme10n1 : 0.51 370.20 23.14 0.00 0.00 143092.81 28544.57 125052.40 00:22:04.805 =================================================================================================================== 00:22:04.805 Total : 4083.13 255.20 0.00 0.00 140592.36 15922.82 152237.70 00:22:05.063 12:35:58 -- target/shutdown.sh@112 -- # sleep 1 00:22:06.436 12:35:59 -- target/shutdown.sh@113 -- # kill -0 1332617 00:22:06.436 12:35:59 -- target/shutdown.sh@115 -- # stoptarget 00:22:06.436 12:35:59 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:06.436 12:35:59 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:06.436 12:35:59 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:06.436 12:35:59 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:06.436 12:35:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:06.436 12:35:59 -- nvmf/common.sh@116 -- # sync 00:22:06.436 12:35:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:06.436 12:35:59 -- nvmf/common.sh@119 -- # set +e 00:22:06.436 12:35:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:06.436 12:35:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:06.436 rmmod nvme_tcp 00:22:06.436 rmmod nvme_fabrics 00:22:06.436 rmmod nvme_keyring 00:22:06.436 12:36:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:06.436 12:36:00 -- nvmf/common.sh@123 -- # set -e 00:22:06.436 12:36:00 -- nvmf/common.sh@124 -- # return 0 00:22:06.436 12:36:00 -- nvmf/common.sh@477 -- # '[' -n 1332617 ']' 00:22:06.436 12:36:00 -- nvmf/common.sh@478 -- # killprocess 1332617 00:22:06.436 12:36:00 -- common/autotest_common.sh@926 -- # '[' -z 1332617 ']' 00:22:06.436 12:36:00 -- common/autotest_common.sh@930 -- # kill -0 1332617 00:22:06.436 12:36:00 -- common/autotest_common.sh@931 -- # uname 00:22:06.436 12:36:00 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:06.436 12:36:00 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1332617 00:22:06.436 12:36:00 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:06.436 12:36:00 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:06.436 12:36:00 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1332617' 00:22:06.436 killing process with pid 1332617 00:22:06.436 12:36:00 -- common/autotest_common.sh@945 -- # kill 1332617 00:22:06.436 12:36:00 -- common/autotest_common.sh@950 -- # wait 1332617 00:22:06.696 12:36:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:06.696 12:36:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:06.696 12:36:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:06.696 12:36:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:06.696 12:36:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:06.696 12:36:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:06.696 12:36:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:06.696 12:36:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.230 12:36:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:09.230 00:22:09.230 real 0m8.280s 00:22:09.230 user 0m26.163s 00:22:09.230 sys 0m1.445s 00:22:09.230 12:36:02 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:09.230 12:36:02 -- common/autotest_common.sh@10 -- # set +x 00:22:09.230 ************************************ 00:22:09.230 END TEST nvmf_shutdown_tc2 00:22:09.230 ************************************ 00:22:09.230 12:36:02 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:09.230 12:36:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:22:09.230 12:36:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:09.230 12:36:02 -- common/autotest_common.sh@10 -- # set +x 00:22:09.230 ************************************ 00:22:09.230 START TEST nvmf_shutdown_tc3 00:22:09.230 ************************************ 00:22:09.230 12:36:02 -- common/autotest_common.sh@1104 -- # nvmf_shutdown_tc3 00:22:09.230 12:36:02 -- target/shutdown.sh@120 -- # starttarget 00:22:09.230 12:36:02 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:09.230 12:36:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:09.230 12:36:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:09.230 12:36:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:09.230 12:36:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:09.230 12:36:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:09.230 12:36:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:09.230 12:36:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:09.230 12:36:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:09.230 12:36:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:09.230 12:36:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:09.230 12:36:02 -- common/autotest_common.sh@10 -- # set +x 00:22:09.230 12:36:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:09.230 12:36:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:09.230 12:36:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:09.230 12:36:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:09.230 12:36:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:09.230 12:36:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:09.230 12:36:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:09.230 12:36:02 -- nvmf/common.sh@294 -- # net_devs=() 00:22:09.230 12:36:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:09.230 12:36:02 -- nvmf/common.sh@295 -- # e810=() 00:22:09.230 12:36:02 -- nvmf/common.sh@295 -- # local -ga e810 00:22:09.230 12:36:02 -- nvmf/common.sh@296 -- # x722=() 00:22:09.230 12:36:02 -- nvmf/common.sh@296 -- # local -ga x722 00:22:09.230 12:36:02 -- nvmf/common.sh@297 -- # mlx=() 00:22:09.230 12:36:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:09.230 12:36:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:09.230 12:36:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:09.230 12:36:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:09.230 12:36:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:09.230 12:36:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:09.230 12:36:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:09.230 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:09.230 12:36:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:09.230 12:36:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:09.230 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:09.230 12:36:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:09.230 12:36:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:09.230 12:36:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:09.231 12:36:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.231 12:36:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:09.231 12:36:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.231 12:36:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:09.231 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:09.231 12:36:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.231 12:36:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:09.231 12:36:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:09.231 12:36:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:09.231 12:36:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:09.231 12:36:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:09.231 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:09.231 12:36:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:09.231 12:36:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:09.231 12:36:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:09.231 12:36:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:09.231 12:36:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:09.231 12:36:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:09.231 12:36:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:09.231 12:36:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:09.231 12:36:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:09.231 12:36:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:09.231 12:36:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:09.231 12:36:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:09.231 12:36:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:09.231 12:36:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:09.231 12:36:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:09.231 12:36:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:09.231 12:36:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:09.231 12:36:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:09.231 12:36:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:09.231 12:36:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:09.231 12:36:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:09.231 12:36:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:09.231 12:36:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:09.231 12:36:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:09.231 12:36:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:09.231 12:36:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:09.231 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:09.231 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.193 ms 00:22:09.231 00:22:09.231 --- 10.0.0.2 ping statistics --- 00:22:09.231 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.231 rtt min/avg/max/mdev = 0.193/0.193/0.193/0.000 ms 00:22:09.231 12:36:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:09.231 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:09.231 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.161 ms 00:22:09.231 00:22:09.231 --- 10.0.0.1 ping statistics --- 00:22:09.231 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:09.231 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:22:09.231 12:36:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:09.231 12:36:02 -- nvmf/common.sh@410 -- # return 0 00:22:09.231 12:36:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:09.231 12:36:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:09.231 12:36:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:09.231 12:36:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:09.231 12:36:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:09.231 12:36:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:09.231 12:36:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:09.231 12:36:02 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:09.231 12:36:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:09.231 12:36:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:09.231 12:36:02 -- common/autotest_common.sh@10 -- # set +x 00:22:09.231 12:36:02 -- nvmf/common.sh@469 -- # nvmfpid=1333853 00:22:09.231 12:36:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:09.231 12:36:02 -- nvmf/common.sh@470 -- # waitforlisten 1333853 00:22:09.231 12:36:02 -- common/autotest_common.sh@819 -- # '[' -z 1333853 ']' 00:22:09.231 12:36:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:09.231 12:36:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:09.231 12:36:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:09.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:09.231 12:36:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:09.231 12:36:02 -- common/autotest_common.sh@10 -- # set +x 00:22:09.231 [2024-07-12 12:36:02.852787] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:09.231 [2024-07-12 12:36:02.852886] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:09.231 EAL: No free 2048 kB hugepages reported on node 1 00:22:09.231 [2024-07-12 12:36:02.929086] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:09.231 [2024-07-12 12:36:03.036058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:09.231 [2024-07-12 12:36:03.036236] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:09.231 [2024-07-12 12:36:03.036255] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:09.231 [2024-07-12 12:36:03.036267] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:09.231 [2024-07-12 12:36:03.036329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:09.231 [2024-07-12 12:36:03.036397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:09.231 [2024-07-12 12:36:03.036444] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:09.231 [2024-07-12 12:36:03.036448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:10.161 12:36:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:10.161 12:36:03 -- common/autotest_common.sh@852 -- # return 0 00:22:10.161 12:36:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:10.161 12:36:03 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:10.161 12:36:03 -- common/autotest_common.sh@10 -- # set +x 00:22:10.161 12:36:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:10.161 12:36:03 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:10.161 12:36:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:10.161 12:36:03 -- common/autotest_common.sh@10 -- # set +x 00:22:10.161 [2024-07-12 12:36:03.806292] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:10.161 12:36:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:10.161 12:36:03 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:10.161 12:36:03 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:10.161 12:36:03 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:10.161 12:36:03 -- common/autotest_common.sh@10 -- # set +x 00:22:10.161 12:36:03 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:10.161 12:36:03 -- target/shutdown.sh@28 -- # cat 00:22:10.161 12:36:03 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:10.161 12:36:03 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:10.161 12:36:03 -- common/autotest_common.sh@10 -- # set +x 00:22:10.161 Malloc1 00:22:10.161 [2024-07-12 12:36:03.881321] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:10.161 Malloc2 00:22:10.161 Malloc3 00:22:10.161 Malloc4 00:22:10.161 Malloc5 00:22:10.419 Malloc6 00:22:10.419 Malloc7 00:22:10.419 Malloc8 00:22:10.419 Malloc9 00:22:10.419 Malloc10 00:22:10.419 12:36:04 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:10.419 12:36:04 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:10.419 12:36:04 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:10.419 12:36:04 -- common/autotest_common.sh@10 -- # set +x 00:22:10.677 12:36:04 -- target/shutdown.sh@124 -- # perfpid=1334167 00:22:10.677 12:36:04 -- target/shutdown.sh@125 -- # waitforlisten 1334167 /var/tmp/bdevperf.sock 00:22:10.677 12:36:04 -- common/autotest_common.sh@819 -- # '[' -z 1334167 ']' 00:22:10.677 12:36:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:10.677 12:36:04 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:10.677 12:36:04 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:10.677 12:36:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:10.677 12:36:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:10.677 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:10.677 12:36:04 -- nvmf/common.sh@520 -- # config=() 00:22:10.677 12:36:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:10.677 12:36:04 -- nvmf/common.sh@520 -- # local subsystem config 00:22:10.677 12:36:04 -- common/autotest_common.sh@10 -- # set +x 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.677 "adrfam": "ipv4", 00:22:10.677 "trsvcid": "$NVMF_PORT", 00:22:10.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.677 "hdgst": ${hdgst:-false}, 00:22:10.677 "ddgst": ${ddgst:-false} 00:22:10.677 }, 00:22:10.677 "method": "bdev_nvme_attach_controller" 00:22:10.677 } 00:22:10.677 EOF 00:22:10.677 )") 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.677 "adrfam": "ipv4", 00:22:10.677 "trsvcid": "$NVMF_PORT", 00:22:10.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.677 "hdgst": ${hdgst:-false}, 00:22:10.677 "ddgst": ${ddgst:-false} 00:22:10.677 }, 00:22:10.677 "method": "bdev_nvme_attach_controller" 00:22:10.677 } 00:22:10.677 EOF 00:22:10.677 )") 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.677 "adrfam": "ipv4", 00:22:10.677 "trsvcid": "$NVMF_PORT", 00:22:10.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.677 "hdgst": ${hdgst:-false}, 00:22:10.677 "ddgst": ${ddgst:-false} 00:22:10.677 }, 00:22:10.677 "method": "bdev_nvme_attach_controller" 00:22:10.677 } 00:22:10.677 EOF 00:22:10.677 )") 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.677 "adrfam": "ipv4", 00:22:10.677 "trsvcid": "$NVMF_PORT", 00:22:10.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.677 "hdgst": ${hdgst:-false}, 00:22:10.677 "ddgst": ${ddgst:-false} 00:22:10.677 }, 00:22:10.677 "method": "bdev_nvme_attach_controller" 00:22:10.677 } 00:22:10.677 EOF 00:22:10.677 )") 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.677 "adrfam": "ipv4", 00:22:10.677 "trsvcid": "$NVMF_PORT", 00:22:10.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.677 "hdgst": ${hdgst:-false}, 00:22:10.677 "ddgst": ${ddgst:-false} 00:22:10.677 }, 00:22:10.677 "method": "bdev_nvme_attach_controller" 00:22:10.677 } 00:22:10.677 EOF 00:22:10.677 )") 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.677 "adrfam": "ipv4", 00:22:10.677 "trsvcid": "$NVMF_PORT", 00:22:10.677 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.677 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.677 "hdgst": ${hdgst:-false}, 00:22:10.677 "ddgst": ${ddgst:-false} 00:22:10.677 }, 00:22:10.677 "method": "bdev_nvme_attach_controller" 00:22:10.677 } 00:22:10.677 EOF 00:22:10.677 )") 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.677 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.677 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.677 { 00:22:10.677 "params": { 00:22:10.677 "name": "Nvme$subsystem", 00:22:10.677 "trtype": "$TEST_TRANSPORT", 00:22:10.677 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "$NVMF_PORT", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.678 "hdgst": ${hdgst:-false}, 00:22:10.678 "ddgst": ${ddgst:-false} 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 } 00:22:10.678 EOF 00:22:10.678 )") 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.678 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.678 { 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme$subsystem", 00:22:10.678 "trtype": "$TEST_TRANSPORT", 00:22:10.678 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "$NVMF_PORT", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.678 "hdgst": ${hdgst:-false}, 00:22:10.678 "ddgst": ${ddgst:-false} 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 } 00:22:10.678 EOF 00:22:10.678 )") 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.678 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.678 { 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme$subsystem", 00:22:10.678 "trtype": "$TEST_TRANSPORT", 00:22:10.678 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "$NVMF_PORT", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.678 "hdgst": ${hdgst:-false}, 00:22:10.678 "ddgst": ${ddgst:-false} 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 } 00:22:10.678 EOF 00:22:10.678 )") 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.678 12:36:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:10.678 { 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme$subsystem", 00:22:10.678 "trtype": "$TEST_TRANSPORT", 00:22:10.678 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "$NVMF_PORT", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:10.678 "hdgst": ${hdgst:-false}, 00:22:10.678 "ddgst": ${ddgst:-false} 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 } 00:22:10.678 EOF 00:22:10.678 )") 00:22:10.678 12:36:04 -- nvmf/common.sh@542 -- # cat 00:22:10.678 12:36:04 -- nvmf/common.sh@544 -- # jq . 00:22:10.678 12:36:04 -- nvmf/common.sh@545 -- # IFS=, 00:22:10.678 12:36:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme1", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme2", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme3", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme4", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme5", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme6", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme7", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme8", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme9", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 },{ 00:22:10.678 "params": { 00:22:10.678 "name": "Nvme10", 00:22:10.678 "trtype": "tcp", 00:22:10.678 "traddr": "10.0.0.2", 00:22:10.678 "adrfam": "ipv4", 00:22:10.678 "trsvcid": "4420", 00:22:10.678 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:10.678 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:10.678 "hdgst": false, 00:22:10.678 "ddgst": false 00:22:10.678 }, 00:22:10.678 "method": "bdev_nvme_attach_controller" 00:22:10.678 }' 00:22:10.678 [2024-07-12 12:36:04.388556] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:10.678 [2024-07-12 12:36:04.388643] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1334167 ] 00:22:10.678 EAL: No free 2048 kB hugepages reported on node 1 00:22:10.678 [2024-07-12 12:36:04.453730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:10.678 [2024-07-12 12:36:04.561706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:12.574 Running I/O for 10 seconds... 00:22:13.152 12:36:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:13.152 12:36:06 -- common/autotest_common.sh@852 -- # return 0 00:22:13.152 12:36:06 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:13.152 12:36:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.152 12:36:06 -- common/autotest_common.sh@10 -- # set +x 00:22:13.152 12:36:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.152 12:36:06 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:13.152 12:36:06 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:13.152 12:36:06 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:13.152 12:36:06 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:13.152 12:36:06 -- target/shutdown.sh@57 -- # local ret=1 00:22:13.152 12:36:06 -- target/shutdown.sh@58 -- # local i 00:22:13.152 12:36:06 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:13.152 12:36:06 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:13.152 12:36:06 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:13.152 12:36:06 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:13.152 12:36:06 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:13.152 12:36:06 -- common/autotest_common.sh@10 -- # set +x 00:22:13.152 12:36:06 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:13.152 12:36:06 -- target/shutdown.sh@60 -- # read_io_count=167 00:22:13.152 12:36:06 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:22:13.152 12:36:06 -- target/shutdown.sh@64 -- # ret=0 00:22:13.152 12:36:06 -- target/shutdown.sh@65 -- # break 00:22:13.152 12:36:06 -- target/shutdown.sh@69 -- # return 0 00:22:13.152 12:36:06 -- target/shutdown.sh@134 -- # killprocess 1333853 00:22:13.152 12:36:06 -- common/autotest_common.sh@926 -- # '[' -z 1333853 ']' 00:22:13.152 12:36:06 -- common/autotest_common.sh@930 -- # kill -0 1333853 00:22:13.152 12:36:06 -- common/autotest_common.sh@931 -- # uname 00:22:13.152 12:36:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:13.152 12:36:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1333853 00:22:13.152 12:36:06 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:13.152 12:36:06 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:13.152 12:36:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1333853' 00:22:13.152 killing process with pid 1333853 00:22:13.152 12:36:06 -- common/autotest_common.sh@945 -- # kill 1333853 00:22:13.152 12:36:06 -- common/autotest_common.sh@950 -- # wait 1333853 00:22:13.152 [2024-07-12 12:36:06.948992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949119] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949132] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949145] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949157] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949192] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949205] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949217] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949229] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949242] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949254] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949281] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949295] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949308] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949334] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949385] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949398] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949411] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.152 [2024-07-12 12:36:06.949445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949458] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949483] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949495] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949507] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949533] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949547] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949559] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949572] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949585] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949597] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949611] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949623] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949635] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949647] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949661] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949674] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949702] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.949714] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec100 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.950562] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.153 [2024-07-12 12:36:06.950602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.153 [2024-07-12 12:36:06.950634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950649] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.153 [2024-07-12 12:36:06.950669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.153 [2024-07-12 12:36:06.950697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ef210 is same with the state(5) to be set 00:22:13.153 [2024-07-12 12:36:06.950775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.950797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.950840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.950891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.950922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.950953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.950983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.950999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.153 [2024-07-12 12:36:06.951384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.153 [2024-07-12 12:36:06.951397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.951976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.951990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.154 [2024-07-12 12:36:06.952377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.154 [2024-07-12 12:36:06.952392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.155 [2024-07-12 12:36:06.952792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.155 [2024-07-12 12:36:06.952909] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2366f40 was disconnected and freed. reset controller. 00:22:13.155 [2024-07-12 12:36:06.955113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955147] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955186] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955212] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955224] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955250] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955263] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955288] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955314] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955339] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955352] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955365] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955377] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955411] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955437] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955450] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955488] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955540] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955553] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955566] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955578] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955603] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955629] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955642] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.155 [2024-07-12 12:36:06.955655] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955668] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955694] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955707] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955720] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955733] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955746] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955776] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955828] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955840] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955852] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955880] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955893] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955906] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955919] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955932] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955944] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955956] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.955968] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeea90 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.956501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:13.156 [2024-07-12 12:36:06.956544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21ef210 (9): Bad file descriptor 00:22:13.156 [2024-07-12 12:36:06.958503] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958533] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958552] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958564] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958578] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958603] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958616] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958628] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958660] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958673] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958686] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958717] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958730] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958746] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958760] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958773] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958789] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958802] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958831] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958864] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958889] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958902] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958917] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958931] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958943] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958957] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.958995] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959008] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959020] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959037] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959051] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959064] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959091] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959104] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959117] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959130] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959143] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.156 [2024-07-12 12:36:06.959180] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959193] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959232] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959245] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959259] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959272] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959284] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959311] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959324] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959336] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959348] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.959386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdec590 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961049] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.157 [2024-07-12 12:36:06.961130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961239] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x222a4f0 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961353] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961381] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961409] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-07-12 12:36:06.961399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 he state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b5a60 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961467] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961479] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961493] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961506] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961530] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961549] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.157 [2024-07-12 12:36:06.961562] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.157 [2024-07-12 12:36:06.961579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.157 [2024-07-12 12:36:06.961587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.158 [2024-07-12 12:36:06.961593] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.158 [2024-07-12 12:36:06.961605] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 ns[2024-07-12 12:36:06.961618] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:13.158 he state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.158 [2024-07-12 12:36:06.961647] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.158 [2024-07-12 12:36:06.961661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-07-12 12:36:06.961650] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.158 he state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961677] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f1f70 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961698] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961742] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961755] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961768] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961781] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961806] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961818] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961832] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961845] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961883] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961898] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961910] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961923] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961935] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961947] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.961992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962018] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962045] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962058] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962072] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962084] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962097] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962110] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962123] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962135] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962148] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962166] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962191] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962202] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962215] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962239] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962268] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962281] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962294] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962306] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962318] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962331] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962355] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962368] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.962380] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeca40 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.963435] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.158 [2024-07-12 12:36:06.966706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.158 [2024-07-12 12:36:06.966735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.158 [2024-07-12 12:36:06.966757] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.966771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.158 [2024-07-12 12:36:06.966789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.158 [2024-07-12 12:36:06.966793] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.966808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:12[2024-07-12 12:36:06.966808] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.158 he state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.966825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-12 12:36:06.966826] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.158 he state(5) to be set 00:22:13.158 [2024-07-12 12:36:06.966842] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.966854] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-12 12:36:06.966875] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 he state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966892] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.966895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128he state(5) to be set 00:22:13.159 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.966912] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.966925] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.966938] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.966952] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128[2024-07-12 12:36:06.966965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 he state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966979] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.966979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:13.159 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.966994] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.966998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967006] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967019] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:12[2024-07-12 12:36:06.967032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 he state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967047] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:13.159 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967061] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967074] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967086] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967102] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967116] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967129] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967142] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967155] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967178] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:13.159 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967194] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967220] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967233] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967248] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967261] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:12he state(5) to be set 00:22:13.159 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:13.159 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967307] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967320] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967334] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 [2024-07-12 12:36:06.967347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.159 [2024-07-12 12:36:06.967361] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.159 [2024-07-12 12:36:06.967372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-12 12:36:06.967374] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.159 he state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:12he state(5) to be set 00:22:13.160 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967404] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:13.160 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967432] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967445] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967458] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-12 12:36:06.967471] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 he state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967485] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967498] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967511] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:28288 len:128he state(5) to be set 00:22:13.160 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967538] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with t[2024-07-12 12:36:06.967540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:22:13.160 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967553] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967566] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967591] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-07-12 12:36:06.967605] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 he state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967620] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967632] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967645] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967658] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdeced0 is same with the state(5) to be set 00:22:13.160 [2024-07-12 12:36:06.967668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.967972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.967987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.968003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.968017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.968033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.968047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.968063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.968077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.968093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.968111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.160 [2024-07-12 12:36:06.968127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.160 [2024-07-12 12:36:06.968141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.161 [2024-07-12 12:36:06.968803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.161 [2024-07-12 12:36:06.968817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2367260 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.968934] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2367260 was disconnected and freed. reset controller. 00:22:13.161 [2024-07-12 12:36:06.969207] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969238] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969276] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969301] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969314] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969350] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969362] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969374] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969411] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969423] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969435] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.969459] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded380 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.970167] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.161 [2024-07-12 12:36:06.970195] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970209] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970227] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970240] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970253] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970266] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970278] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970327] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970346] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970359] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970371] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970397] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970410] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.970422] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xded830 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971347] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971376] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971390] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971403] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971415] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971427] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971440] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971502] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971514] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971527] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971576] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controlle[2024-07-12 12:36:06.971588] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdedcc0 is same with tr 00:22:13.162 he state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21f1f70 (9): Bad file descriptor 00:22:13.162 [2024-07-12 12:36:06.971667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x222a4f0 (9): Bad file descriptor 00:22:13.162 [2024-07-12 12:36:06.971701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b5a60 (9): Bad file descriptor 00:22:13.162 [2024-07-12 12:36:06.971752] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.971773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.971788] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.971802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.971817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.971830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.971845] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.971874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.971893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b0490 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.971960] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.971982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.971997] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.972011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.972025] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.972039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.972052] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.972066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.972079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e8e60 is same with the state(5) to be set 00:22:13.162 [2024-07-12 12:36:06.972123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.972143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.972169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.972183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.972197] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.162 [2024-07-12 12:36:06.972216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.162 [2024-07-12 12:36:06.972231] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.163 [2024-07-12 12:36:06.972245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.972258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2152a50 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972289] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972302] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.163 [2024-07-12 12:36:06.972316] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with t[2024-07-12 12:36:06.972322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:22:13.163 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.972342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.163 [2024-07-12 12:36:06.972344] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.972360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972370] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.163 [2024-07-12 12:36:06.972373] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.972386] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972398] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-07-12 12:36:06.972399] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with tid:0 cdw10:00000000 cdw11:00000000 00:22:13.163 he state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972414] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with t[2024-07-12 12:36:06.972414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:22:13.163 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.972429] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with t[2024-07-12 12:36:06.972430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b08c0 is same he state(5) to be set 00:22:13.163 with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972443] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972456] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972469] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972481] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972499] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972536] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972548] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.972560] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xdee150 is same with the state(5) to be set 00:22:13.163 [2024-07-12 12:36:06.973620] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.163 [2024-07-12 12:36:06.974002] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.163 [2024-07-12 12:36:06.974281] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.163 [2024-07-12 12:36:06.974348] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.163 [2024-07-12 12:36:06.974413] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:13.163 [2024-07-12 12:36:06.974640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.163 [2024-07-12 12:36:06.974918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.163 [2024-07-12 12:36:06.974938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.974955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.974970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.974985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.164 [2024-07-12 12:36:06.975286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x32571a0 is same with the state(5) to be set 00:22:13.164 [2024-07-12 12:36:06.975370] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x32571a0 was disconnected and freed. reset controller. 00:22:13.164 [2024-07-12 12:36:06.975439] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:13.164 [2024-07-12 12:36:06.975461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.975476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ef210 is same with the state(5) to be set 00:22:13.164 [2024-07-12 12:36:06.976469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:13.164 [2024-07-12 12:36:06.976530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2373830 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.976564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21ef210 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.976654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:13.164 [2024-07-12 12:36:06.976676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:13.164 [2024-07-12 12:36:06.976693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:13.164 [2024-07-12 12:36:06.977031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.164 [2024-07-12 12:36:06.977140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.164 [2024-07-12 12:36:06.977255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.164 [2024-07-12 12:36:06.977282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2373830 with addr=10.0.0.2, port=4420 00:22:13.164 [2024-07-12 12:36:06.977299] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2373830 is same with the state(5) to be set 00:22:13.164 [2024-07-12 12:36:06.977383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2373830 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.977409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21f1f70 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.977476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:13.164 [2024-07-12 12:36:06.977494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:13.164 [2024-07-12 12:36:06.977509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:13.164 [2024-07-12 12:36:06.977528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:13.164 [2024-07-12 12:36:06.977543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:13.164 [2024-07-12 12:36:06.977557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:13.164 [2024-07-12 12:36:06.977628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.164 [2024-07-12 12:36:06.977648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.164 [2024-07-12 12:36:06.979402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:13.164 [2024-07-12 12:36:06.979590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.164 [2024-07-12 12:36:06.979709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.164 [2024-07-12 12:36:06.979735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21ef210 with addr=10.0.0.2, port=4420 00:22:13.164 [2024-07-12 12:36:06.979752] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ef210 is same with the state(5) to be set 00:22:13.164 [2024-07-12 12:36:06.979812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21ef210 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.979885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:13.164 [2024-07-12 12:36:06.979906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:13.164 [2024-07-12 12:36:06.979921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:13.164 [2024-07-12 12:36:06.979979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.164 [2024-07-12 12:36:06.981642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b0490 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.981718] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.164 [2024-07-12 12:36:06.981741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.981758] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.164 [2024-07-12 12:36:06.981772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.981787] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.164 [2024-07-12 12:36:06.981801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.981815] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:13.164 [2024-07-12 12:36:06.981828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.164 [2024-07-12 12:36:06.981841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e8a30 is same with the state(5) to be set 00:22:13.164 [2024-07-12 12:36:06.981885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e8e60 (9): Bad file descriptor 00:22:13.164 [2024-07-12 12:36:06.981918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2152a50 (9): Bad file descriptor 00:22:13.165 [2024-07-12 12:36:06.981948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b08c0 (9): Bad file descriptor 00:22:13.165 [2024-07-12 12:36:06.982081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.982978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.982995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.165 [2024-07-12 12:36:06.983322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.165 [2024-07-12 12:36:06.983338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.983982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.983998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.984012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.984028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.984042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.984058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.984072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.984088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.984102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.984118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.984131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.984146] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21dee70 is same with the state(5) to be set 00:22:13.166 [2024-07-12 12:36:06.985465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.985970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.166 [2024-07-12 12:36:06.985988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.166 [2024-07-12 12:36:06.986005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.986980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.986996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.167 [2024-07-12 12:36:06.987225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.167 [2024-07-12 12:36:06.987241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.987462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.987476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x33f9d70 is same with the state(5) to be set 00:22:13.168 [2024-07-12 12:36:06.989595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:13.168 [2024-07-12 12:36:06.989628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:13.168 [2024-07-12 12:36:06.989992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.990105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.990132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23b5a60 with addr=10.0.0.2, port=4420 00:22:13.168 [2024-07-12 12:36:06.990160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b5a60 is same with the state(5) to be set 00:22:13.168 [2024-07-12 12:36:06.990242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.990330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.990354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x222a4f0 with addr=10.0.0.2, port=4420 00:22:13.168 [2024-07-12 12:36:06.990371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x222a4f0 is same with the state(5) to be set 00:22:13.168 [2024-07-12 12:36:06.990964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:13.168 [2024-07-12 12:36:06.990992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:13.168 [2024-07-12 12:36:06.991012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:13.168 [2024-07-12 12:36:06.991059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b5a60 (9): Bad file descriptor 00:22:13.168 [2024-07-12 12:36:06.991081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x222a4f0 (9): Bad file descriptor 00:22:13.168 [2024-07-12 12:36:06.991225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.991319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.991345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21f1f70 with addr=10.0.0.2, port=4420 00:22:13.168 [2024-07-12 12:36:06.991362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f1f70 is same with the state(5) to be set 00:22:13.168 [2024-07-12 12:36:06.991442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.991536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.991561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2373830 with addr=10.0.0.2, port=4420 00:22:13.168 [2024-07-12 12:36:06.991577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2373830 is same with the state(5) to be set 00:22:13.168 [2024-07-12 12:36:06.991661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.991754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.168 [2024-07-12 12:36:06.991779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21ef210 with addr=10.0.0.2, port=4420 00:22:13.168 [2024-07-12 12:36:06.991795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ef210 is same with the state(5) to be set 00:22:13.168 [2024-07-12 12:36:06.991810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:13.168 [2024-07-12 12:36:06.991823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:13.168 [2024-07-12 12:36:06.991839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:13.168 [2024-07-12 12:36:06.991875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:13.168 [2024-07-12 12:36:06.991891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:13.168 [2024-07-12 12:36:06.991905] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:13.168 [2024-07-12 12:36:06.991980] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.168 [2024-07-12 12:36:06.992001] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.168 [2024-07-12 12:36:06.992018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21f1f70 (9): Bad file descriptor 00:22:13.168 [2024-07-12 12:36:06.992038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2373830 (9): Bad file descriptor 00:22:13.168 [2024-07-12 12:36:06.992056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21ef210 (9): Bad file descriptor 00:22:13.168 [2024-07-12 12:36:06.992089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e8a30 (9): Bad file descriptor 00:22:13.168 [2024-07-12 12:36:06.992193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:13.168 [2024-07-12 12:36:06.992213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:13.168 [2024-07-12 12:36:06.992227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:13.168 [2024-07-12 12:36:06.992245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:13.168 [2024-07-12 12:36:06.992260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:13.168 [2024-07-12 12:36:06.992274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:13.168 [2024-07-12 12:36:06.992292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:13.168 [2024-07-12 12:36:06.992306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:13.168 [2024-07-12 12:36:06.992319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:13.168 [2024-07-12 12:36:06.992376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.992398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.992422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.992438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.992457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.992471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.992487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.992501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.992517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.992532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.992548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.168 [2024-07-12 12:36:06.992562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.168 [2024-07-12 12:36:06.992579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.992968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.992982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.169 [2024-07-12 12:36:06.993920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.169 [2024-07-12 12:36:06.993934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.993951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.993965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.993980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.993995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.994397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.994412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2368820 is same with the state(5) to be set 00:22:13.170 [2024-07-12 12:36:06.995637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.995972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.995988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.996301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.996316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x232ec30 is same with the state(5) to be set 00:22:13.170 [2024-07-12 12:36:06.997366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.997390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.997410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.997425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.997442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.997457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.997473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.997486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.997503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.997517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.997533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.170 [2024-07-12 12:36:06.997548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.170 [2024-07-12 12:36:06.997564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.997978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.997991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.998006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2330210 is same with the state(5) to be set 00:22:13.171 [2024-07-12 12:36:06.999037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.171 [2024-07-12 12:36:06.999659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.171 [2024-07-12 12:36:06.999674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23317f0 is same with the state(5) to be set 00:22:13.171 [2024-07-12 12:36:07.000699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.171 [2024-07-12 12:36:07.000726] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.171 [2024-07-12 12:36:07.000740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.171 [2024-07-12 12:36:07.000756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:13.171 [2024-07-12 12:36:07.000777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:13.171 [2024-07-12 12:36:07.000954] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:13.171 [2024-07-12 12:36:07.000984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:13.171 [2024-07-12 12:36:07.001194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.171 [2024-07-12 12:36:07.001302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.171 [2024-07-12 12:36:07.001329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2152a50 with addr=10.0.0.2, port=4420 00:22:13.171 [2024-07-12 12:36:07.001346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2152a50 is same with the state(5) to be set 00:22:13.171 [2024-07-12 12:36:07.001423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.171 [2024-07-12 12:36:07.001512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.171 [2024-07-12 12:36:07.001537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23b08c0 with addr=10.0.0.2, port=4420 00:22:13.171 [2024-07-12 12:36:07.001553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b08c0 is same with the state(5) to be set 00:22:13.171 [2024-07-12 12:36:07.002696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:13.171 [2024-07-12 12:36:07.002725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:13.172 [2024-07-12 12:36:07.002841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.002953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.002980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23b0490 with addr=10.0.0.2, port=4420 00:22:13.172 [2024-07-12 12:36:07.002996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b0490 is same with the state(5) to be set 00:22:13.172 [2024-07-12 12:36:07.003072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.003177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.003202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21e8e60 with addr=10.0.0.2, port=4420 00:22:13.172 [2024-07-12 12:36:07.003218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e8e60 is same with the state(5) to be set 00:22:13.172 [2024-07-12 12:36:07.003243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2152a50 (9): Bad file descriptor 00:22:13.172 [2024-07-12 12:36:07.003263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b08c0 (9): Bad file descriptor 00:22:13.172 [2024-07-12 12:36:07.003445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.003527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.003553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x222a4f0 with addr=10.0.0.2, port=4420 00:22:13.172 [2024-07-12 12:36:07.003569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x222a4f0 is same with the state(5) to be set 00:22:13.172 [2024-07-12 12:36:07.003641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.003718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.172 [2024-07-12 12:36:07.003742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23b5a60 with addr=10.0.0.2, port=4420 00:22:13.172 [2024-07-12 12:36:07.003758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b5a60 is same with the state(5) to be set 00:22:13.172 [2024-07-12 12:36:07.003777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b0490 (9): Bad file descriptor 00:22:13.172 [2024-07-12 12:36:07.003796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e8e60 (9): Bad file descriptor 00:22:13.172 [2024-07-12 12:36:07.003813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:13.172 [2024-07-12 12:36:07.003827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:13.172 [2024-07-12 12:36:07.003843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:13.172 [2024-07-12 12:36:07.003885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:13.172 [2024-07-12 12:36:07.003902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:13.172 [2024-07-12 12:36:07.003915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:13.172 [2024-07-12 12:36:07.004002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:13.172 [2024-07-12 12:36:07.004621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:13.172 [2024-07-12 12:36:07.004635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2332dd0 is same with the state(5) to be set 00:22:13.172 [2024-07-12 12:36:07.006053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:13.172 [2024-07-12 12:36:07.006084] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:13.172 [2024-07-12 12:36:07.006102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:13.172 [2024-07-12 12:36:07.006131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.172 [2024-07-12 12:36:07.006145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.172 task offset: 29184 on job bdev=Nvme1n1 fails 00:22:13.172 00:22:13.172 Latency(us) 00:22:13.172 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:13.172 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.172 Job: Nvme1n1 ended in about 0.57 seconds with error 00:22:13.172 Verification LBA range: start 0x0 length 0x400 00:22:13.172 Nvme1n1 : 0.57 366.28 22.89 112.70 0.00 132439.12 29321.29 116508.44 00:22:13.173 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme2n1 ended in about 0.60 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme2n1 : 0.60 347.76 21.74 107.00 0.00 137766.24 52040.44 115731.72 00:22:13.173 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme3n1 ended in about 0.58 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme3n1 : 0.58 356.61 22.29 109.73 0.00 132449.11 29709.65 113401.55 00:22:13.173 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme4n1 ended in about 0.61 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme4n1 : 0.61 341.92 21.37 105.20 0.00 136537.62 45438.29 114178.28 00:22:13.173 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme5n1 ended in about 0.61 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme5n1 : 0.61 340.96 21.31 32.78 0.00 153454.74 40389.59 114955.00 00:22:13.173 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme6n1 ended in about 0.61 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme6n1 : 0.61 340.02 21.25 32.69 0.00 151972.83 39224.51 118061.89 00:22:13.173 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme7n1 ended in about 0.61 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme7n1 : 0.61 339.10 21.19 32.61 0.00 150544.58 37088.52 119615.34 00:22:13.173 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme8n1 ended in about 0.62 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme8n1 : 0.62 336.38 21.02 32.34 0.00 149442.52 39807.05 117285.17 00:22:13.173 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme9n1 ended in about 0.59 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme9n1 : 0.59 352.97 22.06 33.94 0.00 146115.90 4296.25 121168.78 00:22:13.173 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:13.173 Job: Nvme10n1 ended in about 0.60 seconds with error 00:22:13.173 Verification LBA range: start 0x0 length 0x400 00:22:13.173 Nvme10n1 : 0.60 272.69 17.04 106.42 0.00 148312.35 83886.08 121168.78 00:22:13.173 =================================================================================================================== 00:22:13.173 Total : 3394.69 212.17 705.42 0.00 143250.99 4296.25 121168.78 00:22:13.173 [2024-07-12 12:36:07.032060] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:13.173 [2024-07-12 12:36:07.032142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:13.173 [2024-07-12 12:36:07.032249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x222a4f0 (9): Bad file descriptor 00:22:13.173 [2024-07-12 12:36:07.032278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b5a60 (9): Bad file descriptor 00:22:13.173 [2024-07-12 12:36:07.032298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.032313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.032329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:13.173 [2024-07-12 12:36:07.032354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.032369] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.032384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:13.173 [2024-07-12 12:36:07.032515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.032540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.032759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.032880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.032908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21ef210 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.032936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21ef210 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.033023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.033117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.033142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2373830 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.033170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2373830 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.033261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.033339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.033364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21f1f70 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.033380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21f1f70 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.033458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.033543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.033567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21e8a30 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.033583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e8a30 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.033598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.033611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.033625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:13.173 [2024-07-12 12:36:07.033646] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.033661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.033674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:13.173 [2024-07-12 12:36:07.033741] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:13.173 [2024-07-12 12:36:07.033767] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:13.173 [2024-07-12 12:36:07.034114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.034139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.034177] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21ef210 (9): Bad file descriptor 00:22:13.173 [2024-07-12 12:36:07.034199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2373830 (9): Bad file descriptor 00:22:13.173 [2024-07-12 12:36:07.034230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21f1f70 (9): Bad file descriptor 00:22:13.173 [2024-07-12 12:36:07.034248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e8a30 (9): Bad file descriptor 00:22:13.173 [2024-07-12 12:36:07.034309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:13.173 [2024-07-12 12:36:07.034334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:13.173 [2024-07-12 12:36:07.034352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:13.173 [2024-07-12 12:36:07.034368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:13.173 [2024-07-12 12:36:07.034416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.034434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.034448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:13.173 [2024-07-12 12:36:07.034466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.034481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.034495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:13.173 [2024-07-12 12:36:07.034511] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.034526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.034538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:13.173 [2024-07-12 12:36:07.034555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:13.173 [2024-07-12 12:36:07.034569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:13.173 [2024-07-12 12:36:07.034583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:13.173 [2024-07-12 12:36:07.034632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.034652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.034665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.034677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.173 [2024-07-12 12:36:07.034759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.034835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.034876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23b08c0 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.034895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b08c0 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.034976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.035056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.035080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x2152a50 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.035097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2152a50 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.035184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.035264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.173 [2024-07-12 12:36:07.035288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x21e8e60 with addr=10.0.0.2, port=4420 00:22:13.173 [2024-07-12 12:36:07.035304] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x21e8e60 is same with the state(5) to be set 00:22:13.173 [2024-07-12 12:36:07.035382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.174 [2024-07-12 12:36:07.035463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:13.174 [2024-07-12 12:36:07.035487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x23b0490 with addr=10.0.0.2, port=4420 00:22:13.174 [2024-07-12 12:36:07.035507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x23b0490 is same with the state(5) to be set 00:22:13.174 [2024-07-12 12:36:07.035551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b08c0 (9): Bad file descriptor 00:22:13.174 [2024-07-12 12:36:07.035575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2152a50 (9): Bad file descriptor 00:22:13.174 [2024-07-12 12:36:07.035596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x21e8e60 (9): Bad file descriptor 00:22:13.174 [2024-07-12 12:36:07.035615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x23b0490 (9): Bad file descriptor 00:22:13.174 [2024-07-12 12:36:07.035660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:13.174 [2024-07-12 12:36:07.035679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:13.174 [2024-07-12 12:36:07.035693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:13.174 [2024-07-12 12:36:07.035710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:13.174 [2024-07-12 12:36:07.035725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:13.174 [2024-07-12 12:36:07.035739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:13.174 [2024-07-12 12:36:07.035755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:13.174 [2024-07-12 12:36:07.035770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:13.174 [2024-07-12 12:36:07.035783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:13.174 [2024-07-12 12:36:07.035799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:13.174 [2024-07-12 12:36:07.035813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:13.174 [2024-07-12 12:36:07.035826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:13.174 [2024-07-12 12:36:07.035878] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.174 [2024-07-12 12:36:07.035897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.174 [2024-07-12 12:36:07.035910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.174 [2024-07-12 12:36:07.035922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:13.741 12:36:07 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:13.741 12:36:07 -- target/shutdown.sh@138 -- # sleep 1 00:22:14.674 12:36:08 -- target/shutdown.sh@141 -- # kill -9 1334167 00:22:14.674 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1334167) - No such process 00:22:14.674 12:36:08 -- target/shutdown.sh@141 -- # true 00:22:14.674 12:36:08 -- target/shutdown.sh@143 -- # stoptarget 00:22:14.674 12:36:08 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:14.674 12:36:08 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:14.674 12:36:08 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:14.674 12:36:08 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:14.674 12:36:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:14.674 12:36:08 -- nvmf/common.sh@116 -- # sync 00:22:14.674 12:36:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:14.674 12:36:08 -- nvmf/common.sh@119 -- # set +e 00:22:14.674 12:36:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:14.674 12:36:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:14.674 rmmod nvme_tcp 00:22:14.674 rmmod nvme_fabrics 00:22:14.674 rmmod nvme_keyring 00:22:14.674 12:36:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:14.674 12:36:08 -- nvmf/common.sh@123 -- # set -e 00:22:14.674 12:36:08 -- nvmf/common.sh@124 -- # return 0 00:22:14.674 12:36:08 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:14.674 12:36:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:14.674 12:36:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:14.674 12:36:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:14.674 12:36:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:14.674 12:36:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:14.674 12:36:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:14.674 12:36:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:14.674 12:36:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.232 12:36:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:17.232 00:22:17.232 real 0m7.998s 00:22:17.232 user 0m20.742s 00:22:17.232 sys 0m1.450s 00:22:17.232 12:36:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:17.232 12:36:10 -- common/autotest_common.sh@10 -- # set +x 00:22:17.232 ************************************ 00:22:17.232 END TEST nvmf_shutdown_tc3 00:22:17.232 ************************************ 00:22:17.232 12:36:10 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:17.232 00:22:17.232 real 0m28.501s 00:22:17.232 user 1m22.636s 00:22:17.232 sys 0m6.106s 00:22:17.232 12:36:10 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:17.232 12:36:10 -- common/autotest_common.sh@10 -- # set +x 00:22:17.232 ************************************ 00:22:17.232 END TEST nvmf_shutdown 00:22:17.232 ************************************ 00:22:17.232 12:36:10 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:17.232 12:36:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:17.232 12:36:10 -- common/autotest_common.sh@10 -- # set +x 00:22:17.232 12:36:10 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:17.232 12:36:10 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:17.232 12:36:10 -- common/autotest_common.sh@10 -- # set +x 00:22:17.232 12:36:10 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:17.232 12:36:10 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:17.232 12:36:10 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:17.232 12:36:10 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:17.232 12:36:10 -- common/autotest_common.sh@10 -- # set +x 00:22:17.232 ************************************ 00:22:17.232 START TEST nvmf_multicontroller 00:22:17.232 ************************************ 00:22:17.232 12:36:10 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:17.232 * Looking for test storage... 00:22:17.232 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:17.232 12:36:10 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:17.232 12:36:10 -- nvmf/common.sh@7 -- # uname -s 00:22:17.232 12:36:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:17.232 12:36:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:17.232 12:36:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:17.232 12:36:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:17.232 12:36:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:17.232 12:36:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:17.232 12:36:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:17.232 12:36:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:17.232 12:36:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:17.232 12:36:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:17.232 12:36:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.232 12:36:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:17.232 12:36:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:17.232 12:36:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:17.232 12:36:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:17.232 12:36:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:17.232 12:36:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:17.232 12:36:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:17.232 12:36:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:17.232 12:36:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.232 12:36:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.232 12:36:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.232 12:36:10 -- paths/export.sh@5 -- # export PATH 00:22:17.232 12:36:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:17.232 12:36:10 -- nvmf/common.sh@46 -- # : 0 00:22:17.232 12:36:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:17.232 12:36:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:17.232 12:36:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:17.232 12:36:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:17.232 12:36:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:17.232 12:36:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:17.232 12:36:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:17.232 12:36:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:17.232 12:36:10 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:17.232 12:36:10 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:17.232 12:36:10 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:17.232 12:36:10 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:17.232 12:36:10 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:17.232 12:36:10 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:17.232 12:36:10 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:17.232 12:36:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:17.232 12:36:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:17.232 12:36:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:17.232 12:36:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:17.232 12:36:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:17.232 12:36:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:17.232 12:36:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:17.232 12:36:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:17.232 12:36:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:17.232 12:36:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:17.232 12:36:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:17.232 12:36:10 -- common/autotest_common.sh@10 -- # set +x 00:22:19.131 12:36:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:19.131 12:36:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:19.131 12:36:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:19.131 12:36:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:19.131 12:36:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:19.131 12:36:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:19.131 12:36:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:19.131 12:36:12 -- nvmf/common.sh@294 -- # net_devs=() 00:22:19.131 12:36:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:19.131 12:36:12 -- nvmf/common.sh@295 -- # e810=() 00:22:19.131 12:36:12 -- nvmf/common.sh@295 -- # local -ga e810 00:22:19.131 12:36:12 -- nvmf/common.sh@296 -- # x722=() 00:22:19.131 12:36:12 -- nvmf/common.sh@296 -- # local -ga x722 00:22:19.131 12:36:12 -- nvmf/common.sh@297 -- # mlx=() 00:22:19.131 12:36:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:19.131 12:36:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:19.131 12:36:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:19.131 12:36:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:19.131 12:36:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:19.131 12:36:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.131 12:36:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:19.131 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:19.131 12:36:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:19.131 12:36:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:19.131 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:19.131 12:36:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:19.131 12:36:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:19.132 12:36:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:19.132 12:36:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:19.132 12:36:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.132 12:36:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.132 12:36:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.132 12:36:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.132 12:36:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:19.132 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:19.132 12:36:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.132 12:36:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:19.132 12:36:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:19.132 12:36:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:19.132 12:36:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:19.132 12:36:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:19.132 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:19.132 12:36:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:19.132 12:36:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:19.132 12:36:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:19.132 12:36:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:19.132 12:36:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:19.132 12:36:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:19.132 12:36:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:19.132 12:36:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:19.132 12:36:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:19.132 12:36:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:19.132 12:36:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:19.132 12:36:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:19.132 12:36:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:19.132 12:36:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:19.132 12:36:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:19.132 12:36:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:19.132 12:36:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:19.132 12:36:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:19.132 12:36:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:19.132 12:36:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:19.132 12:36:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:19.132 12:36:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:19.132 12:36:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:19.132 12:36:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:19.132 12:36:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:19.132 12:36:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:19.132 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:19.132 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:22:19.132 00:22:19.132 --- 10.0.0.2 ping statistics --- 00:22:19.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.132 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:22:19.132 12:36:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:19.132 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:19.132 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:22:19.132 00:22:19.132 --- 10.0.0.1 ping statistics --- 00:22:19.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:19.132 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:22:19.132 12:36:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:19.132 12:36:12 -- nvmf/common.sh@410 -- # return 0 00:22:19.132 12:36:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:19.132 12:36:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:19.132 12:36:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:19.132 12:36:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:19.132 12:36:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:19.132 12:36:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:19.132 12:36:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:19.132 12:36:12 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:19.132 12:36:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:19.132 12:36:12 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:19.132 12:36:12 -- common/autotest_common.sh@10 -- # set +x 00:22:19.132 12:36:12 -- nvmf/common.sh@469 -- # nvmfpid=1337095 00:22:19.132 12:36:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:19.132 12:36:12 -- nvmf/common.sh@470 -- # waitforlisten 1337095 00:22:19.132 12:36:12 -- common/autotest_common.sh@819 -- # '[' -z 1337095 ']' 00:22:19.132 12:36:12 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:19.132 12:36:12 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:19.132 12:36:12 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:19.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:19.132 12:36:12 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:19.132 12:36:12 -- common/autotest_common.sh@10 -- # set +x 00:22:19.132 [2024-07-12 12:36:12.869113] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:19.132 [2024-07-12 12:36:12.869236] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:19.132 EAL: No free 2048 kB hugepages reported on node 1 00:22:19.132 [2024-07-12 12:36:12.939565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:19.389 [2024-07-12 12:36:13.057108] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:19.389 [2024-07-12 12:36:13.057265] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:19.389 [2024-07-12 12:36:13.057284] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:19.389 [2024-07-12 12:36:13.057297] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:19.389 [2024-07-12 12:36:13.057357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:19.389 [2024-07-12 12:36:13.057426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:19.389 [2024-07-12 12:36:13.057429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:19.952 12:36:13 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:19.952 12:36:13 -- common/autotest_common.sh@852 -- # return 0 00:22:19.952 12:36:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:19.952 12:36:13 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:19.952 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:19.952 12:36:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:19.952 12:36:13 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:19.952 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:19.952 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:19.952 [2024-07-12 12:36:13.833555] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:19.952 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:19.952 12:36:13 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:19.952 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:19.952 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:19.952 Malloc0 00:22:19.952 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:19.952 12:36:13 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:19.952 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:19.952 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 [2024-07-12 12:36:13.887503] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 [2024-07-12 12:36:13.895425] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 Malloc1 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:20.210 12:36:13 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:20.210 12:36:13 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:20.210 12:36:13 -- host/multicontroller.sh@44 -- # bdevperf_pid=1337253 00:22:20.210 12:36:13 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:20.210 12:36:13 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:20.210 12:36:13 -- host/multicontroller.sh@47 -- # waitforlisten 1337253 /var/tmp/bdevperf.sock 00:22:20.210 12:36:13 -- common/autotest_common.sh@819 -- # '[' -z 1337253 ']' 00:22:20.210 12:36:13 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:20.210 12:36:13 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:20.210 12:36:13 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:20.210 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:20.210 12:36:13 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:20.210 12:36:13 -- common/autotest_common.sh@10 -- # set +x 00:22:21.141 12:36:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:21.141 12:36:14 -- common/autotest_common.sh@852 -- # return 0 00:22:21.141 12:36:14 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:21.141 12:36:14 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.141 12:36:14 -- common/autotest_common.sh@10 -- # set +x 00:22:21.398 NVMe0n1 00:22:21.398 12:36:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:21.398 12:36:15 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:21.398 12:36:15 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:21.398 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.398 12:36:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:21.398 1 00:22:21.398 12:36:15 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:21.398 12:36:15 -- common/autotest_common.sh@640 -- # local es=0 00:22:21.398 12:36:15 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:21.398 12:36:15 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:21.398 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.398 request: 00:22:21.398 { 00:22:21.398 "name": "NVMe0", 00:22:21.398 "trtype": "tcp", 00:22:21.398 "traddr": "10.0.0.2", 00:22:21.398 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:21.398 "hostaddr": "10.0.0.2", 00:22:21.398 "hostsvcid": "60000", 00:22:21.398 "adrfam": "ipv4", 00:22:21.398 "trsvcid": "4420", 00:22:21.398 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:21.398 "method": "bdev_nvme_attach_controller", 00:22:21.398 "req_id": 1 00:22:21.398 } 00:22:21.398 Got JSON-RPC error response 00:22:21.398 response: 00:22:21.398 { 00:22:21.398 "code": -114, 00:22:21.398 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:21.398 } 00:22:21.398 12:36:15 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # es=1 00:22:21.398 12:36:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:21.398 12:36:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:21.398 12:36:15 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:21.398 12:36:15 -- common/autotest_common.sh@640 -- # local es=0 00:22:21.398 12:36:15 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:21.398 12:36:15 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:21.398 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.398 request: 00:22:21.398 { 00:22:21.398 "name": "NVMe0", 00:22:21.398 "trtype": "tcp", 00:22:21.398 "traddr": "10.0.0.2", 00:22:21.398 "hostaddr": "10.0.0.2", 00:22:21.398 "hostsvcid": "60000", 00:22:21.398 "adrfam": "ipv4", 00:22:21.398 "trsvcid": "4420", 00:22:21.398 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:21.398 "method": "bdev_nvme_attach_controller", 00:22:21.398 "req_id": 1 00:22:21.398 } 00:22:21.398 Got JSON-RPC error response 00:22:21.398 response: 00:22:21.398 { 00:22:21.398 "code": -114, 00:22:21.398 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:21.398 } 00:22:21.398 12:36:15 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # es=1 00:22:21.398 12:36:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:21.398 12:36:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:21.398 12:36:15 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@640 -- # local es=0 00:22:21.398 12:36:15 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.398 request: 00:22:21.398 { 00:22:21.398 "name": "NVMe0", 00:22:21.398 "trtype": "tcp", 00:22:21.398 "traddr": "10.0.0.2", 00:22:21.398 "hostaddr": "10.0.0.2", 00:22:21.398 "hostsvcid": "60000", 00:22:21.398 "adrfam": "ipv4", 00:22:21.398 "trsvcid": "4420", 00:22:21.398 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:21.398 "multipath": "disable", 00:22:21.398 "method": "bdev_nvme_attach_controller", 00:22:21.398 "req_id": 1 00:22:21.398 } 00:22:21.398 Got JSON-RPC error response 00:22:21.398 response: 00:22:21.398 { 00:22:21.398 "code": -114, 00:22:21.398 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:21.398 } 00:22:21.398 12:36:15 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # es=1 00:22:21.398 12:36:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:21.398 12:36:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:21.398 12:36:15 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:21.398 12:36:15 -- common/autotest_common.sh@640 -- # local es=0 00:22:21.398 12:36:15 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:21.398 12:36:15 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:22:21.398 12:36:15 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:21.398 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.398 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.398 request: 00:22:21.398 { 00:22:21.398 "name": "NVMe0", 00:22:21.398 "trtype": "tcp", 00:22:21.398 "traddr": "10.0.0.2", 00:22:21.398 "hostaddr": "10.0.0.2", 00:22:21.398 "hostsvcid": "60000", 00:22:21.398 "adrfam": "ipv4", 00:22:21.398 "trsvcid": "4420", 00:22:21.398 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:21.398 "multipath": "failover", 00:22:21.398 "method": "bdev_nvme_attach_controller", 00:22:21.398 "req_id": 1 00:22:21.398 } 00:22:21.398 Got JSON-RPC error response 00:22:21.398 response: 00:22:21.398 { 00:22:21.398 "code": -114, 00:22:21.398 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:21.398 } 00:22:21.398 12:36:15 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@643 -- # es=1 00:22:21.398 12:36:15 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:22:21.398 12:36:15 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:22:21.398 12:36:15 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:22:21.399 12:36:15 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:21.399 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.399 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.656 00:22:21.656 12:36:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:21.656 12:36:15 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:21.656 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.656 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.656 12:36:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:21.656 12:36:15 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:21.656 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.656 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.913 00:22:21.913 12:36:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:21.913 12:36:15 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:21.913 12:36:15 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:21.913 12:36:15 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:21.913 12:36:15 -- common/autotest_common.sh@10 -- # set +x 00:22:21.913 12:36:15 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:21.913 12:36:15 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:21.913 12:36:15 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:22:23.286 0 00:22:23.286 12:36:16 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:22:23.286 12:36:16 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:23.286 12:36:16 -- common/autotest_common.sh@10 -- # set +x 00:22:23.286 12:36:16 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:23.286 12:36:16 -- host/multicontroller.sh@100 -- # killprocess 1337253 00:22:23.286 12:36:16 -- common/autotest_common.sh@926 -- # '[' -z 1337253 ']' 00:22:23.286 12:36:16 -- common/autotest_common.sh@930 -- # kill -0 1337253 00:22:23.286 12:36:16 -- common/autotest_common.sh@931 -- # uname 00:22:23.286 12:36:16 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:23.286 12:36:16 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1337253 00:22:23.286 12:36:16 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:23.286 12:36:16 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:23.286 12:36:16 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1337253' 00:22:23.286 killing process with pid 1337253 00:22:23.286 12:36:16 -- common/autotest_common.sh@945 -- # kill 1337253 00:22:23.286 12:36:16 -- common/autotest_common.sh@950 -- # wait 1337253 00:22:23.286 12:36:17 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:23.286 12:36:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:23.286 12:36:17 -- common/autotest_common.sh@10 -- # set +x 00:22:23.286 12:36:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:23.286 12:36:17 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:23.286 12:36:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:23.286 12:36:17 -- common/autotest_common.sh@10 -- # set +x 00:22:23.286 12:36:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:23.286 12:36:17 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:22:23.286 12:36:17 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:23.286 12:36:17 -- common/autotest_common.sh@1597 -- # read -r file 00:22:23.286 12:36:17 -- common/autotest_common.sh@1596 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:22:23.286 12:36:17 -- common/autotest_common.sh@1596 -- # sort -u 00:22:23.286 12:36:17 -- common/autotest_common.sh@1598 -- # cat 00:22:23.286 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:23.286 [2024-07-12 12:36:13.990395] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:23.286 [2024-07-12 12:36:13.990499] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1337253 ] 00:22:23.286 EAL: No free 2048 kB hugepages reported on node 1 00:22:23.286 [2024-07-12 12:36:14.052633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:23.286 [2024-07-12 12:36:14.161043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:23.286 [2024-07-12 12:36:15.647655] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 394ce69a-c93b-4db5-b7fb-cdae4f53a484 already exists 00:22:23.286 [2024-07-12 12:36:15.647695] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:394ce69a-c93b-4db5-b7fb-cdae4f53a484 alias for bdev NVMe1n1 00:22:23.286 [2024-07-12 12:36:15.647714] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:22:23.286 Running I/O for 1 seconds... 00:22:23.286 00:22:23.286 Latency(us) 00:22:23.286 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:23.286 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:22:23.286 NVMe0n1 : 1.01 19713.81 77.01 0.00 0.00 6478.04 3762.25 13981.01 00:22:23.286 =================================================================================================================== 00:22:23.286 Total : 19713.81 77.01 0.00 0.00 6478.04 3762.25 13981.01 00:22:23.286 Received shutdown signal, test time was about 1.000000 seconds 00:22:23.286 00:22:23.286 Latency(us) 00:22:23.286 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:23.286 =================================================================================================================== 00:22:23.286 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:22:23.286 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:22:23.286 12:36:17 -- common/autotest_common.sh@1603 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:22:23.286 12:36:17 -- common/autotest_common.sh@1597 -- # read -r file 00:22:23.286 12:36:17 -- host/multicontroller.sh@108 -- # nvmftestfini 00:22:23.286 12:36:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:23.286 12:36:17 -- nvmf/common.sh@116 -- # sync 00:22:23.286 12:36:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:23.286 12:36:17 -- nvmf/common.sh@119 -- # set +e 00:22:23.286 12:36:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:23.286 12:36:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:23.286 rmmod nvme_tcp 00:22:23.286 rmmod nvme_fabrics 00:22:23.286 rmmod nvme_keyring 00:22:23.286 12:36:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:23.286 12:36:17 -- nvmf/common.sh@123 -- # set -e 00:22:23.286 12:36:17 -- nvmf/common.sh@124 -- # return 0 00:22:23.286 12:36:17 -- nvmf/common.sh@477 -- # '[' -n 1337095 ']' 00:22:23.286 12:36:17 -- nvmf/common.sh@478 -- # killprocess 1337095 00:22:23.286 12:36:17 -- common/autotest_common.sh@926 -- # '[' -z 1337095 ']' 00:22:23.286 12:36:17 -- common/autotest_common.sh@930 -- # kill -0 1337095 00:22:23.286 12:36:17 -- common/autotest_common.sh@931 -- # uname 00:22:23.286 12:36:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:23.286 12:36:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1337095 00:22:23.286 12:36:17 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:22:23.286 12:36:17 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:22:23.286 12:36:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1337095' 00:22:23.286 killing process with pid 1337095 00:22:23.286 12:36:17 -- common/autotest_common.sh@945 -- # kill 1337095 00:22:23.286 12:36:17 -- common/autotest_common.sh@950 -- # wait 1337095 00:22:23.855 12:36:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:23.855 12:36:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:23.855 12:36:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:23.855 12:36:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:23.855 12:36:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:23.855 12:36:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:23.855 12:36:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:23.855 12:36:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.760 12:36:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:25.760 00:22:25.760 real 0m8.848s 00:22:25.760 user 0m17.425s 00:22:25.760 sys 0m2.256s 00:22:25.760 12:36:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:25.760 12:36:19 -- common/autotest_common.sh@10 -- # set +x 00:22:25.760 ************************************ 00:22:25.760 END TEST nvmf_multicontroller 00:22:25.760 ************************************ 00:22:25.760 12:36:19 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:25.760 12:36:19 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:25.760 12:36:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:25.760 12:36:19 -- common/autotest_common.sh@10 -- # set +x 00:22:25.760 ************************************ 00:22:25.760 START TEST nvmf_aer 00:22:25.760 ************************************ 00:22:25.760 12:36:19 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:22:25.760 * Looking for test storage... 00:22:25.760 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:25.760 12:36:19 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:25.760 12:36:19 -- nvmf/common.sh@7 -- # uname -s 00:22:25.760 12:36:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:25.760 12:36:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:25.760 12:36:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:25.760 12:36:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:25.760 12:36:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:25.760 12:36:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:25.760 12:36:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:25.760 12:36:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:25.760 12:36:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:25.760 12:36:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:25.760 12:36:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.760 12:36:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.760 12:36:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:25.760 12:36:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:25.760 12:36:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:25.760 12:36:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:25.760 12:36:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:25.760 12:36:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:25.760 12:36:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:25.760 12:36:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.760 12:36:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.760 12:36:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.760 12:36:19 -- paths/export.sh@5 -- # export PATH 00:22:25.760 12:36:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.760 12:36:19 -- nvmf/common.sh@46 -- # : 0 00:22:25.760 12:36:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:25.760 12:36:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:25.760 12:36:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:25.760 12:36:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:25.760 12:36:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:25.760 12:36:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:25.760 12:36:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:25.760 12:36:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:25.760 12:36:19 -- host/aer.sh@11 -- # nvmftestinit 00:22:25.760 12:36:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:25.760 12:36:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:25.760 12:36:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:25.760 12:36:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:25.760 12:36:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:25.760 12:36:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:25.760 12:36:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:25.760 12:36:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.760 12:36:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:25.760 12:36:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:25.760 12:36:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:25.760 12:36:19 -- common/autotest_common.sh@10 -- # set +x 00:22:27.662 12:36:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:27.662 12:36:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:27.662 12:36:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:27.662 12:36:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:27.662 12:36:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:27.662 12:36:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:27.662 12:36:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:27.662 12:36:21 -- nvmf/common.sh@294 -- # net_devs=() 00:22:27.662 12:36:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:27.662 12:36:21 -- nvmf/common.sh@295 -- # e810=() 00:22:27.662 12:36:21 -- nvmf/common.sh@295 -- # local -ga e810 00:22:27.662 12:36:21 -- nvmf/common.sh@296 -- # x722=() 00:22:27.662 12:36:21 -- nvmf/common.sh@296 -- # local -ga x722 00:22:27.662 12:36:21 -- nvmf/common.sh@297 -- # mlx=() 00:22:27.662 12:36:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:27.662 12:36:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:27.662 12:36:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:27.662 12:36:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:27.662 12:36:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:27.662 12:36:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.662 12:36:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:27.662 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:27.662 12:36:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.662 12:36:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:27.663 12:36:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:27.663 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:27.663 12:36:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:27.663 12:36:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.663 12:36:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.663 12:36:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.663 12:36:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.663 12:36:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:27.663 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:27.663 12:36:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.663 12:36:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:27.663 12:36:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:27.663 12:36:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:27.663 12:36:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:27.663 12:36:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:27.663 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:27.663 12:36:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:27.663 12:36:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:27.663 12:36:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:27.663 12:36:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:27.663 12:36:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:27.663 12:36:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:27.663 12:36:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:27.663 12:36:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:27.663 12:36:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:27.663 12:36:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:27.663 12:36:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:27.663 12:36:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:27.663 12:36:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:27.663 12:36:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:27.663 12:36:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:27.663 12:36:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:27.663 12:36:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:27.663 12:36:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:27.663 12:36:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:27.663 12:36:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:27.663 12:36:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:27.663 12:36:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:27.663 12:36:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:27.663 12:36:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:27.663 12:36:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:27.663 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:27.663 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:22:27.663 00:22:27.663 --- 10.0.0.2 ping statistics --- 00:22:27.663 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.663 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:22:27.663 12:36:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:27.921 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:27.921 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.097 ms 00:22:27.921 00:22:27.921 --- 10.0.0.1 ping statistics --- 00:22:27.921 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.921 rtt min/avg/max/mdev = 0.097/0.097/0.097/0.000 ms 00:22:27.921 12:36:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:27.921 12:36:21 -- nvmf/common.sh@410 -- # return 0 00:22:27.921 12:36:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:27.921 12:36:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:27.922 12:36:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:27.922 12:36:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:27.922 12:36:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:27.922 12:36:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:27.922 12:36:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:27.922 12:36:21 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:22:27.922 12:36:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:27.922 12:36:21 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:27.922 12:36:21 -- common/autotest_common.sh@10 -- # set +x 00:22:27.922 12:36:21 -- nvmf/common.sh@469 -- # nvmfpid=1339616 00:22:27.922 12:36:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:27.922 12:36:21 -- nvmf/common.sh@470 -- # waitforlisten 1339616 00:22:27.922 12:36:21 -- common/autotest_common.sh@819 -- # '[' -z 1339616 ']' 00:22:27.922 12:36:21 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:27.922 12:36:21 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:27.922 12:36:21 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:27.922 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:27.922 12:36:21 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:27.922 12:36:21 -- common/autotest_common.sh@10 -- # set +x 00:22:27.922 [2024-07-12 12:36:21.653786] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:27.922 [2024-07-12 12:36:21.653883] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:27.922 EAL: No free 2048 kB hugepages reported on node 1 00:22:27.922 [2024-07-12 12:36:21.724807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:27.922 [2024-07-12 12:36:21.840492] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:27.922 [2024-07-12 12:36:21.840649] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:27.922 [2024-07-12 12:36:21.840667] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:27.922 [2024-07-12 12:36:21.840681] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:27.922 [2024-07-12 12:36:21.840732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:27.922 [2024-07-12 12:36:21.840756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:27.922 [2024-07-12 12:36:21.840807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:27.922 [2024-07-12 12:36:21.840810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:28.856 12:36:22 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:28.856 12:36:22 -- common/autotest_common.sh@852 -- # return 0 00:22:28.856 12:36:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:28.856 12:36:22 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:28.856 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.856 12:36:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:28.856 12:36:22 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:28.856 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.856 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.856 [2024-07-12 12:36:22.592255] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:28.856 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.856 12:36:22 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:22:28.856 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.856 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.856 Malloc0 00:22:28.856 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.856 12:36:22 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:22:28.856 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.856 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.856 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.856 12:36:22 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:28.856 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.856 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.857 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.857 12:36:22 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:28.857 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.857 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.857 [2024-07-12 12:36:22.643095] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:28.857 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.857 12:36:22 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:22:28.857 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:28.857 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:28.857 [2024-07-12 12:36:22.650841] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:28.857 [ 00:22:28.857 { 00:22:28.857 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:28.857 "subtype": "Discovery", 00:22:28.857 "listen_addresses": [], 00:22:28.857 "allow_any_host": true, 00:22:28.857 "hosts": [] 00:22:28.857 }, 00:22:28.857 { 00:22:28.857 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:28.857 "subtype": "NVMe", 00:22:28.857 "listen_addresses": [ 00:22:28.857 { 00:22:28.857 "transport": "TCP", 00:22:28.857 "trtype": "TCP", 00:22:28.857 "adrfam": "IPv4", 00:22:28.857 "traddr": "10.0.0.2", 00:22:28.857 "trsvcid": "4420" 00:22:28.857 } 00:22:28.857 ], 00:22:28.857 "allow_any_host": true, 00:22:28.857 "hosts": [], 00:22:28.857 "serial_number": "SPDK00000000000001", 00:22:28.857 "model_number": "SPDK bdev Controller", 00:22:28.857 "max_namespaces": 2, 00:22:28.857 "min_cntlid": 1, 00:22:28.857 "max_cntlid": 65519, 00:22:28.857 "namespaces": [ 00:22:28.857 { 00:22:28.857 "nsid": 1, 00:22:28.857 "bdev_name": "Malloc0", 00:22:28.857 "name": "Malloc0", 00:22:28.857 "nguid": "F1549A5E81DE429A8BFC59B04F9C0309", 00:22:28.857 "uuid": "f1549a5e-81de-429a-8bfc-59b04f9c0309" 00:22:28.857 } 00:22:28.857 ] 00:22:28.857 } 00:22:28.857 ] 00:22:28.857 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:28.857 12:36:22 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:22:28.857 12:36:22 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:22:28.857 12:36:22 -- host/aer.sh@33 -- # aerpid=1339775 00:22:28.857 12:36:22 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:22:28.857 12:36:22 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:22:28.857 12:36:22 -- common/autotest_common.sh@1244 -- # local i=0 00:22:28.857 12:36:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:28.857 12:36:22 -- common/autotest_common.sh@1246 -- # '[' 0 -lt 200 ']' 00:22:28.857 12:36:22 -- common/autotest_common.sh@1247 -- # i=1 00:22:28.857 12:36:22 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:22:28.857 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.857 12:36:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:28.857 12:36:22 -- common/autotest_common.sh@1246 -- # '[' 1 -lt 200 ']' 00:22:28.857 12:36:22 -- common/autotest_common.sh@1247 -- # i=2 00:22:28.857 12:36:22 -- common/autotest_common.sh@1248 -- # sleep 0.1 00:22:29.114 12:36:22 -- common/autotest_common.sh@1245 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:29.114 12:36:22 -- common/autotest_common.sh@1251 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:22:29.114 12:36:22 -- common/autotest_common.sh@1255 -- # return 0 00:22:29.114 12:36:22 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:22:29.114 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.114 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:29.114 Malloc1 00:22:29.114 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.114 12:36:22 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:22:29.114 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.114 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:29.114 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.114 12:36:22 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:22:29.114 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.114 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:29.114 Asynchronous Event Request test 00:22:29.114 Attaching to 10.0.0.2 00:22:29.114 Attached to 10.0.0.2 00:22:29.114 Registering asynchronous event callbacks... 00:22:29.114 Starting namespace attribute notice tests for all controllers... 00:22:29.114 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:22:29.115 aer_cb - Changed Namespace 00:22:29.115 Cleaning up... 00:22:29.115 [ 00:22:29.115 { 00:22:29.115 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:29.115 "subtype": "Discovery", 00:22:29.115 "listen_addresses": [], 00:22:29.115 "allow_any_host": true, 00:22:29.115 "hosts": [] 00:22:29.115 }, 00:22:29.115 { 00:22:29.115 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:29.115 "subtype": "NVMe", 00:22:29.115 "listen_addresses": [ 00:22:29.115 { 00:22:29.115 "transport": "TCP", 00:22:29.115 "trtype": "TCP", 00:22:29.115 "adrfam": "IPv4", 00:22:29.115 "traddr": "10.0.0.2", 00:22:29.115 "trsvcid": "4420" 00:22:29.115 } 00:22:29.115 ], 00:22:29.115 "allow_any_host": true, 00:22:29.115 "hosts": [], 00:22:29.115 "serial_number": "SPDK00000000000001", 00:22:29.115 "model_number": "SPDK bdev Controller", 00:22:29.115 "max_namespaces": 2, 00:22:29.115 "min_cntlid": 1, 00:22:29.115 "max_cntlid": 65519, 00:22:29.115 "namespaces": [ 00:22:29.115 { 00:22:29.115 "nsid": 1, 00:22:29.115 "bdev_name": "Malloc0", 00:22:29.115 "name": "Malloc0", 00:22:29.115 "nguid": "F1549A5E81DE429A8BFC59B04F9C0309", 00:22:29.115 "uuid": "f1549a5e-81de-429a-8bfc-59b04f9c0309" 00:22:29.115 }, 00:22:29.115 { 00:22:29.115 "nsid": 2, 00:22:29.115 "bdev_name": "Malloc1", 00:22:29.115 "name": "Malloc1", 00:22:29.115 "nguid": "FB3C342E4BC243D09F724AFA7E8890AC", 00:22:29.115 "uuid": "fb3c342e-4bc2-43d0-9f72-4afa7e8890ac" 00:22:29.115 } 00:22:29.115 ] 00:22:29.115 } 00:22:29.115 ] 00:22:29.115 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.115 12:36:22 -- host/aer.sh@43 -- # wait 1339775 00:22:29.115 12:36:22 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:22:29.115 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.115 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:29.115 12:36:22 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.115 12:36:22 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:22:29.115 12:36:22 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.115 12:36:22 -- common/autotest_common.sh@10 -- # set +x 00:22:29.115 12:36:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.115 12:36:23 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:29.115 12:36:23 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:29.115 12:36:23 -- common/autotest_common.sh@10 -- # set +x 00:22:29.115 12:36:23 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:29.115 12:36:23 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:22:29.115 12:36:23 -- host/aer.sh@51 -- # nvmftestfini 00:22:29.115 12:36:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:29.115 12:36:23 -- nvmf/common.sh@116 -- # sync 00:22:29.115 12:36:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:29.115 12:36:23 -- nvmf/common.sh@119 -- # set +e 00:22:29.115 12:36:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:29.115 12:36:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:29.115 rmmod nvme_tcp 00:22:29.371 rmmod nvme_fabrics 00:22:29.371 rmmod nvme_keyring 00:22:29.371 12:36:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:29.371 12:36:23 -- nvmf/common.sh@123 -- # set -e 00:22:29.371 12:36:23 -- nvmf/common.sh@124 -- # return 0 00:22:29.371 12:36:23 -- nvmf/common.sh@477 -- # '[' -n 1339616 ']' 00:22:29.371 12:36:23 -- nvmf/common.sh@478 -- # killprocess 1339616 00:22:29.371 12:36:23 -- common/autotest_common.sh@926 -- # '[' -z 1339616 ']' 00:22:29.371 12:36:23 -- common/autotest_common.sh@930 -- # kill -0 1339616 00:22:29.371 12:36:23 -- common/autotest_common.sh@931 -- # uname 00:22:29.371 12:36:23 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:29.371 12:36:23 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1339616 00:22:29.371 12:36:23 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:29.371 12:36:23 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:29.371 12:36:23 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1339616' 00:22:29.371 killing process with pid 1339616 00:22:29.371 12:36:23 -- common/autotest_common.sh@945 -- # kill 1339616 00:22:29.371 [2024-07-12 12:36:23.100177] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:29.371 12:36:23 -- common/autotest_common.sh@950 -- # wait 1339616 00:22:29.630 12:36:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:29.630 12:36:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:29.630 12:36:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:29.630 12:36:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:29.630 12:36:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:29.630 12:36:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.630 12:36:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.630 12:36:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:31.532 12:36:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:31.532 00:22:31.532 real 0m5.833s 00:22:31.532 user 0m6.705s 00:22:31.532 sys 0m1.808s 00:22:31.532 12:36:25 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:31.532 12:36:25 -- common/autotest_common.sh@10 -- # set +x 00:22:31.532 ************************************ 00:22:31.532 END TEST nvmf_aer 00:22:31.532 ************************************ 00:22:31.532 12:36:25 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:31.532 12:36:25 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:31.532 12:36:25 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:31.532 12:36:25 -- common/autotest_common.sh@10 -- # set +x 00:22:31.532 ************************************ 00:22:31.532 START TEST nvmf_async_init 00:22:31.532 ************************************ 00:22:31.532 12:36:25 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:22:31.790 * Looking for test storage... 00:22:31.790 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:31.790 12:36:25 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:31.790 12:36:25 -- nvmf/common.sh@7 -- # uname -s 00:22:31.790 12:36:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:31.790 12:36:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:31.790 12:36:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:31.790 12:36:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:31.790 12:36:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:31.790 12:36:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:31.790 12:36:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:31.790 12:36:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:31.790 12:36:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:31.790 12:36:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:31.790 12:36:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:31.790 12:36:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:31.790 12:36:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:31.790 12:36:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:31.790 12:36:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:31.790 12:36:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:31.790 12:36:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:31.790 12:36:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:31.790 12:36:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:31.790 12:36:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.790 12:36:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.790 12:36:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.790 12:36:25 -- paths/export.sh@5 -- # export PATH 00:22:31.790 12:36:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:31.790 12:36:25 -- nvmf/common.sh@46 -- # : 0 00:22:31.790 12:36:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:31.790 12:36:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:31.790 12:36:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:31.790 12:36:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:31.790 12:36:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:31.790 12:36:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:31.790 12:36:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:31.790 12:36:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:31.790 12:36:25 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:22:31.790 12:36:25 -- host/async_init.sh@14 -- # null_block_size=512 00:22:31.790 12:36:25 -- host/async_init.sh@15 -- # null_bdev=null0 00:22:31.790 12:36:25 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:22:31.790 12:36:25 -- host/async_init.sh@20 -- # uuidgen 00:22:31.790 12:36:25 -- host/async_init.sh@20 -- # tr -d - 00:22:31.790 12:36:25 -- host/async_init.sh@20 -- # nguid=2e6bb2d5be42446ea1b133a91d1d268e 00:22:31.790 12:36:25 -- host/async_init.sh@22 -- # nvmftestinit 00:22:31.790 12:36:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:31.790 12:36:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:31.790 12:36:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:31.790 12:36:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:31.790 12:36:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:31.790 12:36:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:31.790 12:36:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:31.790 12:36:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:31.790 12:36:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:31.790 12:36:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:31.790 12:36:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:31.790 12:36:25 -- common/autotest_common.sh@10 -- # set +x 00:22:33.693 12:36:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:33.693 12:36:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:33.693 12:36:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:33.693 12:36:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:33.693 12:36:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:33.693 12:36:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:33.693 12:36:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:33.693 12:36:27 -- nvmf/common.sh@294 -- # net_devs=() 00:22:33.693 12:36:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:33.693 12:36:27 -- nvmf/common.sh@295 -- # e810=() 00:22:33.693 12:36:27 -- nvmf/common.sh@295 -- # local -ga e810 00:22:33.693 12:36:27 -- nvmf/common.sh@296 -- # x722=() 00:22:33.693 12:36:27 -- nvmf/common.sh@296 -- # local -ga x722 00:22:33.693 12:36:27 -- nvmf/common.sh@297 -- # mlx=() 00:22:33.693 12:36:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:33.693 12:36:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:33.693 12:36:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:33.693 12:36:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:33.693 12:36:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:33.693 12:36:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:33.693 12:36:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:33.693 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:33.693 12:36:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:33.693 12:36:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:33.693 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:33.693 12:36:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:33.693 12:36:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:33.693 12:36:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:33.693 12:36:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:33.693 12:36:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:33.693 12:36:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:33.693 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:33.693 12:36:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:33.693 12:36:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:33.693 12:36:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:33.693 12:36:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:33.693 12:36:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:33.693 12:36:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:33.693 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:33.693 12:36:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:33.693 12:36:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:33.693 12:36:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:33.693 12:36:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:33.693 12:36:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:33.693 12:36:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:33.693 12:36:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:33.693 12:36:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:33.693 12:36:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:33.693 12:36:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:33.693 12:36:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:33.693 12:36:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:33.693 12:36:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:33.693 12:36:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:33.693 12:36:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:33.693 12:36:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:33.693 12:36:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:33.693 12:36:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:33.693 12:36:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:33.693 12:36:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:33.693 12:36:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:33.693 12:36:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:33.951 12:36:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:33.951 12:36:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:33.951 12:36:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:33.951 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:33.951 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.185 ms 00:22:33.951 00:22:33.951 --- 10.0.0.2 ping statistics --- 00:22:33.951 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.951 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:22:33.951 12:36:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:33.951 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:33.951 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:22:33.951 00:22:33.951 --- 10.0.0.1 ping statistics --- 00:22:33.951 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:33.951 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:22:33.951 12:36:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:33.951 12:36:27 -- nvmf/common.sh@410 -- # return 0 00:22:33.951 12:36:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:33.951 12:36:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:33.951 12:36:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:33.951 12:36:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:33.952 12:36:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:33.952 12:36:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:33.952 12:36:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:33.952 12:36:27 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:22:33.952 12:36:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:33.952 12:36:27 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:33.952 12:36:27 -- common/autotest_common.sh@10 -- # set +x 00:22:33.952 12:36:27 -- nvmf/common.sh@469 -- # nvmfpid=1341724 00:22:33.952 12:36:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:22:33.952 12:36:27 -- nvmf/common.sh@470 -- # waitforlisten 1341724 00:22:33.952 12:36:27 -- common/autotest_common.sh@819 -- # '[' -z 1341724 ']' 00:22:33.952 12:36:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:33.952 12:36:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:33.952 12:36:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:33.952 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:33.952 12:36:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:33.952 12:36:27 -- common/autotest_common.sh@10 -- # set +x 00:22:33.952 [2024-07-12 12:36:27.695265] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:33.952 [2024-07-12 12:36:27.695340] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:33.952 EAL: No free 2048 kB hugepages reported on node 1 00:22:33.952 [2024-07-12 12:36:27.757943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:34.211 [2024-07-12 12:36:27.873476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:34.211 [2024-07-12 12:36:27.873655] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:34.211 [2024-07-12 12:36:27.873678] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:34.211 [2024-07-12 12:36:27.873698] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:34.211 [2024-07-12 12:36:27.873751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:34.781 12:36:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:34.781 12:36:28 -- common/autotest_common.sh@852 -- # return 0 00:22:34.781 12:36:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:34.781 12:36:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:34.781 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 12:36:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:35.041 12:36:28 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 [2024-07-12 12:36:28.713540] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:35.041 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.041 12:36:28 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 null0 00:22:35.041 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.041 12:36:28 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.041 12:36:28 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.041 12:36:28 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 2e6bb2d5be42446ea1b133a91d1d268e 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.041 12:36:28 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.041 [2024-07-12 12:36:28.753749] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:35.041 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.041 12:36:28 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:22:35.041 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.041 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.302 nvme0n1 00:22:35.302 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.302 12:36:28 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:35.302 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.302 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.302 [ 00:22:35.302 { 00:22:35.302 "name": "nvme0n1", 00:22:35.302 "aliases": [ 00:22:35.302 "2e6bb2d5-be42-446e-a1b1-33a91d1d268e" 00:22:35.302 ], 00:22:35.302 "product_name": "NVMe disk", 00:22:35.302 "block_size": 512, 00:22:35.302 "num_blocks": 2097152, 00:22:35.302 "uuid": "2e6bb2d5-be42-446e-a1b1-33a91d1d268e", 00:22:35.302 "assigned_rate_limits": { 00:22:35.302 "rw_ios_per_sec": 0, 00:22:35.302 "rw_mbytes_per_sec": 0, 00:22:35.302 "r_mbytes_per_sec": 0, 00:22:35.302 "w_mbytes_per_sec": 0 00:22:35.302 }, 00:22:35.302 "claimed": false, 00:22:35.302 "zoned": false, 00:22:35.302 "supported_io_types": { 00:22:35.302 "read": true, 00:22:35.302 "write": true, 00:22:35.302 "unmap": false, 00:22:35.302 "write_zeroes": true, 00:22:35.302 "flush": true, 00:22:35.302 "reset": true, 00:22:35.302 "compare": true, 00:22:35.302 "compare_and_write": true, 00:22:35.302 "abort": true, 00:22:35.302 "nvme_admin": true, 00:22:35.302 "nvme_io": true 00:22:35.302 }, 00:22:35.302 "driver_specific": { 00:22:35.302 "nvme": [ 00:22:35.302 { 00:22:35.302 "trid": { 00:22:35.302 "trtype": "TCP", 00:22:35.302 "adrfam": "IPv4", 00:22:35.302 "traddr": "10.0.0.2", 00:22:35.302 "trsvcid": "4420", 00:22:35.302 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:35.302 }, 00:22:35.302 "ctrlr_data": { 00:22:35.302 "cntlid": 1, 00:22:35.302 "vendor_id": "0x8086", 00:22:35.302 "model_number": "SPDK bdev Controller", 00:22:35.302 "serial_number": "00000000000000000000", 00:22:35.302 "firmware_revision": "24.01.1", 00:22:35.302 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:35.302 "oacs": { 00:22:35.302 "security": 0, 00:22:35.302 "format": 0, 00:22:35.302 "firmware": 0, 00:22:35.302 "ns_manage": 0 00:22:35.302 }, 00:22:35.302 "multi_ctrlr": true, 00:22:35.302 "ana_reporting": false 00:22:35.302 }, 00:22:35.302 "vs": { 00:22:35.302 "nvme_version": "1.3" 00:22:35.302 }, 00:22:35.302 "ns_data": { 00:22:35.302 "id": 1, 00:22:35.302 "can_share": true 00:22:35.302 } 00:22:35.302 } 00:22:35.302 ], 00:22:35.302 "mp_policy": "active_passive" 00:22:35.302 } 00:22:35.302 } 00:22:35.302 ] 00:22:35.302 12:36:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.302 12:36:28 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:22:35.302 12:36:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.302 12:36:28 -- common/autotest_common.sh@10 -- # set +x 00:22:35.302 [2024-07-12 12:36:29.002441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:22:35.302 [2024-07-12 12:36:29.002531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd0fa80 (9): Bad file descriptor 00:22:35.302 [2024-07-12 12:36:29.135027] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:35.302 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.302 12:36:29 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:35.302 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.302 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.302 [ 00:22:35.302 { 00:22:35.302 "name": "nvme0n1", 00:22:35.302 "aliases": [ 00:22:35.302 "2e6bb2d5-be42-446e-a1b1-33a91d1d268e" 00:22:35.302 ], 00:22:35.302 "product_name": "NVMe disk", 00:22:35.302 "block_size": 512, 00:22:35.302 "num_blocks": 2097152, 00:22:35.302 "uuid": "2e6bb2d5-be42-446e-a1b1-33a91d1d268e", 00:22:35.302 "assigned_rate_limits": { 00:22:35.302 "rw_ios_per_sec": 0, 00:22:35.302 "rw_mbytes_per_sec": 0, 00:22:35.302 "r_mbytes_per_sec": 0, 00:22:35.302 "w_mbytes_per_sec": 0 00:22:35.302 }, 00:22:35.302 "claimed": false, 00:22:35.302 "zoned": false, 00:22:35.302 "supported_io_types": { 00:22:35.302 "read": true, 00:22:35.302 "write": true, 00:22:35.302 "unmap": false, 00:22:35.302 "write_zeroes": true, 00:22:35.302 "flush": true, 00:22:35.302 "reset": true, 00:22:35.302 "compare": true, 00:22:35.302 "compare_and_write": true, 00:22:35.302 "abort": true, 00:22:35.302 "nvme_admin": true, 00:22:35.302 "nvme_io": true 00:22:35.302 }, 00:22:35.302 "driver_specific": { 00:22:35.303 "nvme": [ 00:22:35.303 { 00:22:35.303 "trid": { 00:22:35.303 "trtype": "TCP", 00:22:35.303 "adrfam": "IPv4", 00:22:35.303 "traddr": "10.0.0.2", 00:22:35.303 "trsvcid": "4420", 00:22:35.303 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:35.303 }, 00:22:35.303 "ctrlr_data": { 00:22:35.303 "cntlid": 2, 00:22:35.303 "vendor_id": "0x8086", 00:22:35.303 "model_number": "SPDK bdev Controller", 00:22:35.303 "serial_number": "00000000000000000000", 00:22:35.303 "firmware_revision": "24.01.1", 00:22:35.303 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:35.303 "oacs": { 00:22:35.303 "security": 0, 00:22:35.303 "format": 0, 00:22:35.303 "firmware": 0, 00:22:35.303 "ns_manage": 0 00:22:35.303 }, 00:22:35.303 "multi_ctrlr": true, 00:22:35.303 "ana_reporting": false 00:22:35.303 }, 00:22:35.303 "vs": { 00:22:35.303 "nvme_version": "1.3" 00:22:35.303 }, 00:22:35.303 "ns_data": { 00:22:35.303 "id": 1, 00:22:35.303 "can_share": true 00:22:35.303 } 00:22:35.303 } 00:22:35.303 ], 00:22:35.303 "mp_policy": "active_passive" 00:22:35.303 } 00:22:35.303 } 00:22:35.303 ] 00:22:35.303 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.303 12:36:29 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:35.303 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.303 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.303 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.303 12:36:29 -- host/async_init.sh@53 -- # mktemp 00:22:35.303 12:36:29 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.7ZwVZpnKDM 00:22:35.303 12:36:29 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:22:35.303 12:36:29 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.7ZwVZpnKDM 00:22:35.303 12:36:29 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:22:35.303 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.303 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.303 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.303 12:36:29 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:22:35.303 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.303 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.303 [2024-07-12 12:36:29.183035] tcp.c: 912:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:22:35.303 [2024-07-12 12:36:29.183173] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:35.303 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.303 12:36:29 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.7ZwVZpnKDM 00:22:35.303 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.303 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.303 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.303 12:36:29 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.7ZwVZpnKDM 00:22:35.303 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.303 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.303 [2024-07-12 12:36:29.199073] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:22:35.561 nvme0n1 00:22:35.561 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.561 12:36:29 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:22:35.561 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.561 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.561 [ 00:22:35.561 { 00:22:35.561 "name": "nvme0n1", 00:22:35.561 "aliases": [ 00:22:35.561 "2e6bb2d5-be42-446e-a1b1-33a91d1d268e" 00:22:35.561 ], 00:22:35.561 "product_name": "NVMe disk", 00:22:35.561 "block_size": 512, 00:22:35.561 "num_blocks": 2097152, 00:22:35.561 "uuid": "2e6bb2d5-be42-446e-a1b1-33a91d1d268e", 00:22:35.561 "assigned_rate_limits": { 00:22:35.561 "rw_ios_per_sec": 0, 00:22:35.561 "rw_mbytes_per_sec": 0, 00:22:35.561 "r_mbytes_per_sec": 0, 00:22:35.561 "w_mbytes_per_sec": 0 00:22:35.561 }, 00:22:35.561 "claimed": false, 00:22:35.561 "zoned": false, 00:22:35.561 "supported_io_types": { 00:22:35.561 "read": true, 00:22:35.561 "write": true, 00:22:35.561 "unmap": false, 00:22:35.561 "write_zeroes": true, 00:22:35.561 "flush": true, 00:22:35.561 "reset": true, 00:22:35.561 "compare": true, 00:22:35.561 "compare_and_write": true, 00:22:35.561 "abort": true, 00:22:35.561 "nvme_admin": true, 00:22:35.561 "nvme_io": true 00:22:35.561 }, 00:22:35.561 "driver_specific": { 00:22:35.561 "nvme": [ 00:22:35.561 { 00:22:35.561 "trid": { 00:22:35.561 "trtype": "TCP", 00:22:35.561 "adrfam": "IPv4", 00:22:35.561 "traddr": "10.0.0.2", 00:22:35.561 "trsvcid": "4421", 00:22:35.561 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:22:35.561 }, 00:22:35.561 "ctrlr_data": { 00:22:35.561 "cntlid": 3, 00:22:35.561 "vendor_id": "0x8086", 00:22:35.561 "model_number": "SPDK bdev Controller", 00:22:35.561 "serial_number": "00000000000000000000", 00:22:35.561 "firmware_revision": "24.01.1", 00:22:35.561 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:22:35.561 "oacs": { 00:22:35.561 "security": 0, 00:22:35.561 "format": 0, 00:22:35.561 "firmware": 0, 00:22:35.561 "ns_manage": 0 00:22:35.561 }, 00:22:35.561 "multi_ctrlr": true, 00:22:35.561 "ana_reporting": false 00:22:35.561 }, 00:22:35.561 "vs": { 00:22:35.561 "nvme_version": "1.3" 00:22:35.561 }, 00:22:35.561 "ns_data": { 00:22:35.561 "id": 1, 00:22:35.561 "can_share": true 00:22:35.561 } 00:22:35.561 } 00:22:35.561 ], 00:22:35.561 "mp_policy": "active_passive" 00:22:35.561 } 00:22:35.561 } 00:22:35.561 ] 00:22:35.562 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.562 12:36:29 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:35.562 12:36:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:35.562 12:36:29 -- common/autotest_common.sh@10 -- # set +x 00:22:35.562 12:36:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:35.562 12:36:29 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.7ZwVZpnKDM 00:22:35.562 12:36:29 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:22:35.562 12:36:29 -- host/async_init.sh@78 -- # nvmftestfini 00:22:35.562 12:36:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:35.562 12:36:29 -- nvmf/common.sh@116 -- # sync 00:22:35.562 12:36:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:35.562 12:36:29 -- nvmf/common.sh@119 -- # set +e 00:22:35.562 12:36:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:35.562 12:36:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:35.562 rmmod nvme_tcp 00:22:35.562 rmmod nvme_fabrics 00:22:35.562 rmmod nvme_keyring 00:22:35.562 12:36:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:35.562 12:36:29 -- nvmf/common.sh@123 -- # set -e 00:22:35.562 12:36:29 -- nvmf/common.sh@124 -- # return 0 00:22:35.562 12:36:29 -- nvmf/common.sh@477 -- # '[' -n 1341724 ']' 00:22:35.562 12:36:29 -- nvmf/common.sh@478 -- # killprocess 1341724 00:22:35.562 12:36:29 -- common/autotest_common.sh@926 -- # '[' -z 1341724 ']' 00:22:35.562 12:36:29 -- common/autotest_common.sh@930 -- # kill -0 1341724 00:22:35.562 12:36:29 -- common/autotest_common.sh@931 -- # uname 00:22:35.562 12:36:29 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:35.562 12:36:29 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1341724 00:22:35.562 12:36:29 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:35.562 12:36:29 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:35.562 12:36:29 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1341724' 00:22:35.562 killing process with pid 1341724 00:22:35.562 12:36:29 -- common/autotest_common.sh@945 -- # kill 1341724 00:22:35.562 12:36:29 -- common/autotest_common.sh@950 -- # wait 1341724 00:22:35.848 12:36:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:35.848 12:36:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:35.849 12:36:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:35.849 12:36:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:35.849 12:36:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:35.849 12:36:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:35.849 12:36:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:35.849 12:36:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:37.755 12:36:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:37.755 00:22:37.756 real 0m6.232s 00:22:37.756 user 0m3.029s 00:22:37.756 sys 0m1.848s 00:22:37.756 12:36:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:37.756 12:36:31 -- common/autotest_common.sh@10 -- # set +x 00:22:37.756 ************************************ 00:22:37.756 END TEST nvmf_async_init 00:22:37.756 ************************************ 00:22:38.017 12:36:31 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:38.017 12:36:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:38.017 12:36:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:38.017 12:36:31 -- common/autotest_common.sh@10 -- # set +x 00:22:38.017 ************************************ 00:22:38.017 START TEST dma 00:22:38.017 ************************************ 00:22:38.017 12:36:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:22:38.017 * Looking for test storage... 00:22:38.017 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:38.017 12:36:31 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:38.017 12:36:31 -- nvmf/common.sh@7 -- # uname -s 00:22:38.017 12:36:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:38.017 12:36:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:38.017 12:36:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:38.017 12:36:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:38.018 12:36:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:38.018 12:36:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:38.018 12:36:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:38.018 12:36:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:38.018 12:36:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:38.018 12:36:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:38.018 12:36:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:38.018 12:36:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:38.018 12:36:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:38.018 12:36:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:38.018 12:36:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:38.018 12:36:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:38.018 12:36:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:38.018 12:36:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:38.018 12:36:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:38.018 12:36:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.018 12:36:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.018 12:36:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.018 12:36:31 -- paths/export.sh@5 -- # export PATH 00:22:38.018 12:36:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.018 12:36:31 -- nvmf/common.sh@46 -- # : 0 00:22:38.018 12:36:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:38.018 12:36:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:38.018 12:36:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:38.018 12:36:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:38.018 12:36:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:38.018 12:36:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:38.018 12:36:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:38.018 12:36:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:38.018 12:36:31 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:22:38.018 12:36:31 -- host/dma.sh@13 -- # exit 0 00:22:38.018 00:22:38.018 real 0m0.062s 00:22:38.018 user 0m0.036s 00:22:38.018 sys 0m0.031s 00:22:38.018 12:36:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:38.018 12:36:31 -- common/autotest_common.sh@10 -- # set +x 00:22:38.018 ************************************ 00:22:38.018 END TEST dma 00:22:38.018 ************************************ 00:22:38.018 12:36:31 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:38.018 12:36:31 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:38.018 12:36:31 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:38.018 12:36:31 -- common/autotest_common.sh@10 -- # set +x 00:22:38.018 ************************************ 00:22:38.018 START TEST nvmf_identify 00:22:38.018 ************************************ 00:22:38.018 12:36:31 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:22:38.018 * Looking for test storage... 00:22:38.018 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:38.018 12:36:31 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:38.018 12:36:31 -- nvmf/common.sh@7 -- # uname -s 00:22:38.018 12:36:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:38.018 12:36:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:38.018 12:36:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:38.018 12:36:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:38.018 12:36:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:38.018 12:36:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:38.018 12:36:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:38.018 12:36:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:38.019 12:36:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:38.019 12:36:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:38.019 12:36:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:38.019 12:36:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:38.019 12:36:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:38.019 12:36:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:38.019 12:36:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:38.019 12:36:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:38.019 12:36:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:38.019 12:36:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:38.019 12:36:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:38.019 12:36:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.019 12:36:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.019 12:36:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.019 12:36:31 -- paths/export.sh@5 -- # export PATH 00:22:38.019 12:36:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:38.019 12:36:31 -- nvmf/common.sh@46 -- # : 0 00:22:38.019 12:36:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:38.019 12:36:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:38.019 12:36:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:38.019 12:36:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:38.019 12:36:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:38.019 12:36:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:38.019 12:36:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:38.019 12:36:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:38.019 12:36:31 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:38.019 12:36:31 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:38.019 12:36:31 -- host/identify.sh@14 -- # nvmftestinit 00:22:38.019 12:36:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:38.019 12:36:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:38.019 12:36:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:38.019 12:36:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:38.019 12:36:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:38.019 12:36:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:38.019 12:36:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:38.019 12:36:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:38.019 12:36:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:38.019 12:36:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:38.019 12:36:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:38.019 12:36:31 -- common/autotest_common.sh@10 -- # set +x 00:22:39.926 12:36:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:39.926 12:36:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:39.926 12:36:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:39.926 12:36:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:39.926 12:36:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:39.926 12:36:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:39.926 12:36:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:39.926 12:36:33 -- nvmf/common.sh@294 -- # net_devs=() 00:22:39.926 12:36:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:39.926 12:36:33 -- nvmf/common.sh@295 -- # e810=() 00:22:39.926 12:36:33 -- nvmf/common.sh@295 -- # local -ga e810 00:22:39.926 12:36:33 -- nvmf/common.sh@296 -- # x722=() 00:22:39.926 12:36:33 -- nvmf/common.sh@296 -- # local -ga x722 00:22:39.926 12:36:33 -- nvmf/common.sh@297 -- # mlx=() 00:22:39.926 12:36:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:39.926 12:36:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:39.926 12:36:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:39.926 12:36:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:39.926 12:36:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:39.926 12:36:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:39.926 12:36:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:39.926 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:39.926 12:36:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:39.926 12:36:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:39.926 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:39.926 12:36:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:39.926 12:36:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:39.926 12:36:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:39.926 12:36:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:39.926 12:36:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:39.926 12:36:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:39.926 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:39.926 12:36:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:39.926 12:36:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:39.926 12:36:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:39.926 12:36:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:39.926 12:36:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:39.926 12:36:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:39.926 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:39.926 12:36:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:39.926 12:36:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:39.926 12:36:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:39.926 12:36:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:39.926 12:36:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:39.926 12:36:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:39.926 12:36:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:39.926 12:36:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:39.926 12:36:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:39.926 12:36:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:39.926 12:36:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:39.926 12:36:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:39.926 12:36:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:39.926 12:36:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:39.926 12:36:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:39.926 12:36:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:39.926 12:36:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:39.926 12:36:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:39.926 12:36:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:39.926 12:36:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:39.926 12:36:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:39.926 12:36:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:39.926 12:36:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:39.926 12:36:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:39.926 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:39.926 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.264 ms 00:22:39.926 00:22:39.926 --- 10.0.0.2 ping statistics --- 00:22:39.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:39.926 rtt min/avg/max/mdev = 0.264/0.264/0.264/0.000 ms 00:22:39.926 12:36:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:39.926 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:39.926 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:22:39.926 00:22:39.926 --- 10.0.0.1 ping statistics --- 00:22:39.926 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:39.926 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:22:39.926 12:36:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:39.926 12:36:33 -- nvmf/common.sh@410 -- # return 0 00:22:39.926 12:36:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:39.926 12:36:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:39.926 12:36:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:39.926 12:36:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:39.926 12:36:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:39.926 12:36:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:39.926 12:36:33 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:22:39.926 12:36:33 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:39.926 12:36:33 -- common/autotest_common.sh@10 -- # set +x 00:22:39.926 12:36:33 -- host/identify.sh@19 -- # nvmfpid=1344010 00:22:39.926 12:36:33 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:39.926 12:36:33 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:39.926 12:36:33 -- host/identify.sh@23 -- # waitforlisten 1344010 00:22:39.926 12:36:33 -- common/autotest_common.sh@819 -- # '[' -z 1344010 ']' 00:22:39.926 12:36:33 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:39.926 12:36:33 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:39.926 12:36:33 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:39.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:39.926 12:36:33 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:39.926 12:36:33 -- common/autotest_common.sh@10 -- # set +x 00:22:39.926 [2024-07-12 12:36:33.835459] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:39.926 [2024-07-12 12:36:33.835547] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:40.186 EAL: No free 2048 kB hugepages reported on node 1 00:22:40.186 [2024-07-12 12:36:33.906000] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:40.186 [2024-07-12 12:36:34.026976] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:40.186 [2024-07-12 12:36:34.027131] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:40.186 [2024-07-12 12:36:34.027149] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:40.186 [2024-07-12 12:36:34.027161] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:40.186 [2024-07-12 12:36:34.027212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:40.186 [2024-07-12 12:36:34.027239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:40.186 [2024-07-12 12:36:34.027299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:40.186 [2024-07-12 12:36:34.027302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:41.126 12:36:34 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:41.126 12:36:34 -- common/autotest_common.sh@852 -- # return 0 00:22:41.126 12:36:34 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:41.126 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.126 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.126 [2024-07-12 12:36:34.824430] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:41.126 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.126 12:36:34 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:22:41.126 12:36:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:41.126 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.126 12:36:34 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:41.126 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.126 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.126 Malloc0 00:22:41.126 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.126 12:36:34 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:41.126 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.126 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.126 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.126 12:36:34 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:22:41.126 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.126 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.126 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.127 12:36:34 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:41.127 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.127 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.127 [2024-07-12 12:36:34.891346] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:41.127 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.127 12:36:34 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:41.127 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.127 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.127 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.127 12:36:34 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:22:41.127 12:36:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.127 12:36:34 -- common/autotest_common.sh@10 -- # set +x 00:22:41.127 [2024-07-12 12:36:34.907153] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:22:41.127 [ 00:22:41.127 { 00:22:41.127 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:22:41.127 "subtype": "Discovery", 00:22:41.127 "listen_addresses": [ 00:22:41.127 { 00:22:41.127 "transport": "TCP", 00:22:41.127 "trtype": "TCP", 00:22:41.127 "adrfam": "IPv4", 00:22:41.127 "traddr": "10.0.0.2", 00:22:41.127 "trsvcid": "4420" 00:22:41.127 } 00:22:41.127 ], 00:22:41.127 "allow_any_host": true, 00:22:41.127 "hosts": [] 00:22:41.127 }, 00:22:41.127 { 00:22:41.127 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:22:41.127 "subtype": "NVMe", 00:22:41.127 "listen_addresses": [ 00:22:41.127 { 00:22:41.127 "transport": "TCP", 00:22:41.127 "trtype": "TCP", 00:22:41.127 "adrfam": "IPv4", 00:22:41.127 "traddr": "10.0.0.2", 00:22:41.127 "trsvcid": "4420" 00:22:41.127 } 00:22:41.127 ], 00:22:41.127 "allow_any_host": true, 00:22:41.127 "hosts": [], 00:22:41.127 "serial_number": "SPDK00000000000001", 00:22:41.127 "model_number": "SPDK bdev Controller", 00:22:41.127 "max_namespaces": 32, 00:22:41.127 "min_cntlid": 1, 00:22:41.127 "max_cntlid": 65519, 00:22:41.127 "namespaces": [ 00:22:41.127 { 00:22:41.127 "nsid": 1, 00:22:41.127 "bdev_name": "Malloc0", 00:22:41.127 "name": "Malloc0", 00:22:41.127 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:22:41.127 "eui64": "ABCDEF0123456789", 00:22:41.127 "uuid": "aecb8ff3-c6b0-4ff1-bbd0-45677ab3b50b" 00:22:41.127 } 00:22:41.127 ] 00:22:41.127 } 00:22:41.127 ] 00:22:41.127 12:36:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.127 12:36:34 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:22:41.127 [2024-07-12 12:36:34.928513] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:41.127 [2024-07-12 12:36:34.928552] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344170 ] 00:22:41.127 EAL: No free 2048 kB hugepages reported on node 1 00:22:41.127 [2024-07-12 12:36:34.960061] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:22:41.127 [2024-07-12 12:36:34.960122] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:41.127 [2024-07-12 12:36:34.960133] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:41.127 [2024-07-12 12:36:34.960164] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:41.127 [2024-07-12 12:36:34.960177] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:41.127 [2024-07-12 12:36:34.964017] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:22:41.127 [2024-07-12 12:36:34.964078] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x14afe10 0 00:22:41.127 [2024-07-12 12:36:34.971881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:41.127 [2024-07-12 12:36:34.971903] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:41.127 [2024-07-12 12:36:34.971912] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:41.127 [2024-07-12 12:36:34.971918] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:41.127 [2024-07-12 12:36:34.971969] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.971983] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.971990] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.127 [2024-07-12 12:36:34.972007] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:41.127 [2024-07-12 12:36:34.972039] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.127 [2024-07-12 12:36:34.979886] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.127 [2024-07-12 12:36:34.979905] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.127 [2024-07-12 12:36:34.979913] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.979920] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.127 [2024-07-12 12:36:34.979941] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:41.127 [2024-07-12 12:36:34.979954] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:22:41.127 [2024-07-12 12:36:34.979964] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:22:41.127 [2024-07-12 12:36:34.979982] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.979994] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980001] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.127 [2024-07-12 12:36:34.980012] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.127 [2024-07-12 12:36:34.980036] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.127 [2024-07-12 12:36:34.980182] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.127 [2024-07-12 12:36:34.980198] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.127 [2024-07-12 12:36:34.980205] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980212] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.127 [2024-07-12 12:36:34.980225] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:22:41.127 [2024-07-12 12:36:34.980239] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:22:41.127 [2024-07-12 12:36:34.980252] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980259] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980268] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.127 [2024-07-12 12:36:34.980280] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.127 [2024-07-12 12:36:34.980302] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.127 [2024-07-12 12:36:34.980393] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.127 [2024-07-12 12:36:34.980408] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.127 [2024-07-12 12:36:34.980415] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980425] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.127 [2024-07-12 12:36:34.980436] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:22:41.127 [2024-07-12 12:36:34.980450] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:22:41.127 [2024-07-12 12:36:34.980463] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980472] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980480] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.127 [2024-07-12 12:36:34.980491] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.127 [2024-07-12 12:36:34.980517] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.127 [2024-07-12 12:36:34.980603] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.127 [2024-07-12 12:36:34.980619] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.127 [2024-07-12 12:36:34.980626] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980632] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.127 [2024-07-12 12:36:34.980643] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:41.127 [2024-07-12 12:36:34.980661] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980671] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980678] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.127 [2024-07-12 12:36:34.980688] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.127 [2024-07-12 12:36:34.980710] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.127 [2024-07-12 12:36:34.980796] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.127 [2024-07-12 12:36:34.980811] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.127 [2024-07-12 12:36:34.980818] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.980824] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.127 [2024-07-12 12:36:34.980838] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:22:41.127 [2024-07-12 12:36:34.980850] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:22:41.127 [2024-07-12 12:36:34.980864] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:41.127 [2024-07-12 12:36:34.980987] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:22:41.127 [2024-07-12 12:36:34.980997] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:41.127 [2024-07-12 12:36:34.981011] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.981019] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.127 [2024-07-12 12:36:34.981026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.127 [2024-07-12 12:36:34.981036] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.128 [2024-07-12 12:36:34.981058] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.128 [2024-07-12 12:36:34.981172] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.128 [2024-07-12 12:36:34.981187] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.128 [2024-07-12 12:36:34.981194] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981201] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.128 [2024-07-12 12:36:34.981213] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:41.128 [2024-07-12 12:36:34.981232] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981241] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981247] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:34.981264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.128 [2024-07-12 12:36:34.981288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.128 [2024-07-12 12:36:34.981374] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.128 [2024-07-12 12:36:34.981389] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.128 [2024-07-12 12:36:34.981396] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981403] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.128 [2024-07-12 12:36:34.981412] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:41.128 [2024-07-12 12:36:34.981420] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:22:41.128 [2024-07-12 12:36:34.981435] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:22:41.128 [2024-07-12 12:36:34.981452] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:22:41.128 [2024-07-12 12:36:34.981467] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981475] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981482] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:34.981493] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.128 [2024-07-12 12:36:34.981515] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.128 [2024-07-12 12:36:34.981642] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.128 [2024-07-12 12:36:34.981657] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.128 [2024-07-12 12:36:34.981667] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981675] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14afe10): datao=0, datal=4096, cccid=0 00:22:41.128 [2024-07-12 12:36:34.981683] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x152fbf0) on tqpair(0x14afe10): expected_datao=0, payload_size=4096 00:22:41.128 [2024-07-12 12:36:34.981696] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:34.981704] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022003] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.128 [2024-07-12 12:36:35.022023] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.128 [2024-07-12 12:36:35.022034] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022043] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.128 [2024-07-12 12:36:35.022057] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:22:41.128 [2024-07-12 12:36:35.022066] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:22:41.128 [2024-07-12 12:36:35.022074] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:22:41.128 [2024-07-12 12:36:35.022082] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:22:41.128 [2024-07-12 12:36:35.022090] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:22:41.128 [2024-07-12 12:36:35.022098] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:22:41.128 [2024-07-12 12:36:35.022125] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:22:41.128 [2024-07-12 12:36:35.022141] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022149] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022155] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022167] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:41.128 [2024-07-12 12:36:35.022190] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.128 [2024-07-12 12:36:35.022283] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.128 [2024-07-12 12:36:35.022298] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.128 [2024-07-12 12:36:35.022305] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022312] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x152fbf0) on tqpair=0x14afe10 00:22:41.128 [2024-07-12 12:36:35.022326] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022333] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022340] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.128 [2024-07-12 12:36:35.022360] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022366] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022373] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.128 [2024-07-12 12:36:35.022391] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022398] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022404] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022413] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.128 [2024-07-12 12:36:35.022422] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022429] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022435] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022444] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.128 [2024-07-12 12:36:35.022452] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:22:41.128 [2024-07-12 12:36:35.022487] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:41.128 [2024-07-12 12:36:35.022501] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022513] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022523] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.128 [2024-07-12 12:36:35.022545] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fbf0, cid 0, qid 0 00:22:41.128 [2024-07-12 12:36:35.022575] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152fd50, cid 1, qid 0 00:22:41.128 [2024-07-12 12:36:35.022584] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x152feb0, cid 2, qid 0 00:22:41.128 [2024-07-12 12:36:35.022591] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.128 [2024-07-12 12:36:35.022599] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530170, cid 4, qid 0 00:22:41.128 [2024-07-12 12:36:35.022799] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.128 [2024-07-12 12:36:35.022814] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.128 [2024-07-12 12:36:35.022821] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022828] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530170) on tqpair=0x14afe10 00:22:41.128 [2024-07-12 12:36:35.022841] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:22:41.128 [2024-07-12 12:36:35.022851] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:22:41.128 [2024-07-12 12:36:35.022878] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022892] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.022899] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.022910] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.128 [2024-07-12 12:36:35.022947] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530170, cid 4, qid 0 00:22:41.128 [2024-07-12 12:36:35.023124] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.128 [2024-07-12 12:36:35.023146] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.128 [2024-07-12 12:36:35.023156] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023163] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14afe10): datao=0, datal=4096, cccid=4 00:22:41.128 [2024-07-12 12:36:35.023171] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1530170) on tqpair(0x14afe10): expected_datao=0, payload_size=4096 00:22:41.128 [2024-07-12 12:36:35.023195] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023207] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023220] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.128 [2024-07-12 12:36:35.023230] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.128 [2024-07-12 12:36:35.023237] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023243] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530170) on tqpair=0x14afe10 00:22:41.128 [2024-07-12 12:36:35.023264] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:22:41.128 [2024-07-12 12:36:35.023303] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023314] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023321] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14afe10) 00:22:41.128 [2024-07-12 12:36:35.023331] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.128 [2024-07-12 12:36:35.023343] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.128 [2024-07-12 12:36:35.023350] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.129 [2024-07-12 12:36:35.023356] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x14afe10) 00:22:41.129 [2024-07-12 12:36:35.023365] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.129 [2024-07-12 12:36:35.023396] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530170, cid 4, qid 0 00:22:41.129 [2024-07-12 12:36:35.023407] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x15302d0, cid 5, qid 0 00:22:41.129 [2024-07-12 12:36:35.023546] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.129 [2024-07-12 12:36:35.023562] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.129 [2024-07-12 12:36:35.023569] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.129 [2024-07-12 12:36:35.023575] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14afe10): datao=0, datal=1024, cccid=4 00:22:41.129 [2024-07-12 12:36:35.023583] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1530170) on tqpair(0x14afe10): expected_datao=0, payload_size=1024 00:22:41.129 [2024-07-12 12:36:35.023594] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.129 [2024-07-12 12:36:35.023601] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.129 [2024-07-12 12:36:35.023610] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.129 [2024-07-12 12:36:35.023619] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.129 [2024-07-12 12:36:35.023625] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.129 [2024-07-12 12:36:35.023632] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x15302d0) on tqpair=0x14afe10 00:22:41.392 [2024-07-12 12:36:35.064050] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.392 [2024-07-12 12:36:35.064071] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.392 [2024-07-12 12:36:35.064080] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.064087] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530170) on tqpair=0x14afe10 00:22:41.392 [2024-07-12 12:36:35.064107] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.064116] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.064123] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14afe10) 00:22:41.392 [2024-07-12 12:36:35.064135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.392 [2024-07-12 12:36:35.064167] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530170, cid 4, qid 0 00:22:41.392 [2024-07-12 12:36:35.064302] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.392 [2024-07-12 12:36:35.064322] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.392 [2024-07-12 12:36:35.064331] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.064338] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14afe10): datao=0, datal=3072, cccid=4 00:22:41.392 [2024-07-12 12:36:35.064346] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1530170) on tqpair(0x14afe10): expected_datao=0, payload_size=3072 00:22:41.392 [2024-07-12 12:36:35.064368] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.064378] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.108898] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.392 [2024-07-12 12:36:35.108918] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.392 [2024-07-12 12:36:35.108926] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.108933] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530170) on tqpair=0x14afe10 00:22:41.392 [2024-07-12 12:36:35.108966] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.108975] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.108982] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x14afe10) 00:22:41.392 [2024-07-12 12:36:35.108994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.392 [2024-07-12 12:36:35.109031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530170, cid 4, qid 0 00:22:41.392 [2024-07-12 12:36:35.109133] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.392 [2024-07-12 12:36:35.109149] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.392 [2024-07-12 12:36:35.109156] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.109162] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x14afe10): datao=0, datal=8, cccid=4 00:22:41.392 [2024-07-12 12:36:35.109171] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1530170) on tqpair(0x14afe10): expected_datao=0, payload_size=8 00:22:41.392 [2024-07-12 12:36:35.109185] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.109193] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.149981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.392 [2024-07-12 12:36:35.150003] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.392 [2024-07-12 12:36:35.150012] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.392 [2024-07-12 12:36:35.150021] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530170) on tqpair=0x14afe10 00:22:41.392 ===================================================== 00:22:41.392 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:22:41.392 ===================================================== 00:22:41.392 Controller Capabilities/Features 00:22:41.392 ================================ 00:22:41.392 Vendor ID: 0000 00:22:41.392 Subsystem Vendor ID: 0000 00:22:41.392 Serial Number: .................... 00:22:41.393 Model Number: ........................................ 00:22:41.393 Firmware Version: 24.01.1 00:22:41.393 Recommended Arb Burst: 0 00:22:41.393 IEEE OUI Identifier: 00 00 00 00:22:41.393 Multi-path I/O 00:22:41.393 May have multiple subsystem ports: No 00:22:41.393 May have multiple controllers: No 00:22:41.393 Associated with SR-IOV VF: No 00:22:41.393 Max Data Transfer Size: 131072 00:22:41.393 Max Number of Namespaces: 0 00:22:41.393 Max Number of I/O Queues: 1024 00:22:41.393 NVMe Specification Version (VS): 1.3 00:22:41.393 NVMe Specification Version (Identify): 1.3 00:22:41.393 Maximum Queue Entries: 128 00:22:41.393 Contiguous Queues Required: Yes 00:22:41.393 Arbitration Mechanisms Supported 00:22:41.393 Weighted Round Robin: Not Supported 00:22:41.393 Vendor Specific: Not Supported 00:22:41.393 Reset Timeout: 15000 ms 00:22:41.393 Doorbell Stride: 4 bytes 00:22:41.393 NVM Subsystem Reset: Not Supported 00:22:41.393 Command Sets Supported 00:22:41.393 NVM Command Set: Supported 00:22:41.393 Boot Partition: Not Supported 00:22:41.393 Memory Page Size Minimum: 4096 bytes 00:22:41.393 Memory Page Size Maximum: 4096 bytes 00:22:41.393 Persistent Memory Region: Not Supported 00:22:41.393 Optional Asynchronous Events Supported 00:22:41.393 Namespace Attribute Notices: Not Supported 00:22:41.393 Firmware Activation Notices: Not Supported 00:22:41.393 ANA Change Notices: Not Supported 00:22:41.393 PLE Aggregate Log Change Notices: Not Supported 00:22:41.393 LBA Status Info Alert Notices: Not Supported 00:22:41.393 EGE Aggregate Log Change Notices: Not Supported 00:22:41.393 Normal NVM Subsystem Shutdown event: Not Supported 00:22:41.393 Zone Descriptor Change Notices: Not Supported 00:22:41.393 Discovery Log Change Notices: Supported 00:22:41.393 Controller Attributes 00:22:41.393 128-bit Host Identifier: Not Supported 00:22:41.393 Non-Operational Permissive Mode: Not Supported 00:22:41.393 NVM Sets: Not Supported 00:22:41.393 Read Recovery Levels: Not Supported 00:22:41.393 Endurance Groups: Not Supported 00:22:41.393 Predictable Latency Mode: Not Supported 00:22:41.393 Traffic Based Keep ALive: Not Supported 00:22:41.393 Namespace Granularity: Not Supported 00:22:41.393 SQ Associations: Not Supported 00:22:41.393 UUID List: Not Supported 00:22:41.393 Multi-Domain Subsystem: Not Supported 00:22:41.393 Fixed Capacity Management: Not Supported 00:22:41.393 Variable Capacity Management: Not Supported 00:22:41.393 Delete Endurance Group: Not Supported 00:22:41.393 Delete NVM Set: Not Supported 00:22:41.393 Extended LBA Formats Supported: Not Supported 00:22:41.393 Flexible Data Placement Supported: Not Supported 00:22:41.393 00:22:41.393 Controller Memory Buffer Support 00:22:41.393 ================================ 00:22:41.393 Supported: No 00:22:41.393 00:22:41.393 Persistent Memory Region Support 00:22:41.393 ================================ 00:22:41.393 Supported: No 00:22:41.393 00:22:41.393 Admin Command Set Attributes 00:22:41.393 ============================ 00:22:41.393 Security Send/Receive: Not Supported 00:22:41.393 Format NVM: Not Supported 00:22:41.393 Firmware Activate/Download: Not Supported 00:22:41.393 Namespace Management: Not Supported 00:22:41.393 Device Self-Test: Not Supported 00:22:41.393 Directives: Not Supported 00:22:41.393 NVMe-MI: Not Supported 00:22:41.393 Virtualization Management: Not Supported 00:22:41.393 Doorbell Buffer Config: Not Supported 00:22:41.393 Get LBA Status Capability: Not Supported 00:22:41.393 Command & Feature Lockdown Capability: Not Supported 00:22:41.393 Abort Command Limit: 1 00:22:41.393 Async Event Request Limit: 4 00:22:41.393 Number of Firmware Slots: N/A 00:22:41.393 Firmware Slot 1 Read-Only: N/A 00:22:41.393 Firmware Activation Without Reset: N/A 00:22:41.393 Multiple Update Detection Support: N/A 00:22:41.393 Firmware Update Granularity: No Information Provided 00:22:41.393 Per-Namespace SMART Log: No 00:22:41.393 Asymmetric Namespace Access Log Page: Not Supported 00:22:41.393 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:22:41.393 Command Effects Log Page: Not Supported 00:22:41.393 Get Log Page Extended Data: Supported 00:22:41.393 Telemetry Log Pages: Not Supported 00:22:41.393 Persistent Event Log Pages: Not Supported 00:22:41.393 Supported Log Pages Log Page: May Support 00:22:41.393 Commands Supported & Effects Log Page: Not Supported 00:22:41.393 Feature Identifiers & Effects Log Page:May Support 00:22:41.393 NVMe-MI Commands & Effects Log Page: May Support 00:22:41.393 Data Area 4 for Telemetry Log: Not Supported 00:22:41.393 Error Log Page Entries Supported: 128 00:22:41.393 Keep Alive: Not Supported 00:22:41.393 00:22:41.393 NVM Command Set Attributes 00:22:41.393 ========================== 00:22:41.393 Submission Queue Entry Size 00:22:41.393 Max: 1 00:22:41.393 Min: 1 00:22:41.393 Completion Queue Entry Size 00:22:41.393 Max: 1 00:22:41.393 Min: 1 00:22:41.393 Number of Namespaces: 0 00:22:41.393 Compare Command: Not Supported 00:22:41.393 Write Uncorrectable Command: Not Supported 00:22:41.393 Dataset Management Command: Not Supported 00:22:41.393 Write Zeroes Command: Not Supported 00:22:41.393 Set Features Save Field: Not Supported 00:22:41.393 Reservations: Not Supported 00:22:41.393 Timestamp: Not Supported 00:22:41.393 Copy: Not Supported 00:22:41.393 Volatile Write Cache: Not Present 00:22:41.393 Atomic Write Unit (Normal): 1 00:22:41.393 Atomic Write Unit (PFail): 1 00:22:41.393 Atomic Compare & Write Unit: 1 00:22:41.393 Fused Compare & Write: Supported 00:22:41.393 Scatter-Gather List 00:22:41.393 SGL Command Set: Supported 00:22:41.393 SGL Keyed: Supported 00:22:41.393 SGL Bit Bucket Descriptor: Not Supported 00:22:41.393 SGL Metadata Pointer: Not Supported 00:22:41.393 Oversized SGL: Not Supported 00:22:41.393 SGL Metadata Address: Not Supported 00:22:41.393 SGL Offset: Supported 00:22:41.393 Transport SGL Data Block: Not Supported 00:22:41.393 Replay Protected Memory Block: Not Supported 00:22:41.393 00:22:41.393 Firmware Slot Information 00:22:41.393 ========================= 00:22:41.393 Active slot: 0 00:22:41.393 00:22:41.393 00:22:41.393 Error Log 00:22:41.393 ========= 00:22:41.393 00:22:41.393 Active Namespaces 00:22:41.393 ================= 00:22:41.393 Discovery Log Page 00:22:41.393 ================== 00:22:41.393 Generation Counter: 2 00:22:41.393 Number of Records: 2 00:22:41.393 Record Format: 0 00:22:41.393 00:22:41.393 Discovery Log Entry 0 00:22:41.393 ---------------------- 00:22:41.393 Transport Type: 3 (TCP) 00:22:41.393 Address Family: 1 (IPv4) 00:22:41.393 Subsystem Type: 3 (Current Discovery Subsystem) 00:22:41.393 Entry Flags: 00:22:41.393 Duplicate Returned Information: 1 00:22:41.393 Explicit Persistent Connection Support for Discovery: 1 00:22:41.393 Transport Requirements: 00:22:41.393 Secure Channel: Not Required 00:22:41.393 Port ID: 0 (0x0000) 00:22:41.393 Controller ID: 65535 (0xffff) 00:22:41.393 Admin Max SQ Size: 128 00:22:41.393 Transport Service Identifier: 4420 00:22:41.393 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:22:41.393 Transport Address: 10.0.0.2 00:22:41.393 Discovery Log Entry 1 00:22:41.393 ---------------------- 00:22:41.393 Transport Type: 3 (TCP) 00:22:41.393 Address Family: 1 (IPv4) 00:22:41.393 Subsystem Type: 2 (NVM Subsystem) 00:22:41.393 Entry Flags: 00:22:41.393 Duplicate Returned Information: 0 00:22:41.393 Explicit Persistent Connection Support for Discovery: 0 00:22:41.393 Transport Requirements: 00:22:41.393 Secure Channel: Not Required 00:22:41.393 Port ID: 0 (0x0000) 00:22:41.393 Controller ID: 65535 (0xffff) 00:22:41.393 Admin Max SQ Size: 128 00:22:41.393 Transport Service Identifier: 4420 00:22:41.393 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:22:41.393 Transport Address: 10.0.0.2 [2024-07-12 12:36:35.150142] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:22:41.393 [2024-07-12 12:36:35.150169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.393 [2024-07-12 12:36:35.150184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.393 [2024-07-12 12:36:35.150193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.393 [2024-07-12 12:36:35.150203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.393 [2024-07-12 12:36:35.150217] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.393 [2024-07-12 12:36:35.150225] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.393 [2024-07-12 12:36:35.150231] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.393 [2024-07-12 12:36:35.150243] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.393 [2024-07-12 12:36:35.150282] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.393 [2024-07-12 12:36:35.150444] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.393 [2024-07-12 12:36:35.150460] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.393 [2024-07-12 12:36:35.150466] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.393 [2024-07-12 12:36:35.150489] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.150504] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150512] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150519] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.150530] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.150558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.150685] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.150701] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.150709] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150715] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.150729] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:22:41.394 [2024-07-12 12:36:35.150738] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:22:41.394 [2024-07-12 12:36:35.150756] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150767] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150773] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.150784] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.150806] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.150906] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.150922] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.150929] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150936] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.150958] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150968] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.150974] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.150985] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.151010] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.151094] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.151109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.151116] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.151143] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151154] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151160] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.151171] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.151192] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.151273] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.151288] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.151295] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151302] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.151323] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151333] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151339] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.151350] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.151373] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.151457] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.151477] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.151485] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151493] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.151514] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151524] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151530] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.151542] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.151566] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.151657] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.151672] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.151679] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151686] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.151706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151717] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151724] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.151734] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.151755] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.151842] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.151857] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.151871] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151880] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.151900] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151911] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.151918] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.151928] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.151950] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.152034] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.152049] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.152056] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152063] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.152082] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152093] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152100] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.152111] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.152132] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.152231] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.152245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.152259] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152266] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.152300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152311] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152318] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.152329] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.152350] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.152450] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.152465] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.152471] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152478] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.152500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152510] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152516] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.152527] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.152551] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.152637] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.152652] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.152659] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152666] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.152687] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152697] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152704] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.394 [2024-07-12 12:36:35.152714] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.394 [2024-07-12 12:36:35.152739] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.394 [2024-07-12 12:36:35.152822] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.394 [2024-07-12 12:36:35.152837] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.394 [2024-07-12 12:36:35.152844] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.152851] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.394 [2024-07-12 12:36:35.156892] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.394 [2024-07-12 12:36:35.156908] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.156915] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x14afe10) 00:22:41.395 [2024-07-12 12:36:35.156925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.156947] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1530010, cid 3, qid 0 00:22:41.395 [2024-07-12 12:36:35.157074] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.157089] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.157096] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.157107] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1530010) on tqpair=0x14afe10 00:22:41.395 [2024-07-12 12:36:35.157127] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:22:41.395 00:22:41.395 12:36:35 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:22:41.395 [2024-07-12 12:36:35.187458] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:41.395 [2024-07-12 12:36:35.187503] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1344174 ] 00:22:41.395 EAL: No free 2048 kB hugepages reported on node 1 00:22:41.395 [2024-07-12 12:36:35.218630] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:22:41.395 [2024-07-12 12:36:35.218680] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:22:41.395 [2024-07-12 12:36:35.218689] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:22:41.395 [2024-07-12 12:36:35.218706] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:22:41.395 [2024-07-12 12:36:35.218717] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:22:41.395 [2024-07-12 12:36:35.221904] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:22:41.395 [2024-07-12 12:36:35.221950] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x2006e10 0 00:22:41.395 [2024-07-12 12:36:35.229881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:22:41.395 [2024-07-12 12:36:35.229899] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:22:41.395 [2024-07-12 12:36:35.229907] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:22:41.395 [2024-07-12 12:36:35.229914] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:22:41.395 [2024-07-12 12:36:35.229951] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.229963] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.229971] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.229985] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:41.395 [2024-07-12 12:36:35.230010] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.237881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.237898] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.237906] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.237914] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.237933] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:22:41.395 [2024-07-12 12:36:35.237944] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:22:41.395 [2024-07-12 12:36:35.237953] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:22:41.395 [2024-07-12 12:36:35.237970] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.237979] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.237985] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.238000] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.238025] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.238148] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.238161] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.238169] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238176] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.238186] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:22:41.395 [2024-07-12 12:36:35.238199] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:22:41.395 [2024-07-12 12:36:35.238212] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238226] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.238237] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.238260] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.238339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.238352] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.238360] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238367] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.238377] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:22:41.395 [2024-07-12 12:36:35.238391] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:22:41.395 [2024-07-12 12:36:35.238404] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238413] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238419] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.238430] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.238452] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.238528] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.238541] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.238548] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238571] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.238581] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:22:41.395 [2024-07-12 12:36:35.238598] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238607] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238614] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.238640] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.238662] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.238746] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.238761] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.238768] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238775] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.238785] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:22:41.395 [2024-07-12 12:36:35.238793] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:22:41.395 [2024-07-12 12:36:35.238807] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:22:41.395 [2024-07-12 12:36:35.238918] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:22:41.395 [2024-07-12 12:36:35.238927] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:22:41.395 [2024-07-12 12:36:35.238940] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238949] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.238955] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.238966] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.238989] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.239095] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.239108] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.239116] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.239123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.239133] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:22:41.395 [2024-07-12 12:36:35.239149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.239159] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.239166] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.395 [2024-07-12 12:36:35.239177] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.395 [2024-07-12 12:36:35.239198] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.395 [2024-07-12 12:36:35.239274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.395 [2024-07-12 12:36:35.239286] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.395 [2024-07-12 12:36:35.239294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.395 [2024-07-12 12:36:35.239301] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.395 [2024-07-12 12:36:35.239310] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:22:41.395 [2024-07-12 12:36:35.239319] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:22:41.395 [2024-07-12 12:36:35.239333] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:22:41.396 [2024-07-12 12:36:35.239347] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.239364] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.239373] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.239380] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.239391] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.396 [2024-07-12 12:36:35.239413] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.396 [2024-07-12 12:36:35.239544] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.396 [2024-07-12 12:36:35.239559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.396 [2024-07-12 12:36:35.239567] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.239574] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=4096, cccid=0 00:22:41.396 [2024-07-12 12:36:35.239582] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2086bf0) on tqpair(0x2006e10): expected_datao=0, payload_size=4096 00:22:41.396 [2024-07-12 12:36:35.239601] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.239611] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.279993] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.396 [2024-07-12 12:36:35.280013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.396 [2024-07-12 12:36:35.280021] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280028] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.396 [2024-07-12 12:36:35.280042] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:22:41.396 [2024-07-12 12:36:35.280051] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:22:41.396 [2024-07-12 12:36:35.280059] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:22:41.396 [2024-07-12 12:36:35.280066] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:22:41.396 [2024-07-12 12:36:35.280074] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:22:41.396 [2024-07-12 12:36:35.280083] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280102] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280116] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280124] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280131] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.280143] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:41.396 [2024-07-12 12:36:35.280168] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.396 [2024-07-12 12:36:35.280245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.396 [2024-07-12 12:36:35.280258] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.396 [2024-07-12 12:36:35.280266] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280273] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2086bf0) on tqpair=0x2006e10 00:22:41.396 [2024-07-12 12:36:35.280285] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280293] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280304] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.280316] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.396 [2024-07-12 12:36:35.280327] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280334] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.280350] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.396 [2024-07-12 12:36:35.280361] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280368] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280375] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.280384] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.396 [2024-07-12 12:36:35.280394] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280402] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280409] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.280418] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.396 [2024-07-12 12:36:35.280427] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280461] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280474] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280482] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280488] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.280499] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.396 [2024-07-12 12:36:35.280536] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086bf0, cid 0, qid 0 00:22:41.396 [2024-07-12 12:36:35.280548] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086d50, cid 1, qid 0 00:22:41.396 [2024-07-12 12:36:35.280556] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2086eb0, cid 2, qid 0 00:22:41.396 [2024-07-12 12:36:35.280564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087010, cid 3, qid 0 00:22:41.396 [2024-07-12 12:36:35.280572] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.396 [2024-07-12 12:36:35.280751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.396 [2024-07-12 12:36:35.280764] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.396 [2024-07-12 12:36:35.280771] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280778] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.396 [2024-07-12 12:36:35.280788] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:22:41.396 [2024-07-12 12:36:35.280797] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280811] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280827] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.280842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280851] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.280858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.284890] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:22:41.396 [2024-07-12 12:36:35.284922] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.396 [2024-07-12 12:36:35.285061] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.396 [2024-07-12 12:36:35.285076] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.396 [2024-07-12 12:36:35.285084] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.285091] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.396 [2024-07-12 12:36:35.285158] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.285177] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:22:41.396 [2024-07-12 12:36:35.285192] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.285200] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.285207] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.396 [2024-07-12 12:36:35.285218] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.396 [2024-07-12 12:36:35.285254] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.396 [2024-07-12 12:36:35.285432] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.396 [2024-07-12 12:36:35.285445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.396 [2024-07-12 12:36:35.285452] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.285459] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=4096, cccid=4 00:22:41.396 [2024-07-12 12:36:35.285468] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2087170) on tqpair(0x2006e10): expected_datao=0, payload_size=4096 00:22:41.396 [2024-07-12 12:36:35.285486] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.396 [2024-07-12 12:36:35.285495] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.325998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.326019] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.326027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.326035] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.326058] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:22:41.660 [2024-07-12 12:36:35.326075] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.326094] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.326109] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.326117] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.326124] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.326136] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.326165] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.660 [2024-07-12 12:36:35.326264] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.660 [2024-07-12 12:36:35.326277] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.660 [2024-07-12 12:36:35.326285] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.326292] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=4096, cccid=4 00:22:41.660 [2024-07-12 12:36:35.326300] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2087170) on tqpair(0x2006e10): expected_datao=0, payload_size=4096 00:22:41.660 [2024-07-12 12:36:35.326318] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.326328] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.368028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.368048] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.368056] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.368064] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.368090] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.368110] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.368125] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.368134] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.368141] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.368153] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.368178] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.660 [2024-07-12 12:36:35.368275] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.660 [2024-07-12 12:36:35.368290] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.660 [2024-07-12 12:36:35.368298] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.368305] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=4096, cccid=4 00:22:41.660 [2024-07-12 12:36:35.368313] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2087170) on tqpair(0x2006e10): expected_datao=0, payload_size=4096 00:22:41.660 [2024-07-12 12:36:35.368331] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.368341] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.412884] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.412917] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.412925] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.412932] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.412947] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.412978] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.412995] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.413009] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.413019] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.413028] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:22:41.660 [2024-07-12 12:36:35.413036] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:22:41.660 [2024-07-12 12:36:35.413045] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:22:41.660 [2024-07-12 12:36:35.413065] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413074] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413081] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413093] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.413105] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413113] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413120] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:22:41.660 [2024-07-12 12:36:35.413157] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.660 [2024-07-12 12:36:35.413169] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20872d0, cid 5, qid 0 00:22:41.660 [2024-07-12 12:36:35.413258] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.413271] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.413278] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413286] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.413298] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.413308] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.413315] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413322] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20872d0) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.413338] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413348] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413355] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413366] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.413388] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20872d0, cid 5, qid 0 00:22:41.660 [2024-07-12 12:36:35.413464] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.413477] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.413484] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413491] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20872d0) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.413508] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413517] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413524] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413539] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.413561] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20872d0, cid 5, qid 0 00:22:41.660 [2024-07-12 12:36:35.413656] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.413671] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.413679] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413686] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20872d0) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.413704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413713] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413720] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413731] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.413752] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20872d0, cid 5, qid 0 00:22:41.660 [2024-07-12 12:36:35.413837] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.660 [2024-07-12 12:36:35.413852] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.660 [2024-07-12 12:36:35.413859] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413874] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20872d0) on tqpair=0x2006e10 00:22:41.660 [2024-07-12 12:36:35.413897] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413908] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413915] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413926] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.413939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413947] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413954] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x2006e10) 00:22:41.660 [2024-07-12 12:36:35.413964] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.660 [2024-07-12 12:36:35.413976] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.660 [2024-07-12 12:36:35.413984] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.413991] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x2006e10) 00:22:41.661 [2024-07-12 12:36:35.414001] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.661 [2024-07-12 12:36:35.414013] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414021] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414028] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x2006e10) 00:22:41.661 [2024-07-12 12:36:35.414038] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.661 [2024-07-12 12:36:35.414062] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x20872d0, cid 5, qid 0 00:22:41.661 [2024-07-12 12:36:35.414074] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087170, cid 4, qid 0 00:22:41.661 [2024-07-12 12:36:35.414086] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087430, cid 6, qid 0 00:22:41.661 [2024-07-12 12:36:35.414095] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087590, cid 7, qid 0 00:22:41.661 [2024-07-12 12:36:35.414270] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.661 [2024-07-12 12:36:35.414283] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.661 [2024-07-12 12:36:35.414290] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414297] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=8192, cccid=5 00:22:41.661 [2024-07-12 12:36:35.414306] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x20872d0) on tqpair(0x2006e10): expected_datao=0, payload_size=8192 00:22:41.661 [2024-07-12 12:36:35.414325] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414335] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414348] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.661 [2024-07-12 12:36:35.414359] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.661 [2024-07-12 12:36:35.414366] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414373] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=512, cccid=4 00:22:41.661 [2024-07-12 12:36:35.414381] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2087170) on tqpair(0x2006e10): expected_datao=0, payload_size=512 00:22:41.661 [2024-07-12 12:36:35.414392] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414400] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414409] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.661 [2024-07-12 12:36:35.414418] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.661 [2024-07-12 12:36:35.414425] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414432] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=512, cccid=6 00:22:41.661 [2024-07-12 12:36:35.414440] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2087430) on tqpair(0x2006e10): expected_datao=0, payload_size=512 00:22:41.661 [2024-07-12 12:36:35.414451] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414459] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414468] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:22:41.661 [2024-07-12 12:36:35.414477] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:22:41.661 [2024-07-12 12:36:35.414484] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414491] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x2006e10): datao=0, datal=4096, cccid=7 00:22:41.661 [2024-07-12 12:36:35.414499] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2087590) on tqpair(0x2006e10): expected_datao=0, payload_size=4096 00:22:41.661 [2024-07-12 12:36:35.414510] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414519] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.661 [2024-07-12 12:36:35.414537] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.661 [2024-07-12 12:36:35.414544] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414551] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x20872d0) on tqpair=0x2006e10 00:22:41.661 [2024-07-12 12:36:35.414588] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.661 [2024-07-12 12:36:35.414600] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.661 [2024-07-12 12:36:35.414607] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414613] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087170) on tqpair=0x2006e10 00:22:41.661 [2024-07-12 12:36:35.414631] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.661 [2024-07-12 12:36:35.414642] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.661 [2024-07-12 12:36:35.414649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414655] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087430) on tqpair=0x2006e10 00:22:41.661 [2024-07-12 12:36:35.414667] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.661 [2024-07-12 12:36:35.414676] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.661 [2024-07-12 12:36:35.414683] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.661 [2024-07-12 12:36:35.414690] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087590) on tqpair=0x2006e10 00:22:41.661 ===================================================== 00:22:41.661 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:41.661 ===================================================== 00:22:41.661 Controller Capabilities/Features 00:22:41.661 ================================ 00:22:41.661 Vendor ID: 8086 00:22:41.661 Subsystem Vendor ID: 8086 00:22:41.661 Serial Number: SPDK00000000000001 00:22:41.661 Model Number: SPDK bdev Controller 00:22:41.661 Firmware Version: 24.01.1 00:22:41.661 Recommended Arb Burst: 6 00:22:41.661 IEEE OUI Identifier: e4 d2 5c 00:22:41.661 Multi-path I/O 00:22:41.661 May have multiple subsystem ports: Yes 00:22:41.661 May have multiple controllers: Yes 00:22:41.661 Associated with SR-IOV VF: No 00:22:41.661 Max Data Transfer Size: 131072 00:22:41.661 Max Number of Namespaces: 32 00:22:41.661 Max Number of I/O Queues: 127 00:22:41.661 NVMe Specification Version (VS): 1.3 00:22:41.661 NVMe Specification Version (Identify): 1.3 00:22:41.661 Maximum Queue Entries: 128 00:22:41.661 Contiguous Queues Required: Yes 00:22:41.661 Arbitration Mechanisms Supported 00:22:41.661 Weighted Round Robin: Not Supported 00:22:41.661 Vendor Specific: Not Supported 00:22:41.661 Reset Timeout: 15000 ms 00:22:41.661 Doorbell Stride: 4 bytes 00:22:41.661 NVM Subsystem Reset: Not Supported 00:22:41.661 Command Sets Supported 00:22:41.661 NVM Command Set: Supported 00:22:41.661 Boot Partition: Not Supported 00:22:41.661 Memory Page Size Minimum: 4096 bytes 00:22:41.661 Memory Page Size Maximum: 4096 bytes 00:22:41.661 Persistent Memory Region: Not Supported 00:22:41.661 Optional Asynchronous Events Supported 00:22:41.661 Namespace Attribute Notices: Supported 00:22:41.661 Firmware Activation Notices: Not Supported 00:22:41.661 ANA Change Notices: Not Supported 00:22:41.661 PLE Aggregate Log Change Notices: Not Supported 00:22:41.661 LBA Status Info Alert Notices: Not Supported 00:22:41.661 EGE Aggregate Log Change Notices: Not Supported 00:22:41.661 Normal NVM Subsystem Shutdown event: Not Supported 00:22:41.661 Zone Descriptor Change Notices: Not Supported 00:22:41.661 Discovery Log Change Notices: Not Supported 00:22:41.661 Controller Attributes 00:22:41.661 128-bit Host Identifier: Supported 00:22:41.661 Non-Operational Permissive Mode: Not Supported 00:22:41.661 NVM Sets: Not Supported 00:22:41.661 Read Recovery Levels: Not Supported 00:22:41.661 Endurance Groups: Not Supported 00:22:41.661 Predictable Latency Mode: Not Supported 00:22:41.661 Traffic Based Keep ALive: Not Supported 00:22:41.661 Namespace Granularity: Not Supported 00:22:41.661 SQ Associations: Not Supported 00:22:41.661 UUID List: Not Supported 00:22:41.661 Multi-Domain Subsystem: Not Supported 00:22:41.661 Fixed Capacity Management: Not Supported 00:22:41.661 Variable Capacity Management: Not Supported 00:22:41.661 Delete Endurance Group: Not Supported 00:22:41.661 Delete NVM Set: Not Supported 00:22:41.661 Extended LBA Formats Supported: Not Supported 00:22:41.661 Flexible Data Placement Supported: Not Supported 00:22:41.661 00:22:41.661 Controller Memory Buffer Support 00:22:41.661 ================================ 00:22:41.661 Supported: No 00:22:41.661 00:22:41.661 Persistent Memory Region Support 00:22:41.661 ================================ 00:22:41.661 Supported: No 00:22:41.661 00:22:41.661 Admin Command Set Attributes 00:22:41.661 ============================ 00:22:41.661 Security Send/Receive: Not Supported 00:22:41.661 Format NVM: Not Supported 00:22:41.661 Firmware Activate/Download: Not Supported 00:22:41.661 Namespace Management: Not Supported 00:22:41.661 Device Self-Test: Not Supported 00:22:41.661 Directives: Not Supported 00:22:41.661 NVMe-MI: Not Supported 00:22:41.661 Virtualization Management: Not Supported 00:22:41.661 Doorbell Buffer Config: Not Supported 00:22:41.661 Get LBA Status Capability: Not Supported 00:22:41.661 Command & Feature Lockdown Capability: Not Supported 00:22:41.661 Abort Command Limit: 4 00:22:41.661 Async Event Request Limit: 4 00:22:41.661 Number of Firmware Slots: N/A 00:22:41.661 Firmware Slot 1 Read-Only: N/A 00:22:41.661 Firmware Activation Without Reset: N/A 00:22:41.661 Multiple Update Detection Support: N/A 00:22:41.661 Firmware Update Granularity: No Information Provided 00:22:41.661 Per-Namespace SMART Log: No 00:22:41.661 Asymmetric Namespace Access Log Page: Not Supported 00:22:41.661 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:22:41.661 Command Effects Log Page: Supported 00:22:41.661 Get Log Page Extended Data: Supported 00:22:41.661 Telemetry Log Pages: Not Supported 00:22:41.661 Persistent Event Log Pages: Not Supported 00:22:41.661 Supported Log Pages Log Page: May Support 00:22:41.661 Commands Supported & Effects Log Page: Not Supported 00:22:41.661 Feature Identifiers & Effects Log Page:May Support 00:22:41.661 NVMe-MI Commands & Effects Log Page: May Support 00:22:41.661 Data Area 4 for Telemetry Log: Not Supported 00:22:41.662 Error Log Page Entries Supported: 128 00:22:41.662 Keep Alive: Supported 00:22:41.662 Keep Alive Granularity: 10000 ms 00:22:41.662 00:22:41.662 NVM Command Set Attributes 00:22:41.662 ========================== 00:22:41.662 Submission Queue Entry Size 00:22:41.662 Max: 64 00:22:41.662 Min: 64 00:22:41.662 Completion Queue Entry Size 00:22:41.662 Max: 16 00:22:41.662 Min: 16 00:22:41.662 Number of Namespaces: 32 00:22:41.662 Compare Command: Supported 00:22:41.662 Write Uncorrectable Command: Not Supported 00:22:41.662 Dataset Management Command: Supported 00:22:41.662 Write Zeroes Command: Supported 00:22:41.662 Set Features Save Field: Not Supported 00:22:41.662 Reservations: Supported 00:22:41.662 Timestamp: Not Supported 00:22:41.662 Copy: Supported 00:22:41.662 Volatile Write Cache: Present 00:22:41.662 Atomic Write Unit (Normal): 1 00:22:41.662 Atomic Write Unit (PFail): 1 00:22:41.662 Atomic Compare & Write Unit: 1 00:22:41.662 Fused Compare & Write: Supported 00:22:41.662 Scatter-Gather List 00:22:41.662 SGL Command Set: Supported 00:22:41.662 SGL Keyed: Supported 00:22:41.662 SGL Bit Bucket Descriptor: Not Supported 00:22:41.662 SGL Metadata Pointer: Not Supported 00:22:41.662 Oversized SGL: Not Supported 00:22:41.662 SGL Metadata Address: Not Supported 00:22:41.662 SGL Offset: Supported 00:22:41.662 Transport SGL Data Block: Not Supported 00:22:41.662 Replay Protected Memory Block: Not Supported 00:22:41.662 00:22:41.662 Firmware Slot Information 00:22:41.662 ========================= 00:22:41.662 Active slot: 1 00:22:41.662 Slot 1 Firmware Revision: 24.01.1 00:22:41.662 00:22:41.662 00:22:41.662 Commands Supported and Effects 00:22:41.662 ============================== 00:22:41.662 Admin Commands 00:22:41.662 -------------- 00:22:41.662 Get Log Page (02h): Supported 00:22:41.662 Identify (06h): Supported 00:22:41.662 Abort (08h): Supported 00:22:41.662 Set Features (09h): Supported 00:22:41.662 Get Features (0Ah): Supported 00:22:41.662 Asynchronous Event Request (0Ch): Supported 00:22:41.662 Keep Alive (18h): Supported 00:22:41.662 I/O Commands 00:22:41.662 ------------ 00:22:41.662 Flush (00h): Supported LBA-Change 00:22:41.662 Write (01h): Supported LBA-Change 00:22:41.662 Read (02h): Supported 00:22:41.662 Compare (05h): Supported 00:22:41.662 Write Zeroes (08h): Supported LBA-Change 00:22:41.662 Dataset Management (09h): Supported LBA-Change 00:22:41.662 Copy (19h): Supported LBA-Change 00:22:41.662 Unknown (79h): Supported LBA-Change 00:22:41.662 Unknown (7Ah): Supported 00:22:41.662 00:22:41.662 Error Log 00:22:41.662 ========= 00:22:41.662 00:22:41.662 Arbitration 00:22:41.662 =========== 00:22:41.662 Arbitration Burst: 1 00:22:41.662 00:22:41.662 Power Management 00:22:41.662 ================ 00:22:41.662 Number of Power States: 1 00:22:41.662 Current Power State: Power State #0 00:22:41.662 Power State #0: 00:22:41.662 Max Power: 0.00 W 00:22:41.662 Non-Operational State: Operational 00:22:41.662 Entry Latency: Not Reported 00:22:41.662 Exit Latency: Not Reported 00:22:41.662 Relative Read Throughput: 0 00:22:41.662 Relative Read Latency: 0 00:22:41.662 Relative Write Throughput: 0 00:22:41.662 Relative Write Latency: 0 00:22:41.662 Idle Power: Not Reported 00:22:41.662 Active Power: Not Reported 00:22:41.662 Non-Operational Permissive Mode: Not Supported 00:22:41.662 00:22:41.662 Health Information 00:22:41.662 ================== 00:22:41.662 Critical Warnings: 00:22:41.662 Available Spare Space: OK 00:22:41.662 Temperature: OK 00:22:41.662 Device Reliability: OK 00:22:41.662 Read Only: No 00:22:41.662 Volatile Memory Backup: OK 00:22:41.662 Current Temperature: 0 Kelvin (-273 Celsius) 00:22:41.662 Temperature Threshold: [2024-07-12 12:36:35.414807] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.414819] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.414826] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x2006e10) 00:22:41.662 [2024-07-12 12:36:35.414836] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.662 [2024-07-12 12:36:35.414858] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087590, cid 7, qid 0 00:22:41.662 [2024-07-12 12:36:35.415049] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.662 [2024-07-12 12:36:35.415063] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.662 [2024-07-12 12:36:35.415071] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415078] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087590) on tqpair=0x2006e10 00:22:41.662 [2024-07-12 12:36:35.415121] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:22:41.662 [2024-07-12 12:36:35.415143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.662 [2024-07-12 12:36:35.415155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.662 [2024-07-12 12:36:35.415165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.662 [2024-07-12 12:36:35.415175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:41.662 [2024-07-12 12:36:35.415187] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415196] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415203] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2006e10) 00:22:41.662 [2024-07-12 12:36:35.415214] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.662 [2024-07-12 12:36:35.415251] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087010, cid 3, qid 0 00:22:41.662 [2024-07-12 12:36:35.415401] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.662 [2024-07-12 12:36:35.415414] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.662 [2024-07-12 12:36:35.415421] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415428] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087010) on tqpair=0x2006e10 00:22:41.662 [2024-07-12 12:36:35.415441] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415450] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415456] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2006e10) 00:22:41.662 [2024-07-12 12:36:35.415467] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.662 [2024-07-12 12:36:35.415498] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087010, cid 3, qid 0 00:22:41.662 [2024-07-12 12:36:35.415594] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.662 [2024-07-12 12:36:35.415609] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.662 [2024-07-12 12:36:35.415616] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415623] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087010) on tqpair=0x2006e10 00:22:41.662 [2024-07-12 12:36:35.415633] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:22:41.662 [2024-07-12 12:36:35.415641] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:22:41.662 [2024-07-12 12:36:35.415657] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415667] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415674] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2006e10) 00:22:41.662 [2024-07-12 12:36:35.415685] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.662 [2024-07-12 12:36:35.415706] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087010, cid 3, qid 0 00:22:41.662 [2024-07-12 12:36:35.415784] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.662 [2024-07-12 12:36:35.415797] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.662 [2024-07-12 12:36:35.415805] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415812] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087010) on tqpair=0x2006e10 00:22:41.662 [2024-07-12 12:36:35.415830] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415839] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.415846] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x2006e10) 00:22:41.662 [2024-07-12 12:36:35.415857] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:41.662 [2024-07-12 12:36:35.419905] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2087010, cid 3, qid 0 00:22:41.662 [2024-07-12 12:36:35.420060] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:22:41.662 [2024-07-12 12:36:35.420075] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:22:41.662 [2024-07-12 12:36:35.420083] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:22:41.662 [2024-07-12 12:36:35.420090] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2087010) on tqpair=0x2006e10 00:22:41.662 [2024-07-12 12:36:35.420105] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:22:41.662 0 Kelvin (-273 Celsius) 00:22:41.662 Available Spare: 0% 00:22:41.662 Available Spare Threshold: 0% 00:22:41.662 Life Percentage Used: 0% 00:22:41.662 Data Units Read: 0 00:22:41.662 Data Units Written: 0 00:22:41.662 Host Read Commands: 0 00:22:41.662 Host Write Commands: 0 00:22:41.662 Controller Busy Time: 0 minutes 00:22:41.662 Power Cycles: 0 00:22:41.662 Power On Hours: 0 hours 00:22:41.662 Unsafe Shutdowns: 0 00:22:41.662 Unrecoverable Media Errors: 0 00:22:41.662 Lifetime Error Log Entries: 0 00:22:41.662 Warning Temperature Time: 0 minutes 00:22:41.662 Critical Temperature Time: 0 minutes 00:22:41.662 00:22:41.662 Number of Queues 00:22:41.662 ================ 00:22:41.662 Number of I/O Submission Queues: 127 00:22:41.662 Number of I/O Completion Queues: 127 00:22:41.663 00:22:41.663 Active Namespaces 00:22:41.663 ================= 00:22:41.663 Namespace ID:1 00:22:41.663 Error Recovery Timeout: Unlimited 00:22:41.663 Command Set Identifier: NVM (00h) 00:22:41.663 Deallocate: Supported 00:22:41.663 Deallocated/Unwritten Error: Not Supported 00:22:41.663 Deallocated Read Value: Unknown 00:22:41.663 Deallocate in Write Zeroes: Not Supported 00:22:41.663 Deallocated Guard Field: 0xFFFF 00:22:41.663 Flush: Supported 00:22:41.663 Reservation: Supported 00:22:41.663 Namespace Sharing Capabilities: Multiple Controllers 00:22:41.663 Size (in LBAs): 131072 (0GiB) 00:22:41.663 Capacity (in LBAs): 131072 (0GiB) 00:22:41.663 Utilization (in LBAs): 131072 (0GiB) 00:22:41.663 NGUID: ABCDEF0123456789ABCDEF0123456789 00:22:41.663 EUI64: ABCDEF0123456789 00:22:41.663 UUID: aecb8ff3-c6b0-4ff1-bbd0-45677ab3b50b 00:22:41.663 Thin Provisioning: Not Supported 00:22:41.663 Per-NS Atomic Units: Yes 00:22:41.663 Atomic Boundary Size (Normal): 0 00:22:41.663 Atomic Boundary Size (PFail): 0 00:22:41.663 Atomic Boundary Offset: 0 00:22:41.663 Maximum Single Source Range Length: 65535 00:22:41.663 Maximum Copy Length: 65535 00:22:41.663 Maximum Source Range Count: 1 00:22:41.663 NGUID/EUI64 Never Reused: No 00:22:41.663 Namespace Write Protected: No 00:22:41.663 Number of LBA Formats: 1 00:22:41.663 Current LBA Format: LBA Format #00 00:22:41.663 LBA Format #00: Data Size: 512 Metadata Size: 0 00:22:41.663 00:22:41.663 12:36:35 -- host/identify.sh@51 -- # sync 00:22:41.663 12:36:35 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:41.663 12:36:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:22:41.663 12:36:35 -- common/autotest_common.sh@10 -- # set +x 00:22:41.663 12:36:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:22:41.663 12:36:35 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:22:41.663 12:36:35 -- host/identify.sh@56 -- # nvmftestfini 00:22:41.663 12:36:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:41.663 12:36:35 -- nvmf/common.sh@116 -- # sync 00:22:41.663 12:36:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:41.663 12:36:35 -- nvmf/common.sh@119 -- # set +e 00:22:41.663 12:36:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:41.663 12:36:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:41.663 rmmod nvme_tcp 00:22:41.663 rmmod nvme_fabrics 00:22:41.663 rmmod nvme_keyring 00:22:41.663 12:36:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:41.663 12:36:35 -- nvmf/common.sh@123 -- # set -e 00:22:41.663 12:36:35 -- nvmf/common.sh@124 -- # return 0 00:22:41.663 12:36:35 -- nvmf/common.sh@477 -- # '[' -n 1344010 ']' 00:22:41.663 12:36:35 -- nvmf/common.sh@478 -- # killprocess 1344010 00:22:41.663 12:36:35 -- common/autotest_common.sh@926 -- # '[' -z 1344010 ']' 00:22:41.663 12:36:35 -- common/autotest_common.sh@930 -- # kill -0 1344010 00:22:41.663 12:36:35 -- common/autotest_common.sh@931 -- # uname 00:22:41.663 12:36:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:22:41.663 12:36:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1344010 00:22:41.663 12:36:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:22:41.663 12:36:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:22:41.663 12:36:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1344010' 00:22:41.663 killing process with pid 1344010 00:22:41.663 12:36:35 -- common/autotest_common.sh@945 -- # kill 1344010 00:22:41.663 [2024-07-12 12:36:35.519140] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:22:41.663 12:36:35 -- common/autotest_common.sh@950 -- # wait 1344010 00:22:41.922 12:36:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:41.922 12:36:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:41.922 12:36:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:41.922 12:36:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:41.922 12:36:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:41.922 12:36:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:41.922 12:36:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:41.922 12:36:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.459 12:36:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:44.459 00:22:44.459 real 0m6.083s 00:22:44.459 user 0m7.798s 00:22:44.459 sys 0m1.826s 00:22:44.459 12:36:37 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:22:44.459 12:36:37 -- common/autotest_common.sh@10 -- # set +x 00:22:44.459 ************************************ 00:22:44.459 END TEST nvmf_identify 00:22:44.459 ************************************ 00:22:44.459 12:36:37 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:44.459 12:36:37 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:22:44.459 12:36:37 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:22:44.459 12:36:37 -- common/autotest_common.sh@10 -- # set +x 00:22:44.459 ************************************ 00:22:44.459 START TEST nvmf_perf 00:22:44.459 ************************************ 00:22:44.459 12:36:37 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:22:44.459 * Looking for test storage... 00:22:44.459 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:44.459 12:36:37 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:44.459 12:36:37 -- nvmf/common.sh@7 -- # uname -s 00:22:44.459 12:36:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:44.459 12:36:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:44.459 12:36:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:44.459 12:36:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:44.459 12:36:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:44.459 12:36:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:44.459 12:36:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:44.459 12:36:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:44.459 12:36:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:44.459 12:36:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:44.459 12:36:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:44.459 12:36:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:44.459 12:36:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:44.459 12:36:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:44.459 12:36:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:44.459 12:36:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:44.459 12:36:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:44.459 12:36:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:44.459 12:36:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:44.459 12:36:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.459 12:36:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.459 12:36:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.459 12:36:37 -- paths/export.sh@5 -- # export PATH 00:22:44.459 12:36:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:44.459 12:36:37 -- nvmf/common.sh@46 -- # : 0 00:22:44.459 12:36:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:44.459 12:36:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:44.459 12:36:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:44.459 12:36:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:44.459 12:36:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:44.459 12:36:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:44.459 12:36:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:44.459 12:36:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:44.459 12:36:37 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:22:44.459 12:36:37 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:22:44.459 12:36:37 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:22:44.459 12:36:37 -- host/perf.sh@17 -- # nvmftestinit 00:22:44.459 12:36:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:44.459 12:36:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:44.459 12:36:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:44.459 12:36:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:44.459 12:36:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:44.459 12:36:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:44.459 12:36:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:44.459 12:36:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:44.459 12:36:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:44.459 12:36:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:44.459 12:36:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:44.459 12:36:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.365 12:36:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:46.365 12:36:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:46.365 12:36:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:46.365 12:36:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:46.365 12:36:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:46.365 12:36:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:46.365 12:36:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:46.365 12:36:39 -- nvmf/common.sh@294 -- # net_devs=() 00:22:46.365 12:36:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:46.365 12:36:39 -- nvmf/common.sh@295 -- # e810=() 00:22:46.365 12:36:39 -- nvmf/common.sh@295 -- # local -ga e810 00:22:46.365 12:36:39 -- nvmf/common.sh@296 -- # x722=() 00:22:46.365 12:36:39 -- nvmf/common.sh@296 -- # local -ga x722 00:22:46.365 12:36:39 -- nvmf/common.sh@297 -- # mlx=() 00:22:46.365 12:36:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:46.365 12:36:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:46.365 12:36:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:46.365 12:36:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:46.365 12:36:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:46.365 12:36:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:46.365 12:36:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:46.365 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:46.365 12:36:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:46.365 12:36:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:46.365 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:46.365 12:36:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:46.365 12:36:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:46.365 12:36:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:46.365 12:36:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:46.365 12:36:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:46.365 12:36:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:46.365 12:36:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:46.365 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:46.365 12:36:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:46.365 12:36:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:46.365 12:36:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:46.365 12:36:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:46.365 12:36:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:46.365 12:36:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:46.366 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:46.366 12:36:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:46.366 12:36:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:46.366 12:36:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:46.366 12:36:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:46.366 12:36:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:46.366 12:36:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:46.366 12:36:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:46.366 12:36:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:46.366 12:36:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:46.366 12:36:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:46.366 12:36:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:46.366 12:36:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:46.366 12:36:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:46.366 12:36:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:46.366 12:36:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:46.366 12:36:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:46.366 12:36:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:46.366 12:36:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:46.366 12:36:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:46.366 12:36:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:46.366 12:36:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:46.366 12:36:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:46.366 12:36:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:46.366 12:36:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:46.366 12:36:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:46.366 12:36:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:46.366 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:46.366 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:22:46.366 00:22:46.366 --- 10.0.0.2 ping statistics --- 00:22:46.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:46.366 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:22:46.366 12:36:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:46.366 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:46.366 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:22:46.366 00:22:46.366 --- 10.0.0.1 ping statistics --- 00:22:46.366 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:46.366 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:22:46.366 12:36:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:46.366 12:36:40 -- nvmf/common.sh@410 -- # return 0 00:22:46.366 12:36:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:46.366 12:36:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:46.366 12:36:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:46.366 12:36:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:46.366 12:36:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:46.366 12:36:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:46.366 12:36:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:46.366 12:36:40 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:22:46.366 12:36:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:46.366 12:36:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:22:46.366 12:36:40 -- common/autotest_common.sh@10 -- # set +x 00:22:46.366 12:36:40 -- nvmf/common.sh@469 -- # nvmfpid=1346118 00:22:46.366 12:36:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:46.366 12:36:40 -- nvmf/common.sh@470 -- # waitforlisten 1346118 00:22:46.366 12:36:40 -- common/autotest_common.sh@819 -- # '[' -z 1346118 ']' 00:22:46.366 12:36:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:46.366 12:36:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:22:46.366 12:36:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:46.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:46.366 12:36:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:22:46.366 12:36:40 -- common/autotest_common.sh@10 -- # set +x 00:22:46.366 [2024-07-12 12:36:40.138412] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:22:46.366 [2024-07-12 12:36:40.138494] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:46.366 EAL: No free 2048 kB hugepages reported on node 1 00:22:46.366 [2024-07-12 12:36:40.210622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:46.626 [2024-07-12 12:36:40.333902] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:46.626 [2024-07-12 12:36:40.334067] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:46.626 [2024-07-12 12:36:40.334086] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:46.626 [2024-07-12 12:36:40.334099] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:46.626 [2024-07-12 12:36:40.334165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:46.626 [2024-07-12 12:36:40.334222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:46.627 [2024-07-12 12:36:40.334274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:46.627 [2024-07-12 12:36:40.334277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:47.568 12:36:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:22:47.568 12:36:41 -- common/autotest_common.sh@852 -- # return 0 00:22:47.568 12:36:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:47.568 12:36:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:22:47.568 12:36:41 -- common/autotest_common.sh@10 -- # set +x 00:22:47.568 12:36:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:47.568 12:36:41 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:22:47.568 12:36:41 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:22:50.858 12:36:44 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:22:50.858 12:36:44 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:22:50.858 12:36:44 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:22:50.858 12:36:44 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:22:51.116 12:36:44 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:22:51.116 12:36:44 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:22:51.116 12:36:44 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:22:51.116 12:36:44 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:22:51.116 12:36:44 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:22:51.374 [2024-07-12 12:36:45.041585] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:51.374 12:36:45 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:51.633 12:36:45 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:51.633 12:36:45 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:51.633 12:36:45 -- host/perf.sh@45 -- # for bdev in $bdevs 00:22:51.633 12:36:45 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:22:51.891 12:36:45 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:52.149 [2024-07-12 12:36:45.989194] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:52.149 12:36:46 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:22:52.409 12:36:46 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:22:52.409 12:36:46 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:52.409 12:36:46 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:22:52.409 12:36:46 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:22:53.784 Initializing NVMe Controllers 00:22:53.784 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:22:53.784 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:22:53.784 Initialization complete. Launching workers. 00:22:53.784 ======================================================== 00:22:53.784 Latency(us) 00:22:53.784 Device Information : IOPS MiB/s Average min max 00:22:53.784 PCIE (0000:88:00.0) NSID 1 from core 0: 86995.82 339.83 367.42 11.08 4453.25 00:22:53.784 ======================================================== 00:22:53.784 Total : 86995.82 339.83 367.42 11.08 4453.25 00:22:53.784 00:22:53.784 12:36:47 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:53.784 EAL: No free 2048 kB hugepages reported on node 1 00:22:55.166 Initializing NVMe Controllers 00:22:55.166 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:55.166 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:55.166 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:55.166 Initialization complete. Launching workers. 00:22:55.166 ======================================================== 00:22:55.166 Latency(us) 00:22:55.166 Device Information : IOPS MiB/s Average min max 00:22:55.166 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 111.94 0.44 9004.22 138.75 45777.83 00:22:55.166 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 61.97 0.24 16394.45 5009.32 50855.52 00:22:55.166 ======================================================== 00:22:55.166 Total : 173.91 0.68 11637.52 138.75 50855.52 00:22:55.166 00:22:55.166 12:36:48 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:55.166 EAL: No free 2048 kB hugepages reported on node 1 00:22:56.126 Initializing NVMe Controllers 00:22:56.126 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:56.126 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:56.126 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:56.126 Initialization complete. Launching workers. 00:22:56.126 ======================================================== 00:22:56.126 Latency(us) 00:22:56.126 Device Information : IOPS MiB/s Average min max 00:22:56.126 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7803.55 30.48 4102.06 631.14 7837.69 00:22:56.126 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3957.08 15.46 8086.67 5667.82 15447.78 00:22:56.126 ======================================================== 00:22:56.126 Total : 11760.64 45.94 5442.75 631.14 15447.78 00:22:56.126 00:22:56.126 12:36:49 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:22:56.126 12:36:49 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:22:56.126 12:36:49 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:22:56.126 EAL: No free 2048 kB hugepages reported on node 1 00:22:59.415 Initializing NVMe Controllers 00:22:59.415 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:59.415 Controller IO queue size 128, less than required. 00:22:59.415 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:59.415 Controller IO queue size 128, less than required. 00:22:59.415 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:59.415 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:22:59.415 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:22:59.415 Initialization complete. Launching workers. 00:22:59.415 ======================================================== 00:22:59.415 Latency(us) 00:22:59.415 Device Information : IOPS MiB/s Average min max 00:22:59.415 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1709.32 427.33 76048.28 54460.39 118328.48 00:22:59.415 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 571.27 142.82 237005.53 70519.97 400107.97 00:22:59.415 ======================================================== 00:22:59.415 Total : 2280.59 570.15 116366.62 54460.39 400107.97 00:22:59.415 00:22:59.415 12:36:52 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:22:59.415 EAL: No free 2048 kB hugepages reported on node 1 00:22:59.415 No valid NVMe controllers or AIO or URING devices found 00:22:59.415 Initializing NVMe Controllers 00:22:59.415 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:59.415 Controller IO queue size 128, less than required. 00:22:59.415 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:59.415 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:22:59.415 Controller IO queue size 128, less than required. 00:22:59.415 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:22:59.415 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:22:59.415 WARNING: Some requested NVMe devices were skipped 00:22:59.415 12:36:53 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:22:59.415 EAL: No free 2048 kB hugepages reported on node 1 00:23:01.946 Initializing NVMe Controllers 00:23:01.946 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:01.946 Controller IO queue size 128, less than required. 00:23:01.946 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:01.946 Controller IO queue size 128, less than required. 00:23:01.946 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:01.946 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:01.946 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:01.946 Initialization complete. Launching workers. 00:23:01.946 00:23:01.946 ==================== 00:23:01.946 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:01.946 TCP transport: 00:23:01.946 polls: 9294 00:23:01.946 idle_polls: 5669 00:23:01.946 sock_completions: 3625 00:23:01.946 nvme_completions: 5708 00:23:01.946 submitted_requests: 8718 00:23:01.946 queued_requests: 1 00:23:01.946 00:23:01.946 ==================== 00:23:01.946 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:01.946 TCP transport: 00:23:01.946 polls: 12294 00:23:01.946 idle_polls: 8934 00:23:01.946 sock_completions: 3360 00:23:01.946 nvme_completions: 6108 00:23:01.946 submitted_requests: 9435 00:23:01.946 queued_requests: 1 00:23:01.946 ======================================================== 00:23:01.946 Latency(us) 00:23:01.946 Device Information : IOPS MiB/s Average min max 00:23:01.946 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1490.31 372.58 88050.92 56175.77 159089.90 00:23:01.946 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1590.29 397.57 81403.04 40210.82 136934.06 00:23:01.946 ======================================================== 00:23:01.946 Total : 3080.60 770.15 84619.10 40210.82 159089.90 00:23:01.946 00:23:01.946 12:36:55 -- host/perf.sh@66 -- # sync 00:23:01.946 12:36:55 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:01.946 12:36:55 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:01.946 12:36:55 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:01.946 12:36:55 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:05.231 12:36:59 -- host/perf.sh@72 -- # ls_guid=28ba4064-5947-4673-befb-0167a64d3f77 00:23:05.231 12:36:59 -- host/perf.sh@73 -- # get_lvs_free_mb 28ba4064-5947-4673-befb-0167a64d3f77 00:23:05.231 12:36:59 -- common/autotest_common.sh@1343 -- # local lvs_uuid=28ba4064-5947-4673-befb-0167a64d3f77 00:23:05.231 12:36:59 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:05.231 12:36:59 -- common/autotest_common.sh@1345 -- # local fc 00:23:05.231 12:36:59 -- common/autotest_common.sh@1346 -- # local cs 00:23:05.231 12:36:59 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:05.489 12:36:59 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:05.489 { 00:23:05.489 "uuid": "28ba4064-5947-4673-befb-0167a64d3f77", 00:23:05.489 "name": "lvs_0", 00:23:05.489 "base_bdev": "Nvme0n1", 00:23:05.489 "total_data_clusters": 238234, 00:23:05.489 "free_clusters": 238234, 00:23:05.489 "block_size": 512, 00:23:05.489 "cluster_size": 4194304 00:23:05.489 } 00:23:05.489 ]' 00:23:05.489 12:36:59 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="28ba4064-5947-4673-befb-0167a64d3f77") .free_clusters' 00:23:05.489 12:36:59 -- common/autotest_common.sh@1348 -- # fc=238234 00:23:05.489 12:36:59 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="28ba4064-5947-4673-befb-0167a64d3f77") .cluster_size' 00:23:05.748 12:36:59 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:05.748 12:36:59 -- common/autotest_common.sh@1352 -- # free_mb=952936 00:23:05.748 12:36:59 -- common/autotest_common.sh@1353 -- # echo 952936 00:23:05.748 952936 00:23:05.748 12:36:59 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:05.748 12:36:59 -- host/perf.sh@78 -- # free_mb=20480 00:23:05.748 12:36:59 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 28ba4064-5947-4673-befb-0167a64d3f77 lbd_0 20480 00:23:06.007 12:36:59 -- host/perf.sh@80 -- # lb_guid=3791dbff-fd69-4d96-a786-f9695b30488d 00:23:06.007 12:36:59 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 3791dbff-fd69-4d96-a786-f9695b30488d lvs_n_0 00:23:06.941 12:37:00 -- host/perf.sh@83 -- # ls_nested_guid=9185488f-cc1e-432d-8dec-bf0c904d2515 00:23:06.941 12:37:00 -- host/perf.sh@84 -- # get_lvs_free_mb 9185488f-cc1e-432d-8dec-bf0c904d2515 00:23:06.941 12:37:00 -- common/autotest_common.sh@1343 -- # local lvs_uuid=9185488f-cc1e-432d-8dec-bf0c904d2515 00:23:06.941 12:37:00 -- common/autotest_common.sh@1344 -- # local lvs_info 00:23:06.941 12:37:00 -- common/autotest_common.sh@1345 -- # local fc 00:23:06.941 12:37:00 -- common/autotest_common.sh@1346 -- # local cs 00:23:06.941 12:37:00 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:06.941 12:37:00 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:23:06.941 { 00:23:06.941 "uuid": "28ba4064-5947-4673-befb-0167a64d3f77", 00:23:06.941 "name": "lvs_0", 00:23:06.941 "base_bdev": "Nvme0n1", 00:23:06.941 "total_data_clusters": 238234, 00:23:06.941 "free_clusters": 233114, 00:23:06.941 "block_size": 512, 00:23:06.941 "cluster_size": 4194304 00:23:06.941 }, 00:23:06.941 { 00:23:06.941 "uuid": "9185488f-cc1e-432d-8dec-bf0c904d2515", 00:23:06.941 "name": "lvs_n_0", 00:23:06.941 "base_bdev": "3791dbff-fd69-4d96-a786-f9695b30488d", 00:23:06.941 "total_data_clusters": 5114, 00:23:06.941 "free_clusters": 5114, 00:23:06.941 "block_size": 512, 00:23:06.941 "cluster_size": 4194304 00:23:06.941 } 00:23:06.941 ]' 00:23:06.941 12:37:00 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="9185488f-cc1e-432d-8dec-bf0c904d2515") .free_clusters' 00:23:07.199 12:37:00 -- common/autotest_common.sh@1348 -- # fc=5114 00:23:07.199 12:37:00 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="9185488f-cc1e-432d-8dec-bf0c904d2515") .cluster_size' 00:23:07.199 12:37:00 -- common/autotest_common.sh@1349 -- # cs=4194304 00:23:07.199 12:37:00 -- common/autotest_common.sh@1352 -- # free_mb=20456 00:23:07.199 12:37:00 -- common/autotest_common.sh@1353 -- # echo 20456 00:23:07.199 20456 00:23:07.199 12:37:00 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:07.199 12:37:00 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9185488f-cc1e-432d-8dec-bf0c904d2515 lbd_nest_0 20456 00:23:07.458 12:37:01 -- host/perf.sh@88 -- # lb_nested_guid=67bf8679-7da0-4933-a3a9-ade903468558 00:23:07.458 12:37:01 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:07.458 12:37:01 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:07.458 12:37:01 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 67bf8679-7da0-4933-a3a9-ade903468558 00:23:07.716 12:37:01 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:07.973 12:37:01 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:07.973 12:37:01 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:07.973 12:37:01 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:07.973 12:37:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:07.973 12:37:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:08.232 EAL: No free 2048 kB hugepages reported on node 1 00:23:20.442 Initializing NVMe Controllers 00:23:20.442 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:20.442 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:20.442 Initialization complete. Launching workers. 00:23:20.442 ======================================================== 00:23:20.442 Latency(us) 00:23:20.442 Device Information : IOPS MiB/s Average min max 00:23:20.442 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 46.30 0.02 21685.20 165.19 48757.56 00:23:20.442 ======================================================== 00:23:20.442 Total : 46.30 0.02 21685.20 165.19 48757.56 00:23:20.442 00:23:20.442 12:37:12 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:20.442 12:37:12 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:20.442 EAL: No free 2048 kB hugepages reported on node 1 00:23:30.425 Initializing NVMe Controllers 00:23:30.425 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:30.425 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:30.425 Initialization complete. Launching workers. 00:23:30.425 ======================================================== 00:23:30.425 Latency(us) 00:23:30.425 Device Information : IOPS MiB/s Average min max 00:23:30.425 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 70.70 8.84 14155.73 6010.76 47895.53 00:23:30.425 ======================================================== 00:23:30.425 Total : 70.70 8.84 14155.73 6010.76 47895.53 00:23:30.425 00:23:30.425 12:37:22 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:30.425 12:37:22 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:30.425 12:37:22 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:30.425 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.429 Initializing NVMe Controllers 00:23:40.429 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:40.429 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:40.429 Initialization complete. Launching workers. 00:23:40.429 ======================================================== 00:23:40.429 Latency(us) 00:23:40.429 Device Information : IOPS MiB/s Average min max 00:23:40.429 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7646.73 3.73 4185.53 294.82 40959.46 00:23:40.429 ======================================================== 00:23:40.429 Total : 7646.73 3.73 4185.53 294.82 40959.46 00:23:40.429 00:23:40.429 12:37:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:40.429 12:37:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:40.429 EAL: No free 2048 kB hugepages reported on node 1 00:23:50.408 Initializing NVMe Controllers 00:23:50.408 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:50.408 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:50.408 Initialization complete. Launching workers. 00:23:50.408 ======================================================== 00:23:50.408 Latency(us) 00:23:50.408 Device Information : IOPS MiB/s Average min max 00:23:50.408 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3989.00 498.62 8024.87 681.86 19133.48 00:23:50.408 ======================================================== 00:23:50.408 Total : 3989.00 498.62 8024.87 681.86 19133.48 00:23:50.408 00:23:50.408 12:37:43 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:50.408 12:37:43 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:50.408 12:37:43 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:50.408 EAL: No free 2048 kB hugepages reported on node 1 00:24:00.386 Initializing NVMe Controllers 00:24:00.386 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:00.386 Controller IO queue size 128, less than required. 00:24:00.386 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:00.386 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:00.386 Initialization complete. Launching workers. 00:24:00.386 ======================================================== 00:24:00.386 Latency(us) 00:24:00.386 Device Information : IOPS MiB/s Average min max 00:24:00.386 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12102.86 5.91 10584.58 1668.27 25805.26 00:24:00.386 ======================================================== 00:24:00.386 Total : 12102.86 5.91 10584.58 1668.27 25805.26 00:24:00.386 00:24:00.386 12:37:53 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:00.386 12:37:53 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:00.386 EAL: No free 2048 kB hugepages reported on node 1 00:24:10.363 Initializing NVMe Controllers 00:24:10.363 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:10.363 Controller IO queue size 128, less than required. 00:24:10.363 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:10.363 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:10.363 Initialization complete. Launching workers. 00:24:10.363 ======================================================== 00:24:10.363 Latency(us) 00:24:10.363 Device Information : IOPS MiB/s Average min max 00:24:10.363 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1203.32 150.42 107310.14 24125.73 232690.32 00:24:10.363 ======================================================== 00:24:10.363 Total : 1203.32 150.42 107310.14 24125.73 232690.32 00:24:10.363 00:24:10.363 12:38:03 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:10.363 12:38:04 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 67bf8679-7da0-4933-a3a9-ade903468558 00:24:11.299 12:38:04 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:11.299 12:38:05 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3791dbff-fd69-4d96-a786-f9695b30488d 00:24:11.864 12:38:05 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:11.864 12:38:05 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:11.864 12:38:05 -- host/perf.sh@114 -- # nvmftestfini 00:24:11.864 12:38:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:11.864 12:38:05 -- nvmf/common.sh@116 -- # sync 00:24:11.864 12:38:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:11.864 12:38:05 -- nvmf/common.sh@119 -- # set +e 00:24:11.864 12:38:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:11.864 12:38:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:11.864 rmmod nvme_tcp 00:24:12.123 rmmod nvme_fabrics 00:24:12.123 rmmod nvme_keyring 00:24:12.123 12:38:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:12.123 12:38:05 -- nvmf/common.sh@123 -- # set -e 00:24:12.123 12:38:05 -- nvmf/common.sh@124 -- # return 0 00:24:12.123 12:38:05 -- nvmf/common.sh@477 -- # '[' -n 1346118 ']' 00:24:12.123 12:38:05 -- nvmf/common.sh@478 -- # killprocess 1346118 00:24:12.123 12:38:05 -- common/autotest_common.sh@926 -- # '[' -z 1346118 ']' 00:24:12.123 12:38:05 -- common/autotest_common.sh@930 -- # kill -0 1346118 00:24:12.123 12:38:05 -- common/autotest_common.sh@931 -- # uname 00:24:12.123 12:38:05 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:12.123 12:38:05 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1346118 00:24:12.124 12:38:05 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:12.124 12:38:05 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:12.124 12:38:05 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1346118' 00:24:12.124 killing process with pid 1346118 00:24:12.124 12:38:05 -- common/autotest_common.sh@945 -- # kill 1346118 00:24:12.124 12:38:05 -- common/autotest_common.sh@950 -- # wait 1346118 00:24:14.030 12:38:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:14.030 12:38:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:14.030 12:38:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:14.030 12:38:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:14.030 12:38:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:14.030 12:38:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:14.030 12:38:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:14.030 12:38:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:15.985 12:38:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:15.985 00:24:15.985 real 1m31.636s 00:24:15.985 user 5m38.018s 00:24:15.985 sys 0m16.386s 00:24:15.985 12:38:09 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:15.985 12:38:09 -- common/autotest_common.sh@10 -- # set +x 00:24:15.985 ************************************ 00:24:15.985 END TEST nvmf_perf 00:24:15.985 ************************************ 00:24:15.985 12:38:09 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:15.985 12:38:09 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:15.985 12:38:09 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:15.985 12:38:09 -- common/autotest_common.sh@10 -- # set +x 00:24:15.985 ************************************ 00:24:15.985 START TEST nvmf_fio_host 00:24:15.985 ************************************ 00:24:15.985 12:38:09 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:15.985 * Looking for test storage... 00:24:15.985 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:15.985 12:38:09 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:15.985 12:38:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:15.985 12:38:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:15.985 12:38:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:15.985 12:38:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- paths/export.sh@5 -- # export PATH 00:24:15.985 12:38:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:15.985 12:38:09 -- nvmf/common.sh@7 -- # uname -s 00:24:15.985 12:38:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:15.985 12:38:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:15.985 12:38:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:15.985 12:38:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:15.985 12:38:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:15.985 12:38:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:15.985 12:38:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:15.985 12:38:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:15.985 12:38:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:15.985 12:38:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:15.985 12:38:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:15.985 12:38:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:15.985 12:38:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:15.985 12:38:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:15.985 12:38:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:15.985 12:38:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:15.985 12:38:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:15.985 12:38:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:15.985 12:38:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:15.985 12:38:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- paths/export.sh@5 -- # export PATH 00:24:15.985 12:38:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:15.985 12:38:09 -- nvmf/common.sh@46 -- # : 0 00:24:15.985 12:38:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:15.985 12:38:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:15.985 12:38:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:15.985 12:38:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:15.985 12:38:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:15.985 12:38:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:15.985 12:38:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:15.985 12:38:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:15.985 12:38:09 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:15.985 12:38:09 -- host/fio.sh@14 -- # nvmftestinit 00:24:15.985 12:38:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:15.985 12:38:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:15.985 12:38:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:15.985 12:38:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:15.985 12:38:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:15.985 12:38:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:15.986 12:38:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:15.986 12:38:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:15.986 12:38:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:15.986 12:38:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:15.986 12:38:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:15.986 12:38:09 -- common/autotest_common.sh@10 -- # set +x 00:24:17.890 12:38:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:17.890 12:38:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:17.890 12:38:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:17.890 12:38:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:17.890 12:38:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:17.890 12:38:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:17.890 12:38:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:17.890 12:38:11 -- nvmf/common.sh@294 -- # net_devs=() 00:24:17.890 12:38:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:17.890 12:38:11 -- nvmf/common.sh@295 -- # e810=() 00:24:17.890 12:38:11 -- nvmf/common.sh@295 -- # local -ga e810 00:24:17.890 12:38:11 -- nvmf/common.sh@296 -- # x722=() 00:24:17.890 12:38:11 -- nvmf/common.sh@296 -- # local -ga x722 00:24:17.890 12:38:11 -- nvmf/common.sh@297 -- # mlx=() 00:24:17.890 12:38:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:17.890 12:38:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:17.890 12:38:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:17.890 12:38:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:17.890 12:38:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:17.890 12:38:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:17.890 12:38:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:17.890 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:17.890 12:38:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:17.890 12:38:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:17.890 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:17.890 12:38:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:17.890 12:38:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:17.890 12:38:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:17.890 12:38:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:17.890 12:38:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:17.890 12:38:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:17.890 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:17.890 12:38:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:17.890 12:38:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:17.890 12:38:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:17.890 12:38:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:17.890 12:38:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:17.890 12:38:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:17.890 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:17.890 12:38:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:17.890 12:38:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:17.890 12:38:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:17.890 12:38:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:17.890 12:38:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:17.890 12:38:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:17.890 12:38:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:17.890 12:38:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:17.890 12:38:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:17.890 12:38:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:17.890 12:38:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:17.890 12:38:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:17.890 12:38:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:17.890 12:38:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:17.890 12:38:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:17.890 12:38:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:17.890 12:38:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:17.890 12:38:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:17.890 12:38:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:17.890 12:38:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:17.890 12:38:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:17.890 12:38:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:17.890 12:38:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:17.890 12:38:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:17.890 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:17.890 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:24:17.890 00:24:17.890 --- 10.0.0.2 ping statistics --- 00:24:17.890 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:17.890 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:24:17.890 12:38:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:17.890 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:17.890 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.093 ms 00:24:17.890 00:24:17.890 --- 10.0.0.1 ping statistics --- 00:24:17.890 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:17.890 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:24:17.890 12:38:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:17.890 12:38:11 -- nvmf/common.sh@410 -- # return 0 00:24:17.890 12:38:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:17.890 12:38:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:17.890 12:38:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:17.890 12:38:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:17.890 12:38:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:17.890 12:38:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:17.891 12:38:11 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:17.891 12:38:11 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:17.891 12:38:11 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:17.891 12:38:11 -- common/autotest_common.sh@10 -- # set +x 00:24:17.891 12:38:11 -- host/fio.sh@24 -- # nvmfpid=1358550 00:24:17.891 12:38:11 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:17.891 12:38:11 -- host/fio.sh@28 -- # waitforlisten 1358550 00:24:17.891 12:38:11 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:17.891 12:38:11 -- common/autotest_common.sh@819 -- # '[' -z 1358550 ']' 00:24:17.891 12:38:11 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:17.891 12:38:11 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:17.891 12:38:11 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:17.891 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:17.891 12:38:11 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:17.891 12:38:11 -- common/autotest_common.sh@10 -- # set +x 00:24:17.891 [2024-07-12 12:38:11.690716] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:24:17.891 [2024-07-12 12:38:11.690792] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:17.891 EAL: No free 2048 kB hugepages reported on node 1 00:24:17.891 [2024-07-12 12:38:11.759405] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:18.150 [2024-07-12 12:38:11.876635] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:18.150 [2024-07-12 12:38:11.876794] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:18.150 [2024-07-12 12:38:11.876814] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:18.150 [2024-07-12 12:38:11.876829] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:18.150 [2024-07-12 12:38:11.876932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:18.150 [2024-07-12 12:38:11.876998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:18.150 [2024-07-12 12:38:11.877046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:18.150 [2024-07-12 12:38:11.877049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:18.716 12:38:12 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:18.716 12:38:12 -- common/autotest_common.sh@852 -- # return 0 00:24:18.716 12:38:12 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:18.975 [2024-07-12 12:38:12.833916] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:18.975 12:38:12 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:18.975 12:38:12 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:18.975 12:38:12 -- common/autotest_common.sh@10 -- # set +x 00:24:18.975 12:38:12 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:19.232 Malloc1 00:24:19.232 12:38:13 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:19.490 12:38:13 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:19.747 12:38:13 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:20.005 [2024-07-12 12:38:13.822358] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:20.005 12:38:13 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:20.262 12:38:14 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:20.262 12:38:14 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:20.262 12:38:14 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:20.262 12:38:14 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:20.262 12:38:14 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:20.262 12:38:14 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:20.262 12:38:14 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:20.262 12:38:14 -- common/autotest_common.sh@1320 -- # shift 00:24:20.262 12:38:14 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:20.262 12:38:14 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:20.262 12:38:14 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:20.262 12:38:14 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:20.262 12:38:14 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:20.262 12:38:14 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:20.262 12:38:14 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:20.263 12:38:14 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:20.521 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:20.521 fio-3.35 00:24:20.521 Starting 1 thread 00:24:20.521 EAL: No free 2048 kB hugepages reported on node 1 00:24:23.056 00:24:23.056 test: (groupid=0, jobs=1): err= 0: pid=1359050: Fri Jul 12 12:38:16 2024 00:24:23.056 read: IOPS=9110, BW=35.6MiB/s (37.3MB/s)(71.4MiB/2006msec) 00:24:23.056 slat (nsec): min=1867, max=159673, avg=2529.56, stdev=1910.45 00:24:23.056 clat (usec): min=2974, max=12757, avg=7692.39, stdev=934.51 00:24:23.056 lat (usec): min=3001, max=12759, avg=7694.92, stdev=934.47 00:24:23.056 clat percentiles (usec): 00:24:23.056 | 1.00th=[ 6128], 5.00th=[ 6521], 10.00th=[ 6718], 20.00th=[ 6980], 00:24:23.056 | 30.00th=[ 7177], 40.00th=[ 7373], 50.00th=[ 7504], 60.00th=[ 7701], 00:24:23.056 | 70.00th=[ 7898], 80.00th=[ 8225], 90.00th=[ 9110], 95.00th=[ 9765], 00:24:23.056 | 99.00th=[10421], 99.50th=[10683], 99.90th=[11469], 99.95th=[11863], 00:24:23.056 | 99.99th=[12780] 00:24:23.056 bw ( KiB/s): min=30184, max=38976, per=99.90%, avg=36406.00, stdev=4162.85, samples=4 00:24:23.056 iops : min= 7546, max= 9744, avg=9101.50, stdev=1040.71, samples=4 00:24:23.056 write: IOPS=9121, BW=35.6MiB/s (37.4MB/s)(71.5MiB/2006msec); 0 zone resets 00:24:23.056 slat (nsec): min=1971, max=129955, avg=2605.10, stdev=1378.27 00:24:23.056 clat (usec): min=1401, max=11220, avg=6253.62, stdev=820.23 00:24:23.056 lat (usec): min=1410, max=11223, avg=6256.22, stdev=820.23 00:24:23.056 clat percentiles (usec): 00:24:23.056 | 1.00th=[ 4948], 5.00th=[ 5276], 10.00th=[ 5473], 20.00th=[ 5669], 00:24:23.056 | 30.00th=[ 5800], 40.00th=[ 5932], 50.00th=[ 6063], 60.00th=[ 6194], 00:24:23.056 | 70.00th=[ 6390], 80.00th=[ 6652], 90.00th=[ 7570], 95.00th=[ 8029], 00:24:23.056 | 99.00th=[ 8586], 99.50th=[ 8848], 99.90th=[ 9241], 99.95th=[ 9896], 00:24:23.056 | 99.99th=[10945] 00:24:23.056 bw ( KiB/s): min=31256, max=38400, per=100.00%, avg=36486.00, stdev=3491.99, samples=4 00:24:23.056 iops : min= 7814, max= 9600, avg=9121.50, stdev=873.00, samples=4 00:24:23.056 lat (msec) : 2=0.01%, 4=0.08%, 10=98.33%, 20=1.58% 00:24:23.056 cpu : usr=64.24%, sys=33.72%, ctx=103, majf=0, minf=5 00:24:23.056 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:23.056 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:23.056 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:23.056 issued rwts: total=18275,18298,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:23.056 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:23.056 00:24:23.056 Run status group 0 (all jobs): 00:24:23.056 READ: bw=35.6MiB/s (37.3MB/s), 35.6MiB/s-35.6MiB/s (37.3MB/s-37.3MB/s), io=71.4MiB (74.9MB), run=2006-2006msec 00:24:23.056 WRITE: bw=35.6MiB/s (37.4MB/s), 35.6MiB/s-35.6MiB/s (37.4MB/s-37.4MB/s), io=71.5MiB (74.9MB), run=2006-2006msec 00:24:23.056 12:38:16 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:23.056 12:38:16 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:23.056 12:38:16 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:23.056 12:38:16 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:23.056 12:38:16 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:23.056 12:38:16 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:23.056 12:38:16 -- common/autotest_common.sh@1320 -- # shift 00:24:23.056 12:38:16 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:23.056 12:38:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:23.056 12:38:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:23.056 12:38:16 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:23.056 12:38:16 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:23.056 12:38:16 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:23.056 12:38:16 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:23.056 12:38:16 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:24:23.056 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:24:23.056 fio-3.35 00:24:23.056 Starting 1 thread 00:24:23.056 EAL: No free 2048 kB hugepages reported on node 1 00:24:25.587 00:24:25.587 test: (groupid=0, jobs=1): err= 0: pid=1359392: Fri Jul 12 12:38:19 2024 00:24:25.587 read: IOPS=8482, BW=133MiB/s (139MB/s)(266MiB/2008msec) 00:24:25.587 slat (usec): min=2, max=138, avg= 3.76, stdev= 1.91 00:24:25.587 clat (usec): min=2954, max=15872, avg=8728.34, stdev=1990.79 00:24:25.587 lat (usec): min=2958, max=15878, avg=8732.11, stdev=1990.84 00:24:25.587 clat percentiles (usec): 00:24:25.587 | 1.00th=[ 4752], 5.00th=[ 5473], 10.00th=[ 6128], 20.00th=[ 6915], 00:24:25.587 | 30.00th=[ 7635], 40.00th=[ 8291], 50.00th=[ 8848], 60.00th=[ 9241], 00:24:25.587 | 70.00th=[ 9765], 80.00th=[10290], 90.00th=[11338], 95.00th=[12125], 00:24:25.587 | 99.00th=[13698], 99.50th=[14222], 99.90th=[15008], 99.95th=[15270], 00:24:25.587 | 99.99th=[15664] 00:24:25.587 bw ( KiB/s): min=57888, max=77952, per=51.18%, avg=69464.00, stdev=9769.26, samples=4 00:24:25.587 iops : min= 3618, max= 4872, avg=4341.50, stdev=610.58, samples=4 00:24:25.587 write: IOPS=4957, BW=77.5MiB/s (81.2MB/s)(142MiB/1838msec); 0 zone resets 00:24:25.587 slat (usec): min=30, max=190, avg=34.22, stdev= 5.96 00:24:25.587 clat (usec): min=4050, max=17797, avg=11245.77, stdev=2069.20 00:24:25.587 lat (usec): min=4087, max=17829, avg=11279.99, stdev=2069.48 00:24:25.587 clat percentiles (usec): 00:24:25.587 | 1.00th=[ 7373], 5.00th=[ 8291], 10.00th=[ 8848], 20.00th=[ 9372], 00:24:25.587 | 30.00th=[ 9896], 40.00th=[10421], 50.00th=[10945], 60.00th=[11600], 00:24:25.587 | 70.00th=[12256], 80.00th=[13173], 90.00th=[14222], 95.00th=[15008], 00:24:25.587 | 99.00th=[16057], 99.50th=[16450], 99.90th=[16909], 99.95th=[17433], 00:24:25.587 | 99.99th=[17695] 00:24:25.587 bw ( KiB/s): min=60416, max=80896, per=91.22%, avg=72360.00, stdev=9888.20, samples=4 00:24:25.587 iops : min= 3776, max= 5056, avg=4522.50, stdev=618.01, samples=4 00:24:25.587 lat (msec) : 4=0.12%, 10=60.27%, 20=39.60% 00:24:25.587 cpu : usr=78.24%, sys=20.27%, ctx=33, majf=0, minf=1 00:24:25.587 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:24:25.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:25.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:25.587 issued rwts: total=17032,9112,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:25.587 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:25.587 00:24:25.587 Run status group 0 (all jobs): 00:24:25.587 READ: bw=133MiB/s (139MB/s), 133MiB/s-133MiB/s (139MB/s-139MB/s), io=266MiB (279MB), run=2008-2008msec 00:24:25.587 WRITE: bw=77.5MiB/s (81.2MB/s), 77.5MiB/s-77.5MiB/s (81.2MB/s-81.2MB/s), io=142MiB (149MB), run=1838-1838msec 00:24:25.587 12:38:19 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:25.846 12:38:19 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:24:25.846 12:38:19 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:24:25.846 12:38:19 -- host/fio.sh@51 -- # get_nvme_bdfs 00:24:25.846 12:38:19 -- common/autotest_common.sh@1498 -- # bdfs=() 00:24:25.846 12:38:19 -- common/autotest_common.sh@1498 -- # local bdfs 00:24:25.846 12:38:19 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:24:25.846 12:38:19 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:24:25.846 12:38:19 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:24:25.846 12:38:19 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:24:25.846 12:38:19 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:24:25.846 12:38:19 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:24:29.136 Nvme0n1 00:24:29.136 12:38:22 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:24:31.667 12:38:25 -- host/fio.sh@53 -- # ls_guid=870bfce7-9e49-4d30-9f58-0b67d52d199e 00:24:31.667 12:38:25 -- host/fio.sh@54 -- # get_lvs_free_mb 870bfce7-9e49-4d30-9f58-0b67d52d199e 00:24:31.667 12:38:25 -- common/autotest_common.sh@1343 -- # local lvs_uuid=870bfce7-9e49-4d30-9f58-0b67d52d199e 00:24:31.667 12:38:25 -- common/autotest_common.sh@1344 -- # local lvs_info 00:24:31.667 12:38:25 -- common/autotest_common.sh@1345 -- # local fc 00:24:31.667 12:38:25 -- common/autotest_common.sh@1346 -- # local cs 00:24:31.667 12:38:25 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:32.232 12:38:25 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:24:32.232 { 00:24:32.232 "uuid": "870bfce7-9e49-4d30-9f58-0b67d52d199e", 00:24:32.232 "name": "lvs_0", 00:24:32.232 "base_bdev": "Nvme0n1", 00:24:32.232 "total_data_clusters": 930, 00:24:32.232 "free_clusters": 930, 00:24:32.232 "block_size": 512, 00:24:32.232 "cluster_size": 1073741824 00:24:32.232 } 00:24:32.232 ]' 00:24:32.232 12:38:25 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="870bfce7-9e49-4d30-9f58-0b67d52d199e") .free_clusters' 00:24:32.232 12:38:25 -- common/autotest_common.sh@1348 -- # fc=930 00:24:32.232 12:38:25 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="870bfce7-9e49-4d30-9f58-0b67d52d199e") .cluster_size' 00:24:32.232 12:38:25 -- common/autotest_common.sh@1349 -- # cs=1073741824 00:24:32.232 12:38:25 -- common/autotest_common.sh@1352 -- # free_mb=952320 00:24:32.232 12:38:25 -- common/autotest_common.sh@1353 -- # echo 952320 00:24:32.232 952320 00:24:32.232 12:38:25 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:24:32.490 17dce1d9-7210-46fb-ba7b-9ab9276116fb 00:24:32.490 12:38:26 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:24:32.748 12:38:26 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:24:33.006 12:38:26 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:33.264 12:38:27 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:33.264 12:38:27 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:33.264 12:38:27 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:33.264 12:38:27 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:33.264 12:38:27 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:33.264 12:38:27 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:33.264 12:38:27 -- common/autotest_common.sh@1320 -- # shift 00:24:33.264 12:38:27 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:33.264 12:38:27 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:33.264 12:38:27 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:33.264 12:38:27 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:33.264 12:38:27 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:33.264 12:38:27 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:33.264 12:38:27 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:33.264 12:38:27 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:33.523 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:33.523 fio-3.35 00:24:33.523 Starting 1 thread 00:24:33.523 EAL: No free 2048 kB hugepages reported on node 1 00:24:36.087 00:24:36.087 test: (groupid=0, jobs=1): err= 0: pid=1360788: Fri Jul 12 12:38:29 2024 00:24:36.087 read: IOPS=6289, BW=24.6MiB/s (25.8MB/s)(49.3MiB/2007msec) 00:24:36.087 slat (nsec): min=1909, max=178492, avg=2684.75, stdev=2651.24 00:24:36.087 clat (usec): min=1110, max=171014, avg=11198.02, stdev=11400.45 00:24:36.087 lat (usec): min=1113, max=171046, avg=11200.70, stdev=11400.80 00:24:36.087 clat percentiles (msec): 00:24:36.087 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:24:36.087 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:24:36.087 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:24:36.087 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:24:36.087 | 99.99th=[ 171] 00:24:36.087 bw ( KiB/s): min=17764, max=27672, per=99.78%, avg=25105.00, stdev=4896.39, samples=4 00:24:36.087 iops : min= 4441, max= 6918, avg=6276.25, stdev=1224.10, samples=4 00:24:36.087 write: IOPS=6278, BW=24.5MiB/s (25.7MB/s)(49.2MiB/2007msec); 0 zone resets 00:24:36.087 slat (usec): min=2, max=145, avg= 2.79, stdev= 2.09 00:24:36.087 clat (usec): min=320, max=169101, avg=9074.97, stdev=10688.60 00:24:36.087 lat (usec): min=324, max=169107, avg=9077.75, stdev=10688.92 00:24:36.087 clat percentiles (msec): 00:24:36.087 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:24:36.087 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:24:36.087 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:24:36.087 | 99.00th=[ 11], 99.50th=[ 14], 99.90th=[ 169], 99.95th=[ 169], 00:24:36.088 | 99.99th=[ 169] 00:24:36.088 bw ( KiB/s): min=18818, max=27496, per=99.83%, avg=25072.50, stdev=4176.69, samples=4 00:24:36.088 iops : min= 4704, max= 6874, avg=6268.00, stdev=1044.42, samples=4 00:24:36.088 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:24:36.088 lat (msec) : 2=0.03%, 4=0.15%, 10=65.15%, 20=34.14%, 250=0.51% 00:24:36.088 cpu : usr=54.44%, sys=43.82%, ctx=72, majf=0, minf=5 00:24:36.088 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:24:36.088 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:36.088 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:36.088 issued rwts: total=12624,12601,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:36.088 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:36.088 00:24:36.088 Run status group 0 (all jobs): 00:24:36.088 READ: bw=24.6MiB/s (25.8MB/s), 24.6MiB/s-24.6MiB/s (25.8MB/s-25.8MB/s), io=49.3MiB (51.7MB), run=2007-2007msec 00:24:36.088 WRITE: bw=24.5MiB/s (25.7MB/s), 24.5MiB/s-24.5MiB/s (25.7MB/s-25.7MB/s), io=49.2MiB (51.6MB), run=2007-2007msec 00:24:36.088 12:38:29 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:36.346 12:38:30 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:24:37.282 12:38:31 -- host/fio.sh@64 -- # ls_nested_guid=a395bf3c-c0d4-4471-b1ab-2b7286e81f70 00:24:37.282 12:38:31 -- host/fio.sh@65 -- # get_lvs_free_mb a395bf3c-c0d4-4471-b1ab-2b7286e81f70 00:24:37.282 12:38:31 -- common/autotest_common.sh@1343 -- # local lvs_uuid=a395bf3c-c0d4-4471-b1ab-2b7286e81f70 00:24:37.282 12:38:31 -- common/autotest_common.sh@1344 -- # local lvs_info 00:24:37.282 12:38:31 -- common/autotest_common.sh@1345 -- # local fc 00:24:37.282 12:38:31 -- common/autotest_common.sh@1346 -- # local cs 00:24:37.282 12:38:31 -- common/autotest_common.sh@1347 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:24:37.540 12:38:31 -- common/autotest_common.sh@1347 -- # lvs_info='[ 00:24:37.540 { 00:24:37.540 "uuid": "870bfce7-9e49-4d30-9f58-0b67d52d199e", 00:24:37.540 "name": "lvs_0", 00:24:37.540 "base_bdev": "Nvme0n1", 00:24:37.540 "total_data_clusters": 930, 00:24:37.540 "free_clusters": 0, 00:24:37.540 "block_size": 512, 00:24:37.540 "cluster_size": 1073741824 00:24:37.540 }, 00:24:37.540 { 00:24:37.540 "uuid": "a395bf3c-c0d4-4471-b1ab-2b7286e81f70", 00:24:37.540 "name": "lvs_n_0", 00:24:37.540 "base_bdev": "17dce1d9-7210-46fb-ba7b-9ab9276116fb", 00:24:37.540 "total_data_clusters": 237847, 00:24:37.540 "free_clusters": 237847, 00:24:37.540 "block_size": 512, 00:24:37.540 "cluster_size": 4194304 00:24:37.540 } 00:24:37.540 ]' 00:24:37.540 12:38:31 -- common/autotest_common.sh@1348 -- # jq '.[] | select(.uuid=="a395bf3c-c0d4-4471-b1ab-2b7286e81f70") .free_clusters' 00:24:37.540 12:38:31 -- common/autotest_common.sh@1348 -- # fc=237847 00:24:37.540 12:38:31 -- common/autotest_common.sh@1349 -- # jq '.[] | select(.uuid=="a395bf3c-c0d4-4471-b1ab-2b7286e81f70") .cluster_size' 00:24:37.798 12:38:31 -- common/autotest_common.sh@1349 -- # cs=4194304 00:24:37.798 12:38:31 -- common/autotest_common.sh@1352 -- # free_mb=951388 00:24:37.798 12:38:31 -- common/autotest_common.sh@1353 -- # echo 951388 00:24:37.798 951388 00:24:37.798 12:38:31 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:24:38.364 f7a739e8-05ff-44be-a517-552591fbd2e1 00:24:38.364 12:38:32 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:24:38.622 12:38:32 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:24:38.880 12:38:32 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:24:39.138 12:38:32 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:39.138 12:38:32 -- common/autotest_common.sh@1339 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:39.138 12:38:32 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:24:39.138 12:38:32 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:39.138 12:38:32 -- common/autotest_common.sh@1318 -- # local sanitizers 00:24:39.138 12:38:32 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:39.138 12:38:32 -- common/autotest_common.sh@1320 -- # shift 00:24:39.138 12:38:32 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:24:39.138 12:38:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # grep libasan 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:39.138 12:38:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:39.138 12:38:32 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:24:39.138 12:38:32 -- common/autotest_common.sh@1324 -- # asan_lib= 00:24:39.138 12:38:32 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:24:39.138 12:38:32 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:39.138 12:38:32 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:39.401 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:39.401 fio-3.35 00:24:39.401 Starting 1 thread 00:24:39.401 EAL: No free 2048 kB hugepages reported on node 1 00:24:41.926 00:24:41.926 test: (groupid=0, jobs=1): err= 0: pid=1361594: Fri Jul 12 12:38:35 2024 00:24:41.926 read: IOPS=5668, BW=22.1MiB/s (23.2MB/s)(44.5MiB/2009msec) 00:24:41.926 slat (nsec): min=1958, max=122474, avg=2544.93, stdev=1870.60 00:24:41.926 clat (usec): min=4673, max=20209, avg=12456.26, stdev=1110.16 00:24:41.926 lat (usec): min=4678, max=20211, avg=12458.81, stdev=1110.10 00:24:41.926 clat percentiles (usec): 00:24:41.926 | 1.00th=[ 9896], 5.00th=[10683], 10.00th=[11076], 20.00th=[11600], 00:24:41.926 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12387], 60.00th=[12780], 00:24:41.926 | 70.00th=[13042], 80.00th=[13435], 90.00th=[13829], 95.00th=[14091], 00:24:41.926 | 99.00th=[14877], 99.50th=[15139], 99.90th=[18482], 99.95th=[18744], 00:24:41.926 | 99.99th=[20055] 00:24:41.926 bw ( KiB/s): min=21456, max=23152, per=99.87%, avg=22644.00, stdev=800.47, samples=4 00:24:41.926 iops : min= 5364, max= 5788, avg=5661.00, stdev=200.12, samples=4 00:24:41.926 write: IOPS=5639, BW=22.0MiB/s (23.1MB/s)(44.3MiB/2009msec); 0 zone resets 00:24:41.926 slat (nsec): min=2056, max=91515, avg=2634.69, stdev=1367.03 00:24:41.926 clat (usec): min=2211, max=18780, avg=10016.76, stdev=954.95 00:24:41.926 lat (usec): min=2217, max=18783, avg=10019.40, stdev=954.92 00:24:41.926 clat percentiles (usec): 00:24:41.926 | 1.00th=[ 7898], 5.00th=[ 8586], 10.00th=[ 8979], 20.00th=[ 9241], 00:24:41.926 | 30.00th=[ 9634], 40.00th=[ 9765], 50.00th=[10028], 60.00th=[10159], 00:24:41.926 | 70.00th=[10421], 80.00th=[10683], 90.00th=[11076], 95.00th=[11469], 00:24:41.926 | 99.00th=[12125], 99.50th=[12518], 99.90th=[17171], 99.95th=[18482], 00:24:41.926 | 99.99th=[18744] 00:24:41.926 bw ( KiB/s): min=22400, max=22784, per=99.91%, avg=22536.00, stdev=169.71, samples=4 00:24:41.926 iops : min= 5600, max= 5696, avg=5634.00, stdev=42.43, samples=4 00:24:41.926 lat (msec) : 4=0.05%, 10=25.28%, 20=74.67%, 50=0.01% 00:24:41.926 cpu : usr=60.56%, sys=37.80%, ctx=61, majf=0, minf=5 00:24:41.926 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:24:41.926 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:41.926 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:24:41.926 issued rwts: total=11388,11329,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:41.926 latency : target=0, window=0, percentile=100.00%, depth=128 00:24:41.926 00:24:41.926 Run status group 0 (all jobs): 00:24:41.926 READ: bw=22.1MiB/s (23.2MB/s), 22.1MiB/s-22.1MiB/s (23.2MB/s-23.2MB/s), io=44.5MiB (46.6MB), run=2009-2009msec 00:24:41.926 WRITE: bw=22.0MiB/s (23.1MB/s), 22.0MiB/s-22.0MiB/s (23.1MB/s-23.1MB/s), io=44.3MiB (46.4MB), run=2009-2009msec 00:24:41.926 12:38:35 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:24:41.926 12:38:35 -- host/fio.sh@74 -- # sync 00:24:41.926 12:38:35 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_n_0/lbd_nest_0 00:24:46.113 12:38:39 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:46.113 12:38:39 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:24:49.395 12:38:42 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:49.395 12:38:42 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:24:51.293 12:38:44 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:24:51.293 12:38:44 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:24:51.293 12:38:44 -- host/fio.sh@86 -- # nvmftestfini 00:24:51.293 12:38:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:51.293 12:38:44 -- nvmf/common.sh@116 -- # sync 00:24:51.293 12:38:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:51.293 12:38:44 -- nvmf/common.sh@119 -- # set +e 00:24:51.293 12:38:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:51.293 12:38:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:51.293 rmmod nvme_tcp 00:24:51.293 rmmod nvme_fabrics 00:24:51.293 rmmod nvme_keyring 00:24:51.293 12:38:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:51.293 12:38:44 -- nvmf/common.sh@123 -- # set -e 00:24:51.293 12:38:44 -- nvmf/common.sh@124 -- # return 0 00:24:51.293 12:38:44 -- nvmf/common.sh@477 -- # '[' -n 1358550 ']' 00:24:51.293 12:38:44 -- nvmf/common.sh@478 -- # killprocess 1358550 00:24:51.293 12:38:44 -- common/autotest_common.sh@926 -- # '[' -z 1358550 ']' 00:24:51.293 12:38:44 -- common/autotest_common.sh@930 -- # kill -0 1358550 00:24:51.293 12:38:44 -- common/autotest_common.sh@931 -- # uname 00:24:51.293 12:38:44 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:24:51.293 12:38:44 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1358550 00:24:51.293 12:38:44 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:24:51.293 12:38:44 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:24:51.293 12:38:44 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1358550' 00:24:51.293 killing process with pid 1358550 00:24:51.293 12:38:44 -- common/autotest_common.sh@945 -- # kill 1358550 00:24:51.293 12:38:44 -- common/autotest_common.sh@950 -- # wait 1358550 00:24:51.293 12:38:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:51.293 12:38:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:51.293 12:38:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:51.293 12:38:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:51.293 12:38:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:51.293 12:38:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:51.293 12:38:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:51.293 12:38:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.833 12:38:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:53.833 00:24:53.833 real 0m37.666s 00:24:53.833 user 2m24.727s 00:24:53.833 sys 0m7.047s 00:24:53.833 12:38:47 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:24:53.833 12:38:47 -- common/autotest_common.sh@10 -- # set +x 00:24:53.833 ************************************ 00:24:53.833 END TEST nvmf_fio_host 00:24:53.833 ************************************ 00:24:53.833 12:38:47 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:53.833 12:38:47 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:24:53.833 12:38:47 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:24:53.833 12:38:47 -- common/autotest_common.sh@10 -- # set +x 00:24:53.833 ************************************ 00:24:53.833 START TEST nvmf_failover 00:24:53.833 ************************************ 00:24:53.833 12:38:47 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:24:53.833 * Looking for test storage... 00:24:53.833 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:53.833 12:38:47 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:53.833 12:38:47 -- nvmf/common.sh@7 -- # uname -s 00:24:53.833 12:38:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:53.833 12:38:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:53.833 12:38:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:53.833 12:38:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:53.833 12:38:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:53.833 12:38:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:53.833 12:38:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:53.833 12:38:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:53.833 12:38:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:53.833 12:38:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:53.833 12:38:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:53.833 12:38:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:53.833 12:38:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:53.833 12:38:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:53.833 12:38:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:53.833 12:38:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:53.833 12:38:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:53.833 12:38:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:53.833 12:38:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:53.833 12:38:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.833 12:38:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.834 12:38:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.834 12:38:47 -- paths/export.sh@5 -- # export PATH 00:24:53.834 12:38:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:53.834 12:38:47 -- nvmf/common.sh@46 -- # : 0 00:24:53.834 12:38:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:53.834 12:38:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:53.834 12:38:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:53.834 12:38:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:53.834 12:38:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:53.834 12:38:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:53.834 12:38:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:53.834 12:38:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:53.834 12:38:47 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:53.834 12:38:47 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:53.834 12:38:47 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:53.834 12:38:47 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:53.834 12:38:47 -- host/failover.sh@18 -- # nvmftestinit 00:24:53.834 12:38:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:53.834 12:38:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:53.834 12:38:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:53.834 12:38:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:53.834 12:38:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:53.834 12:38:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:53.834 12:38:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:53.834 12:38:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:53.834 12:38:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:53.834 12:38:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:53.834 12:38:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:53.834 12:38:47 -- common/autotest_common.sh@10 -- # set +x 00:24:55.739 12:38:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:55.739 12:38:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:55.739 12:38:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:55.739 12:38:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:55.739 12:38:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:55.739 12:38:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:55.739 12:38:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:55.739 12:38:49 -- nvmf/common.sh@294 -- # net_devs=() 00:24:55.739 12:38:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:55.739 12:38:49 -- nvmf/common.sh@295 -- # e810=() 00:24:55.739 12:38:49 -- nvmf/common.sh@295 -- # local -ga e810 00:24:55.739 12:38:49 -- nvmf/common.sh@296 -- # x722=() 00:24:55.739 12:38:49 -- nvmf/common.sh@296 -- # local -ga x722 00:24:55.739 12:38:49 -- nvmf/common.sh@297 -- # mlx=() 00:24:55.739 12:38:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:55.739 12:38:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:55.739 12:38:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:55.739 12:38:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:55.739 12:38:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:55.739 12:38:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:55.739 12:38:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:55.739 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:55.739 12:38:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:55.739 12:38:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:55.739 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:55.739 12:38:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:55.739 12:38:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:55.739 12:38:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:55.739 12:38:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:55.739 12:38:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:55.739 12:38:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:55.739 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:55.739 12:38:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:55.739 12:38:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:55.739 12:38:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:55.739 12:38:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:55.739 12:38:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:55.739 12:38:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:55.739 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:55.739 12:38:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:55.739 12:38:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:55.739 12:38:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:55.739 12:38:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:55.739 12:38:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:55.739 12:38:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:55.739 12:38:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:55.739 12:38:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:55.739 12:38:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:55.739 12:38:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:55.739 12:38:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:55.739 12:38:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:55.739 12:38:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:55.739 12:38:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:55.739 12:38:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:55.739 12:38:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:55.739 12:38:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:55.739 12:38:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:55.739 12:38:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:55.739 12:38:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:55.739 12:38:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:55.739 12:38:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:55.739 12:38:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:55.739 12:38:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:55.739 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:55.739 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:24:55.739 00:24:55.739 --- 10.0.0.2 ping statistics --- 00:24:55.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:55.739 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:24:55.739 12:38:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:55.739 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:55.739 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:24:55.739 00:24:55.739 --- 10.0.0.1 ping statistics --- 00:24:55.739 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:55.739 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:24:55.739 12:38:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:55.739 12:38:49 -- nvmf/common.sh@410 -- # return 0 00:24:55.739 12:38:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:55.739 12:38:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:55.739 12:38:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:55.739 12:38:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:55.739 12:38:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:55.739 12:38:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:55.739 12:38:49 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:24:55.739 12:38:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:55.739 12:38:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:24:55.739 12:38:49 -- common/autotest_common.sh@10 -- # set +x 00:24:55.739 12:38:49 -- nvmf/common.sh@469 -- # nvmfpid=1364889 00:24:55.739 12:38:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:55.739 12:38:49 -- nvmf/common.sh@470 -- # waitforlisten 1364889 00:24:55.739 12:38:49 -- common/autotest_common.sh@819 -- # '[' -z 1364889 ']' 00:24:55.739 12:38:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:55.739 12:38:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:55.739 12:38:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:55.739 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:55.739 12:38:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:55.739 12:38:49 -- common/autotest_common.sh@10 -- # set +x 00:24:55.739 [2024-07-12 12:38:49.381640] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:24:55.739 [2024-07-12 12:38:49.381721] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:55.739 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.739 [2024-07-12 12:38:49.442772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:55.739 [2024-07-12 12:38:49.545049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:55.739 [2024-07-12 12:38:49.545203] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:55.739 [2024-07-12 12:38:49.545220] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:55.739 [2024-07-12 12:38:49.545232] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:55.740 [2024-07-12 12:38:49.545318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:55.740 [2024-07-12 12:38:49.545382] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:55.740 [2024-07-12 12:38:49.545385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:56.674 12:38:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:56.674 12:38:50 -- common/autotest_common.sh@852 -- # return 0 00:24:56.674 12:38:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:56.674 12:38:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:24:56.674 12:38:50 -- common/autotest_common.sh@10 -- # set +x 00:24:56.674 12:38:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:56.674 12:38:50 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:56.933 [2024-07-12 12:38:50.608888] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:56.933 12:38:50 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:24:57.191 Malloc0 00:24:57.191 12:38:50 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:57.449 12:38:51 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:57.708 12:38:51 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:57.708 [2024-07-12 12:38:51.600944] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:57.708 12:38:51 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:57.966 [2024-07-12 12:38:51.829632] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:57.966 12:38:51 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:24:58.225 [2024-07-12 12:38:52.058398] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:24:58.225 12:38:52 -- host/failover.sh@31 -- # bdevperf_pid=1365188 00:24:58.225 12:38:52 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:24:58.225 12:38:52 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:58.225 12:38:52 -- host/failover.sh@34 -- # waitforlisten 1365188 /var/tmp/bdevperf.sock 00:24:58.225 12:38:52 -- common/autotest_common.sh@819 -- # '[' -z 1365188 ']' 00:24:58.225 12:38:52 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:58.225 12:38:52 -- common/autotest_common.sh@824 -- # local max_retries=100 00:24:58.225 12:38:52 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:58.225 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:58.225 12:38:52 -- common/autotest_common.sh@828 -- # xtrace_disable 00:24:58.225 12:38:52 -- common/autotest_common.sh@10 -- # set +x 00:24:59.198 12:38:53 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:24:59.198 12:38:53 -- common/autotest_common.sh@852 -- # return 0 00:24:59.198 12:38:53 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:59.763 NVMe0n1 00:24:59.763 12:38:53 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:00.019 00:25:00.019 12:38:53 -- host/failover.sh@39 -- # run_test_pid=1365464 00:25:00.019 12:38:53 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:00.019 12:38:53 -- host/failover.sh@41 -- # sleep 1 00:25:00.953 12:38:54 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:01.213 [2024-07-12 12:38:55.058081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.213 [2024-07-12 12:38:55.058159] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.213 [2024-07-12 12:38:55.058202] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.213 [2024-07-12 12:38:55.058215] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.213 [2024-07-12 12:38:55.058228] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058255] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058267] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058279] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058290] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058302] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058314] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058325] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058337] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058349] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058407] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058418] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058441] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058476] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058501] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058524] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058539] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058551] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058563] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058575] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058586] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058598] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058610] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058622] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058633] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058646] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058657] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058669] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058681] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058693] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058704] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058716] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058728] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058751] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058763] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058775] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058787] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058798] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058825] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058838] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058850] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058862] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058887] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058900] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058913] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058925] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058937] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058949] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058961] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058974] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058986] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.058998] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.059011] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.059023] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 [2024-07-12 12:38:55.059036] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186b370 is same with the state(5) to be set 00:25:01.214 12:38:55 -- host/failover.sh@45 -- # sleep 3 00:25:04.504 12:38:58 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:04.504 00:25:04.504 12:38:58 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:04.765 [2024-07-12 12:38:58.605928] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.605992] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606007] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606020] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606032] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606044] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606056] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606068] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606081] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606093] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606105] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606127] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606139] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606151] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606163] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606175] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606187] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606199] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606211] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606223] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606251] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606263] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606274] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606286] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606297] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606309] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606321] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606332] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606343] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606355] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606366] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606378] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606389] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606400] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606413] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606424] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606436] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606447] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606462] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606474] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606486] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606497] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606509] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606520] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606532] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606544] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606555] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606567] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606579] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606590] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606602] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606613] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606640] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606653] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606665] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606677] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606689] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606702] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606715] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606727] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 [2024-07-12 12:38:58.606739] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x186bb80 is same with the state(5) to be set 00:25:04.765 12:38:58 -- host/failover.sh@50 -- # sleep 3 00:25:08.047 12:39:01 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:08.047 [2024-07-12 12:39:01.861823] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:08.047 12:39:01 -- host/failover.sh@55 -- # sleep 1 00:25:08.984 12:39:02 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:09.241 [2024-07-12 12:39:03.155815] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155873] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155891] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155909] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155922] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155934] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155946] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155958] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155970] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155982] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.155994] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156006] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156018] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156030] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156042] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156054] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156066] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156078] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156090] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156101] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156113] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156125] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156146] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156158] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156170] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156196] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156219] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156230] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156246] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156258] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156269] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156281] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156292] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156303] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156315] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156326] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156338] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156349] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156360] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156372] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156384] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156395] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156407] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156419] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156430] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156442] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156453] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156465] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156477] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156489] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156500] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156512] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.241 [2024-07-12 12:39:03.156523] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16162f0 is same with the state(5) to be set 00:25:09.498 12:39:03 -- host/failover.sh@59 -- # wait 1365464 00:25:16.074 0 00:25:16.074 12:39:09 -- host/failover.sh@61 -- # killprocess 1365188 00:25:16.074 12:39:09 -- common/autotest_common.sh@926 -- # '[' -z 1365188 ']' 00:25:16.074 12:39:09 -- common/autotest_common.sh@930 -- # kill -0 1365188 00:25:16.074 12:39:09 -- common/autotest_common.sh@931 -- # uname 00:25:16.074 12:39:09 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:16.074 12:39:09 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1365188 00:25:16.074 12:39:09 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:16.074 12:39:09 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:16.074 12:39:09 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1365188' 00:25:16.074 killing process with pid 1365188 00:25:16.074 12:39:09 -- common/autotest_common.sh@945 -- # kill 1365188 00:25:16.074 12:39:09 -- common/autotest_common.sh@950 -- # wait 1365188 00:25:16.074 12:39:09 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:16.074 [2024-07-12 12:38:52.114985] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:16.074 [2024-07-12 12:38:52.115063] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1365188 ] 00:25:16.074 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.074 [2024-07-12 12:38:52.175231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:16.074 [2024-07-12 12:38:52.282519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:16.074 Running I/O for 15 seconds... 00:25:16.074 [2024-07-12 12:38:55.059347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:114064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:114096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:114112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:114120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:114128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:114136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:114144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:114160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:114168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:114184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:114192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:114200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.074 [2024-07-12 12:38:55.059759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:114208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.074 [2024-07-12 12:38:55.059787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:114216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.074 [2024-07-12 12:38:55.059816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:114224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.074 [2024-07-12 12:38:55.059843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:114232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:114240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:114248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.059958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.059973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:114256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.074 [2024-07-12 12:38:55.059987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:113576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:113592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:113600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:113616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:113664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:113672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.074 [2024-07-12 12:38:55.060198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:113680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.074 [2024-07-12 12:38:55.060211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:113696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:114264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:114272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:114280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:114288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:114296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:114304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:114312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:114320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:114328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:114336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:114344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:114352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:114360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:114368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:114376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:114384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:114392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:114400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.060775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:113704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:113712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:113752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:113768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:113784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:113792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.060983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:113800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.060997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:113816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:114408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.061055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:114416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.061083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:114424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.061112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:114432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.061140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:114440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.061169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:114448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:114456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:114464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.075 [2024-07-12 12:38:55.061255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:113840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:113872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:113912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:113928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:113944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:113992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:114000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.075 [2024-07-12 12:38:55.061466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.075 [2024-07-12 12:38:55.061481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:114024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:114472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:114480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:114488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:114496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:114504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:114512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:114520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:114528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:114536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:114544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:114552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:114560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:114568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:114576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.061922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:114584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:114592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.061980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.061995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:114600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:114608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:114616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:114624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:114632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:114640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:114648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:114656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:114664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:114672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:114680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:114688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:114696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:114704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:114712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:114720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:114728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:114736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:114744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:114752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:114760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:114768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:114776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:114784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.076 [2024-07-12 12:38:55.062680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:114792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.076 [2024-07-12 12:38:55.062724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:114800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.076 [2024-07-12 12:38:55.062737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:114808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.077 [2024-07-12 12:38:55.062769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:114816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.062799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:114824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.062828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:114832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.062857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:114840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.062894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:114848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.062924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:114856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.077 [2024-07-12 12:38:55.062953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:114864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.062982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.062997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:114872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:114048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:114056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:114072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:114080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:114088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:114104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:55.063219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab4600 is same with the state(5) to be set 00:25:16.077 [2024-07-12 12:38:55.063250] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:16.077 [2024-07-12 12:38:55.063261] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:16.077 [2024-07-12 12:38:55.063273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114176 len:8 PRP1 0x0 PRP2 0x0 00:25:16.077 [2024-07-12 12:38:55.063286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063349] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ab4600 was disconnected and freed. reset controller. 00:25:16.077 [2024-07-12 12:38:55.063376] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:16.077 [2024-07-12 12:38:55.063409] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:55.063428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:55.063457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:55.063484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:55.063510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:55.063523] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:16.077 [2024-07-12 12:38:55.065687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:16.077 [2024-07-12 12:38:55.065725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a95bd0 (9): Bad file descriptor 00:25:16.077 [2024-07-12 12:38:55.172319] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:16.077 [2024-07-12 12:38:58.606599] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:58.606655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606679] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:58.606694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606709] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:58.606723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606737] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.077 [2024-07-12 12:38:58.606750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a95bd0 is same with the state(5) to be set 00:25:16.077 [2024-07-12 12:38:58.606878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:129104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.606901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:129120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.606942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:129128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.606974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.606990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:129144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:129152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:129160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:129184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:129192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:129200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:129208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:129216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:129224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:129232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.077 [2024-07-12 12:38:58.607288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.077 [2024-07-12 12:38:58.607303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:129240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:129256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:129264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:129288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:129312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:129320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:129328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:129336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:129344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:129352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:129376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:129384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:129392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:129400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:129408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:129416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:128680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:128696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:128712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:128720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:128736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:128752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:128760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.607979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.607995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:128768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.608009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:129448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:129456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:129464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:129472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.608126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:129480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.608163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:129488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.078 [2024-07-12 12:38:58.608206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:129496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:129504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:129512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:129520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.078 [2024-07-12 12:38:58.608335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:129528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.078 [2024-07-12 12:38:58.608348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:129536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:129544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:128784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:128800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:128856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:128864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:128880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:128904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:128912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:128928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:129552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:129560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:129568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:129576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:129584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:129592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:129600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:129608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:129616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:129624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:129632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.608964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.608979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:129640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.608993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:129648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:129656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.609051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:129664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.609084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:129672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:129688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:129696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:129704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:129712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.609272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:129720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:128952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:128960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:128976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:128992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:129000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:129024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:129040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:129064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:129728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.079 [2024-07-12 12:38:58.609556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:129736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.079 [2024-07-12 12:38:58.609584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.079 [2024-07-12 12:38:58.609599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:129744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.609612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:129752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.609640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:129760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:129768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:129776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:129088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:129096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:129112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:129136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:129168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:129176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:129248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:129272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.609980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.609996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:129784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:129792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:129800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:129808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:129816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:129824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:129832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:129840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:129848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:129856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:129864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:129872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:129880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:129888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:129896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:129904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:129912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.080 [2024-07-12 12:38:58.610485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:129280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:129296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:129304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:129360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:129368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:129424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:129432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.080 [2024-07-12 12:38:58.610691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aa2050 is same with the state(5) to be set 00:25:16.080 [2024-07-12 12:38:58.610721] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:16.080 [2024-07-12 12:38:58.610732] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:16.080 [2024-07-12 12:38:58.610743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129440 len:8 PRP1 0x0 PRP2 0x0 00:25:16.080 [2024-07-12 12:38:58.610756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.080 [2024-07-12 12:38:58.610833] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1aa2050 was disconnected and freed. reset controller. 00:25:16.080 [2024-07-12 12:38:58.610853] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:16.080 [2024-07-12 12:38:58.610876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:16.080 [2024-07-12 12:38:58.613061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:16.080 [2024-07-12 12:38:58.613103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a95bd0 (9): Bad file descriptor 00:25:16.080 [2024-07-12 12:38:58.691363] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:16.080 [2024-07-12 12:39:03.155292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.080 [2024-07-12 12:39:03.155358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.155386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.081 [2024-07-12 12:39:03.155400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.155414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.081 [2024-07-12 12:39:03.155427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.155441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:16.081 [2024-07-12 12:39:03.155464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.155478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a95bd0 is same with the state(5) to be set 00:25:16.081 [2024-07-12 12:39:03.156618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:105496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:105512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:105528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:105552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:105560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:104776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:104808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:104816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:104832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:104856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.156974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:104864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.156988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:104904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:104920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:104936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:104944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:104952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:104976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:104992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:105000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:105008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:105024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:105616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:105624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:105632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:105640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:105648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:105656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:105672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:105680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:105688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:105720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:105728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:105736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:105744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:105752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.081 [2024-07-12 12:39:03.157704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:105760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:105768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:105056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:105072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.081 [2024-07-12 12:39:03.157822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.081 [2024-07-12 12:39:03.157844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:105088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.157857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.157909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:105096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.157925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.157941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:105112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.157960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.157988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:105136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:105168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:105184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:105776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:105784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:105792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:105800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:105808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:105816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:105824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:105192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:105200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:105208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:105216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:105240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:105280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:105304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:105312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:105832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:105840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:105848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:105856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:105864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:105872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:105880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:105888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.082 [2024-07-12 12:39:03.158814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:105896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:105320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:105328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:105344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.158976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:105360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.158990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.159005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:105400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.159019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.159034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:105408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.082 [2024-07-12 12:39:03.159051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.082 [2024-07-12 12:39:03.159067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:105424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:105448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:105904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:105912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:105920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:105928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:105936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:105944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:105952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:105960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:105968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:105976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:105984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:105992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:106000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:106008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:106016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:106024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:106032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:106040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:106048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:106056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:106064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:106072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.159882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:106080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:105480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:105488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.159975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.159991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:105504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:105520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:105536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:105544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:105568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:105576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:106088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:106096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:106104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.160257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:106112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.160287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:106120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:106128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:106136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:106144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.160421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:106152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.083 [2024-07-12 12:39:03.160450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.083 [2024-07-12 12:39:03.160465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:106160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.083 [2024-07-12 12:39:03.160486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:106168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.084 [2024-07-12 12:39:03.160526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:106176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:16.084 [2024-07-12 12:39:03.160555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:105584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:105592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:105600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:105608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:105664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:105696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:105704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:16.084 [2024-07-12 12:39:03.160770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac2540 is same with the state(5) to be set 00:25:16.084 [2024-07-12 12:39:03.160801] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:16.084 [2024-07-12 12:39:03.160812] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:16.084 [2024-07-12 12:39:03.160840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:105712 len:8 PRP1 0x0 PRP2 0x0 00:25:16.084 [2024-07-12 12:39:03.160853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:16.084 [2024-07-12 12:39:03.160929] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ac2540 was disconnected and freed. reset controller. 00:25:16.084 [2024-07-12 12:39:03.160949] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:16.084 [2024-07-12 12:39:03.160964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:16.084 [2024-07-12 12:39:03.163240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:16.084 [2024-07-12 12:39:03.163284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a95bd0 (9): Bad file descriptor 00:25:16.084 [2024-07-12 12:39:03.237564] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:16.084 00:25:16.084 Latency(us) 00:25:16.084 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:16.084 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:16.084 Verification LBA range: start 0x0 length 0x4000 00:25:16.084 NVMe0n1 : 15.01 12814.93 50.06 994.04 0.00 9252.04 670.53 17185.00 00:25:16.084 =================================================================================================================== 00:25:16.084 Total : 12814.93 50.06 994.04 0.00 9252.04 670.53 17185.00 00:25:16.084 Received shutdown signal, test time was about 15.000000 seconds 00:25:16.084 00:25:16.084 Latency(us) 00:25:16.084 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:16.084 =================================================================================================================== 00:25:16.084 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:16.084 12:39:09 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:16.084 12:39:09 -- host/failover.sh@65 -- # count=3 00:25:16.084 12:39:09 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:16.084 12:39:09 -- host/failover.sh@73 -- # bdevperf_pid=1367864 00:25:16.084 12:39:09 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:16.084 12:39:09 -- host/failover.sh@75 -- # waitforlisten 1367864 /var/tmp/bdevperf.sock 00:25:16.084 12:39:09 -- common/autotest_common.sh@819 -- # '[' -z 1367864 ']' 00:25:16.084 12:39:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:16.084 12:39:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:16.084 12:39:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:16.084 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:16.084 12:39:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:16.084 12:39:09 -- common/autotest_common.sh@10 -- # set +x 00:25:16.343 12:39:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:16.343 12:39:10 -- common/autotest_common.sh@852 -- # return 0 00:25:16.343 12:39:10 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:16.601 [2024-07-12 12:39:10.479801] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:16.601 12:39:10 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:16.859 [2024-07-12 12:39:10.716482] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:16.859 12:39:10 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:17.426 NVMe0n1 00:25:17.426 12:39:11 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:17.684 00:25:17.684 12:39:11 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:17.941 00:25:17.941 12:39:11 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:17.941 12:39:11 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:18.199 12:39:12 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:18.457 12:39:12 -- host/failover.sh@87 -- # sleep 3 00:25:21.741 12:39:15 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:21.741 12:39:15 -- host/failover.sh@88 -- # grep -q NVMe0 00:25:21.741 12:39:15 -- host/failover.sh@90 -- # run_test_pid=1368683 00:25:21.741 12:39:15 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:21.741 12:39:15 -- host/failover.sh@92 -- # wait 1368683 00:25:22.723 0 00:25:22.723 12:39:16 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:22.723 [2024-07-12 12:39:09.318909] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:22.723 [2024-07-12 12:39:09.318998] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1367864 ] 00:25:22.723 EAL: No free 2048 kB hugepages reported on node 1 00:25:22.723 [2024-07-12 12:39:09.384436] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:22.723 [2024-07-12 12:39:09.491047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:22.723 [2024-07-12 12:39:12.251675] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:22.723 [2024-07-12 12:39:12.251751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:22.723 [2024-07-12 12:39:12.251773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:22.723 [2024-07-12 12:39:12.251804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:22.723 [2024-07-12 12:39:12.251819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:22.723 [2024-07-12 12:39:12.251833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:22.723 [2024-07-12 12:39:12.251848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:22.723 [2024-07-12 12:39:12.251862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:22.723 [2024-07-12 12:39:12.251887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:22.723 [2024-07-12 12:39:12.251901] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:22.723 [2024-07-12 12:39:12.251937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:22.724 [2024-07-12 12:39:12.251968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x6abbd0 (9): Bad file descriptor 00:25:22.724 [2024-07-12 12:39:12.344022] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:22.724 Running I/O for 1 seconds... 00:25:22.724 00:25:22.724 Latency(us) 00:25:22.724 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:22.724 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:22.724 Verification LBA range: start 0x0 length 0x4000 00:25:22.724 NVMe0n1 : 1.01 13116.64 51.24 0.00 0.00 9715.55 1055.86 10825.58 00:25:22.724 =================================================================================================================== 00:25:22.724 Total : 13116.64 51.24 0.00 0.00 9715.55 1055.86 10825.58 00:25:22.724 12:39:16 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:22.724 12:39:16 -- host/failover.sh@95 -- # grep -q NVMe0 00:25:23.290 12:39:16 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:23.290 12:39:17 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:23.290 12:39:17 -- host/failover.sh@99 -- # grep -q NVMe0 00:25:23.548 12:39:17 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:23.806 12:39:17 -- host/failover.sh@101 -- # sleep 3 00:25:27.096 12:39:20 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:27.096 12:39:20 -- host/failover.sh@103 -- # grep -q NVMe0 00:25:27.096 12:39:20 -- host/failover.sh@108 -- # killprocess 1367864 00:25:27.096 12:39:20 -- common/autotest_common.sh@926 -- # '[' -z 1367864 ']' 00:25:27.096 12:39:20 -- common/autotest_common.sh@930 -- # kill -0 1367864 00:25:27.096 12:39:20 -- common/autotest_common.sh@931 -- # uname 00:25:27.096 12:39:20 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:27.096 12:39:20 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1367864 00:25:27.096 12:39:20 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:25:27.096 12:39:20 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:25:27.096 12:39:20 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1367864' 00:25:27.096 killing process with pid 1367864 00:25:27.096 12:39:20 -- common/autotest_common.sh@945 -- # kill 1367864 00:25:27.096 12:39:20 -- common/autotest_common.sh@950 -- # wait 1367864 00:25:27.354 12:39:21 -- host/failover.sh@110 -- # sync 00:25:27.354 12:39:21 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:27.613 12:39:21 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:25:27.613 12:39:21 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:27.613 12:39:21 -- host/failover.sh@116 -- # nvmftestfini 00:25:27.613 12:39:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:27.613 12:39:21 -- nvmf/common.sh@116 -- # sync 00:25:27.613 12:39:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:27.613 12:39:21 -- nvmf/common.sh@119 -- # set +e 00:25:27.613 12:39:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:27.613 12:39:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:27.613 rmmod nvme_tcp 00:25:27.613 rmmod nvme_fabrics 00:25:27.613 rmmod nvme_keyring 00:25:27.613 12:39:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:27.613 12:39:21 -- nvmf/common.sh@123 -- # set -e 00:25:27.613 12:39:21 -- nvmf/common.sh@124 -- # return 0 00:25:27.613 12:39:21 -- nvmf/common.sh@477 -- # '[' -n 1364889 ']' 00:25:27.613 12:39:21 -- nvmf/common.sh@478 -- # killprocess 1364889 00:25:27.613 12:39:21 -- common/autotest_common.sh@926 -- # '[' -z 1364889 ']' 00:25:27.613 12:39:21 -- common/autotest_common.sh@930 -- # kill -0 1364889 00:25:27.613 12:39:21 -- common/autotest_common.sh@931 -- # uname 00:25:27.613 12:39:21 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:27.613 12:39:21 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1364889 00:25:27.613 12:39:21 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:27.613 12:39:21 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:27.613 12:39:21 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1364889' 00:25:27.613 killing process with pid 1364889 00:25:27.613 12:39:21 -- common/autotest_common.sh@945 -- # kill 1364889 00:25:27.613 12:39:21 -- common/autotest_common.sh@950 -- # wait 1364889 00:25:28.182 12:39:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:28.182 12:39:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:28.182 12:39:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:28.182 12:39:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:28.182 12:39:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:28.182 12:39:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:28.182 12:39:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:28.182 12:39:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.090 12:39:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:30.090 00:25:30.090 real 0m36.618s 00:25:30.090 user 2m9.946s 00:25:30.090 sys 0m5.841s 00:25:30.090 12:39:23 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:30.090 12:39:23 -- common/autotest_common.sh@10 -- # set +x 00:25:30.090 ************************************ 00:25:30.090 END TEST nvmf_failover 00:25:30.090 ************************************ 00:25:30.090 12:39:23 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:30.090 12:39:23 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:30.090 12:39:23 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:30.090 12:39:23 -- common/autotest_common.sh@10 -- # set +x 00:25:30.090 ************************************ 00:25:30.091 START TEST nvmf_discovery 00:25:30.091 ************************************ 00:25:30.091 12:39:23 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:25:30.091 * Looking for test storage... 00:25:30.091 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:30.091 12:39:23 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:30.091 12:39:23 -- nvmf/common.sh@7 -- # uname -s 00:25:30.091 12:39:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:30.091 12:39:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:30.091 12:39:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:30.091 12:39:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:30.091 12:39:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:30.091 12:39:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:30.091 12:39:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:30.091 12:39:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:30.091 12:39:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:30.091 12:39:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:30.091 12:39:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:30.091 12:39:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:30.091 12:39:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:30.091 12:39:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:30.091 12:39:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:30.091 12:39:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:30.091 12:39:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:30.091 12:39:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:30.091 12:39:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:30.091 12:39:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.091 12:39:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.091 12:39:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.091 12:39:23 -- paths/export.sh@5 -- # export PATH 00:25:30.091 12:39:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:30.091 12:39:23 -- nvmf/common.sh@46 -- # : 0 00:25:30.091 12:39:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:30.091 12:39:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:30.091 12:39:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:30.091 12:39:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:30.091 12:39:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:30.091 12:39:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:30.091 12:39:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:30.091 12:39:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:30.091 12:39:23 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:25:30.091 12:39:23 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:25:30.091 12:39:23 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:25:30.091 12:39:23 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:25:30.091 12:39:23 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:25:30.091 12:39:23 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:25:30.091 12:39:23 -- host/discovery.sh@25 -- # nvmftestinit 00:25:30.091 12:39:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:30.091 12:39:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:30.091 12:39:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:30.091 12:39:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:30.091 12:39:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:30.091 12:39:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.091 12:39:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.091 12:39:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.091 12:39:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:30.091 12:39:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:30.091 12:39:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:30.091 12:39:23 -- common/autotest_common.sh@10 -- # set +x 00:25:31.997 12:39:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:31.997 12:39:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:31.997 12:39:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:31.997 12:39:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:31.997 12:39:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:31.997 12:39:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:31.997 12:39:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:31.997 12:39:25 -- nvmf/common.sh@294 -- # net_devs=() 00:25:31.997 12:39:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:31.997 12:39:25 -- nvmf/common.sh@295 -- # e810=() 00:25:31.997 12:39:25 -- nvmf/common.sh@295 -- # local -ga e810 00:25:31.997 12:39:25 -- nvmf/common.sh@296 -- # x722=() 00:25:31.997 12:39:25 -- nvmf/common.sh@296 -- # local -ga x722 00:25:31.997 12:39:25 -- nvmf/common.sh@297 -- # mlx=() 00:25:31.997 12:39:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:31.997 12:39:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:31.997 12:39:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:31.997 12:39:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:31.997 12:39:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:31.997 12:39:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:31.997 12:39:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:31.997 12:39:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:31.997 12:39:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:31.997 12:39:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:31.997 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:31.997 12:39:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:31.997 12:39:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:31.997 12:39:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:32.256 12:39:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:32.256 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:32.256 12:39:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:32.256 12:39:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:32.256 12:39:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:32.256 12:39:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:32.256 12:39:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:32.256 12:39:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:32.256 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:32.256 12:39:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:32.256 12:39:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:32.256 12:39:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:32.256 12:39:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:32.256 12:39:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:32.256 12:39:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:32.256 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:32.256 12:39:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:32.256 12:39:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:32.256 12:39:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:32.256 12:39:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:32.256 12:39:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:32.256 12:39:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:32.256 12:39:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:32.256 12:39:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:32.256 12:39:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:32.256 12:39:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:32.256 12:39:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:32.256 12:39:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:32.256 12:39:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:32.256 12:39:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:32.256 12:39:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:32.256 12:39:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:32.256 12:39:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:32.256 12:39:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:32.256 12:39:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:32.256 12:39:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:32.256 12:39:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:32.256 12:39:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:32.256 12:39:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:32.256 12:39:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:32.256 12:39:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:32.256 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:32.256 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.121 ms 00:25:32.256 00:25:32.257 --- 10.0.0.2 ping statistics --- 00:25:32.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:32.257 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:25:32.257 12:39:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:32.257 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:32.257 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:25:32.257 00:25:32.257 --- 10.0.0.1 ping statistics --- 00:25:32.257 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:32.257 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:25:32.257 12:39:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:32.257 12:39:26 -- nvmf/common.sh@410 -- # return 0 00:25:32.257 12:39:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:32.257 12:39:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:32.257 12:39:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:32.257 12:39:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:32.257 12:39:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:32.257 12:39:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:32.257 12:39:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:32.257 12:39:26 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:25:32.257 12:39:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:32.257 12:39:26 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:32.257 12:39:26 -- common/autotest_common.sh@10 -- # set +x 00:25:32.257 12:39:26 -- nvmf/common.sh@469 -- # nvmfpid=1371311 00:25:32.257 12:39:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:32.257 12:39:26 -- nvmf/common.sh@470 -- # waitforlisten 1371311 00:25:32.257 12:39:26 -- common/autotest_common.sh@819 -- # '[' -z 1371311 ']' 00:25:32.257 12:39:26 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:32.257 12:39:26 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:32.257 12:39:26 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:32.257 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:32.257 12:39:26 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:32.257 12:39:26 -- common/autotest_common.sh@10 -- # set +x 00:25:32.257 [2024-07-12 12:39:26.113580] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:32.257 [2024-07-12 12:39:26.113655] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:32.257 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.515 [2024-07-12 12:39:26.178566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:32.515 [2024-07-12 12:39:26.297159] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:32.515 [2024-07-12 12:39:26.297302] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:32.515 [2024-07-12 12:39:26.297320] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:32.515 [2024-07-12 12:39:26.297333] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:32.515 [2024-07-12 12:39:26.297360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:33.455 12:39:27 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:33.455 12:39:27 -- common/autotest_common.sh@852 -- # return 0 00:25:33.455 12:39:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:33.455 12:39:27 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 12:39:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:33.455 12:39:27 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:33.455 12:39:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 [2024-07-12 12:39:27.115191] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:33.455 12:39:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:33.455 12:39:27 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:25:33.455 12:39:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 [2024-07-12 12:39:27.123355] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:33.455 12:39:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:33.455 12:39:27 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:25:33.455 12:39:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 null0 00:25:33.455 12:39:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:33.455 12:39:27 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:25:33.455 12:39:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 null1 00:25:33.455 12:39:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:33.455 12:39:27 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:25:33.455 12:39:27 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 12:39:27 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:33.455 12:39:27 -- host/discovery.sh@45 -- # hostpid=1371470 00:25:33.455 12:39:27 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:25:33.455 12:39:27 -- host/discovery.sh@46 -- # waitforlisten 1371470 /tmp/host.sock 00:25:33.455 12:39:27 -- common/autotest_common.sh@819 -- # '[' -z 1371470 ']' 00:25:33.455 12:39:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:25:33.455 12:39:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:33.455 12:39:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:33.455 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:33.455 12:39:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:33.455 12:39:27 -- common/autotest_common.sh@10 -- # set +x 00:25:33.455 [2024-07-12 12:39:27.190713] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:33.455 [2024-07-12 12:39:27.190788] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1371470 ] 00:25:33.455 EAL: No free 2048 kB hugepages reported on node 1 00:25:33.455 [2024-07-12 12:39:27.251885] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:33.455 [2024-07-12 12:39:27.367753] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:33.455 [2024-07-12 12:39:27.367944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:34.389 12:39:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:34.389 12:39:28 -- common/autotest_common.sh@852 -- # return 0 00:25:34.389 12:39:28 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:34.389 12:39:28 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:25:34.389 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.389 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.389 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.389 12:39:28 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:25:34.389 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.389 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.389 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.389 12:39:28 -- host/discovery.sh@72 -- # notify_id=0 00:25:34.389 12:39:28 -- host/discovery.sh@78 -- # get_subsystem_names 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:34.389 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.389 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # sort 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # xargs 00:25:34.389 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.389 12:39:28 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:25:34.389 12:39:28 -- host/discovery.sh@79 -- # get_bdev_list 00:25:34.389 12:39:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:34.389 12:39:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:34.389 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.389 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.389 12:39:28 -- host/discovery.sh@55 -- # sort 00:25:34.389 12:39:28 -- host/discovery.sh@55 -- # xargs 00:25:34.389 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.389 12:39:28 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:25:34.389 12:39:28 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:25:34.389 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.389 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.389 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.389 12:39:28 -- host/discovery.sh@82 -- # get_subsystem_names 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:34.389 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:34.389 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # sort 00:25:34.389 12:39:28 -- host/discovery.sh@59 -- # xargs 00:25:34.389 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:25:34.647 12:39:28 -- host/discovery.sh@83 -- # get_bdev_list 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # sort 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # xargs 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:25:34.647 12:39:28 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@86 -- # get_subsystem_names 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # sort 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # xargs 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:25:34.647 12:39:28 -- host/discovery.sh@87 -- # get_bdev_list 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # sort 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # xargs 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:25:34.647 12:39:28 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 [2024-07-12 12:39:28.455043] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@92 -- # get_subsystem_names 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # sort 00:25:34.647 12:39:28 -- host/discovery.sh@59 -- # xargs 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:25:34.647 12:39:28 -- host/discovery.sh@93 -- # get_bdev_list 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # sort 00:25:34.647 12:39:28 -- host/discovery.sh@55 -- # xargs 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.647 12:39:28 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:25:34.647 12:39:28 -- host/discovery.sh@94 -- # get_notification_count 00:25:34.647 12:39:28 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:34.647 12:39:28 -- host/discovery.sh@74 -- # jq '. | length' 00:25:34.647 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.647 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.647 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.905 12:39:28 -- host/discovery.sh@74 -- # notification_count=0 00:25:34.905 12:39:28 -- host/discovery.sh@75 -- # notify_id=0 00:25:34.905 12:39:28 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:25:34.905 12:39:28 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:25:34.905 12:39:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:34.905 12:39:28 -- common/autotest_common.sh@10 -- # set +x 00:25:34.905 12:39:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:34.905 12:39:28 -- host/discovery.sh@100 -- # sleep 1 00:25:35.475 [2024-07-12 12:39:29.224063] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:35.475 [2024-07-12 12:39:29.224099] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:35.475 [2024-07-12 12:39:29.224123] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:35.475 [2024-07-12 12:39:29.310404] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:35.475 [2024-07-12 12:39:29.367215] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:35.475 [2024-07-12 12:39:29.367245] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:35.734 12:39:29 -- host/discovery.sh@101 -- # get_subsystem_names 00:25:35.734 12:39:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:35.734 12:39:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:35.734 12:39:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:35.734 12:39:29 -- common/autotest_common.sh@10 -- # set +x 00:25:35.734 12:39:29 -- host/discovery.sh@59 -- # sort 00:25:35.734 12:39:29 -- host/discovery.sh@59 -- # xargs 00:25:35.734 12:39:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:35.734 12:39:29 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:35.734 12:39:29 -- host/discovery.sh@102 -- # get_bdev_list 00:25:35.734 12:39:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:35.734 12:39:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:35.734 12:39:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:35.734 12:39:29 -- common/autotest_common.sh@10 -- # set +x 00:25:35.734 12:39:29 -- host/discovery.sh@55 -- # sort 00:25:35.734 12:39:29 -- host/discovery.sh@55 -- # xargs 00:25:35.734 12:39:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:35.991 12:39:29 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:25:35.991 12:39:29 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:25:35.991 12:39:29 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:35.991 12:39:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:35.991 12:39:29 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:35.991 12:39:29 -- common/autotest_common.sh@10 -- # set +x 00:25:35.991 12:39:29 -- host/discovery.sh@63 -- # sort -n 00:25:35.991 12:39:29 -- host/discovery.sh@63 -- # xargs 00:25:35.991 12:39:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:35.991 12:39:29 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:25:35.991 12:39:29 -- host/discovery.sh@104 -- # get_notification_count 00:25:35.991 12:39:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:25:35.991 12:39:29 -- host/discovery.sh@74 -- # jq '. | length' 00:25:35.991 12:39:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:35.991 12:39:29 -- common/autotest_common.sh@10 -- # set +x 00:25:35.991 12:39:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:35.991 12:39:29 -- host/discovery.sh@74 -- # notification_count=1 00:25:35.991 12:39:29 -- host/discovery.sh@75 -- # notify_id=1 00:25:35.991 12:39:29 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:25:35.991 12:39:29 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:25:35.991 12:39:29 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:35.991 12:39:29 -- common/autotest_common.sh@10 -- # set +x 00:25:35.992 12:39:29 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:35.992 12:39:29 -- host/discovery.sh@109 -- # sleep 1 00:25:36.924 12:39:30 -- host/discovery.sh@110 -- # get_bdev_list 00:25:36.924 12:39:30 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:36.924 12:39:30 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:36.924 12:39:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:36.924 12:39:30 -- common/autotest_common.sh@10 -- # set +x 00:25:36.924 12:39:30 -- host/discovery.sh@55 -- # sort 00:25:36.924 12:39:30 -- host/discovery.sh@55 -- # xargs 00:25:36.924 12:39:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:36.924 12:39:30 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:36.925 12:39:30 -- host/discovery.sh@111 -- # get_notification_count 00:25:36.925 12:39:30 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:25:36.925 12:39:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:36.925 12:39:30 -- host/discovery.sh@74 -- # jq '. | length' 00:25:36.925 12:39:30 -- common/autotest_common.sh@10 -- # set +x 00:25:36.925 12:39:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.184 12:39:30 -- host/discovery.sh@74 -- # notification_count=1 00:25:37.184 12:39:30 -- host/discovery.sh@75 -- # notify_id=2 00:25:37.184 12:39:30 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:25:37.184 12:39:30 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:25:37.184 12:39:30 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:37.184 12:39:30 -- common/autotest_common.sh@10 -- # set +x 00:25:37.184 [2024-07-12 12:39:30.850207] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:37.184 [2024-07-12 12:39:30.851369] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:37.184 [2024-07-12 12:39:30.851412] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:37.184 12:39:30 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:37.184 12:39:30 -- host/discovery.sh@117 -- # sleep 1 00:25:37.184 [2024-07-12 12:39:30.937639] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:25:37.443 [2024-07-12 12:39:31.241958] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:37.443 [2024-07-12 12:39:31.241982] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:37.443 [2024-07-12 12:39:31.241991] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:38.009 12:39:31 -- host/discovery.sh@118 -- # get_subsystem_names 00:25:38.009 12:39:31 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:38.009 12:39:31 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:38.009 12:39:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.009 12:39:31 -- host/discovery.sh@59 -- # sort 00:25:38.009 12:39:31 -- common/autotest_common.sh@10 -- # set +x 00:25:38.009 12:39:31 -- host/discovery.sh@59 -- # xargs 00:25:38.009 12:39:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.009 12:39:31 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:38.009 12:39:31 -- host/discovery.sh@119 -- # get_bdev_list 00:25:38.009 12:39:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:38.009 12:39:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:38.009 12:39:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.009 12:39:31 -- common/autotest_common.sh@10 -- # set +x 00:25:38.009 12:39:31 -- host/discovery.sh@55 -- # sort 00:25:38.009 12:39:31 -- host/discovery.sh@55 -- # xargs 00:25:38.009 12:39:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.268 12:39:31 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:38.268 12:39:31 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:25:38.268 12:39:31 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:38.268 12:39:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.268 12:39:31 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:38.268 12:39:31 -- common/autotest_common.sh@10 -- # set +x 00:25:38.268 12:39:31 -- host/discovery.sh@63 -- # sort -n 00:25:38.268 12:39:31 -- host/discovery.sh@63 -- # xargs 00:25:38.268 12:39:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.268 12:39:31 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:25:38.268 12:39:31 -- host/discovery.sh@121 -- # get_notification_count 00:25:38.268 12:39:31 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:38.268 12:39:31 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.268 12:39:31 -- host/discovery.sh@74 -- # jq '. | length' 00:25:38.268 12:39:31 -- common/autotest_common.sh@10 -- # set +x 00:25:38.268 12:39:31 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.268 12:39:32 -- host/discovery.sh@74 -- # notification_count=0 00:25:38.268 12:39:32 -- host/discovery.sh@75 -- # notify_id=2 00:25:38.268 12:39:32 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:25:38.268 12:39:32 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:38.268 12:39:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:38.268 12:39:32 -- common/autotest_common.sh@10 -- # set +x 00:25:38.268 [2024-07-12 12:39:32.022634] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:25:38.268 [2024-07-12 12:39:32.022670] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:38.268 12:39:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:38.268 12:39:32 -- host/discovery.sh@127 -- # sleep 1 00:25:38.268 [2024-07-12 12:39:32.027492] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.268 [2024-07-12 12:39:32.027526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.268 [2024-07-12 12:39:32.027560] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.268 [2024-07-12 12:39:32.027573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.268 [2024-07-12 12:39:32.027587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.268 [2024-07-12 12:39:32.027615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.268 [2024-07-12 12:39:32.027630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:38.268 [2024-07-12 12:39:32.027643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:38.268 [2024-07-12 12:39:32.027656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.268 [2024-07-12 12:39:32.037497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.268 [2024-07-12 12:39:32.047545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.268 [2024-07-12 12:39:32.047765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.047895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.047939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.268 [2024-07-12 12:39:32.047955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.268 [2024-07-12 12:39:32.047979] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.268 [2024-07-12 12:39:32.048026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.268 [2024-07-12 12:39:32.048045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.268 [2024-07-12 12:39:32.048061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.268 [2024-07-12 12:39:32.048082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.268 [2024-07-12 12:39:32.057626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.268 [2024-07-12 12:39:32.057807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.057923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.057964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.268 [2024-07-12 12:39:32.057980] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.268 [2024-07-12 12:39:32.058003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.268 [2024-07-12 12:39:32.058023] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.268 [2024-07-12 12:39:32.058037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.268 [2024-07-12 12:39:32.058050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.268 [2024-07-12 12:39:32.058082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.268 [2024-07-12 12:39:32.067705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.268 [2024-07-12 12:39:32.067860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.068002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.068031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.268 [2024-07-12 12:39:32.068049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.268 [2024-07-12 12:39:32.068073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.268 [2024-07-12 12:39:32.068122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.268 [2024-07-12 12:39:32.068144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.268 [2024-07-12 12:39:32.068159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.268 [2024-07-12 12:39:32.068193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.268 [2024-07-12 12:39:32.077786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.268 [2024-07-12 12:39:32.078023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.078147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.078172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.268 [2024-07-12 12:39:32.078188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.268 [2024-07-12 12:39:32.078210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.268 [2024-07-12 12:39:32.078242] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.268 [2024-07-12 12:39:32.078260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.268 [2024-07-12 12:39:32.078273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.268 [2024-07-12 12:39:32.078292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.268 [2024-07-12 12:39:32.087870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.268 [2024-07-12 12:39:32.088073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.088190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.268 [2024-07-12 12:39:32.088215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.268 [2024-07-12 12:39:32.088231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.088252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.088296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.088332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.088347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.088383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.269 [2024-07-12 12:39:32.097959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.269 [2024-07-12 12:39:32.098083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.098214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.098239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.269 [2024-07-12 12:39:32.098255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.098277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.098297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.098311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.098323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.098355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.269 [2024-07-12 12:39:32.108028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.269 [2024-07-12 12:39:32.108211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.108320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.108363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.269 [2024-07-12 12:39:32.108380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.108402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.108459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.108479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.108508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.108527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.269 [2024-07-12 12:39:32.118112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.269 [2024-07-12 12:39:32.118292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.118463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.118494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.269 [2024-07-12 12:39:32.118511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.118533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.118583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.118603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.118618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.118654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.269 [2024-07-12 12:39:32.128194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.269 [2024-07-12 12:39:32.128395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.128543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.128568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.269 [2024-07-12 12:39:32.128584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.128606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.128649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.128668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.128681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.128700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.269 [2024-07-12 12:39:32.138283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.269 [2024-07-12 12:39:32.138455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.138579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.138607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.269 [2024-07-12 12:39:32.138625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.138649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.138672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.138687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.138701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.138737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:38.269 [2024-07-12 12:39:32.148362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:38.269 [2024-07-12 12:39:32.148540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.148645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:38.269 [2024-07-12 12:39:32.148675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1fb80 with addr=10.0.0.2, port=4420 00:25:38.269 [2024-07-12 12:39:32.148698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1fb80 is same with the state(5) to be set 00:25:38.269 [2024-07-12 12:39:32.148724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1fb80 (9): Bad file descriptor 00:25:38.269 [2024-07-12 12:39:32.148788] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:25:38.269 [2024-07-12 12:39:32.148818] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:38.269 [2024-07-12 12:39:32.148856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:25:38.269 [2024-07-12 12:39:32.148886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:25:38.269 [2024-07-12 12:39:32.148916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:25:38.269 [2024-07-12 12:39:32.148939] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:39.206 12:39:33 -- host/discovery.sh@128 -- # get_subsystem_names 00:25:39.206 12:39:33 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:39.206 12:39:33 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:39.206 12:39:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.206 12:39:33 -- host/discovery.sh@59 -- # sort 00:25:39.206 12:39:33 -- common/autotest_common.sh@10 -- # set +x 00:25:39.206 12:39:33 -- host/discovery.sh@59 -- # xargs 00:25:39.206 12:39:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.206 12:39:33 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:25:39.206 12:39:33 -- host/discovery.sh@129 -- # get_bdev_list 00:25:39.206 12:39:33 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:39.206 12:39:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.206 12:39:33 -- common/autotest_common.sh@10 -- # set +x 00:25:39.206 12:39:33 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:39.206 12:39:33 -- host/discovery.sh@55 -- # sort 00:25:39.206 12:39:33 -- host/discovery.sh@55 -- # xargs 00:25:39.206 12:39:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.207 12:39:33 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:39.207 12:39:33 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:25:39.207 12:39:33 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:25:39.207 12:39:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.207 12:39:33 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:25:39.207 12:39:33 -- common/autotest_common.sh@10 -- # set +x 00:25:39.207 12:39:33 -- host/discovery.sh@63 -- # sort -n 00:25:39.207 12:39:33 -- host/discovery.sh@63 -- # xargs 00:25:39.207 12:39:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.465 12:39:33 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:25:39.465 12:39:33 -- host/discovery.sh@131 -- # get_notification_count 00:25:39.465 12:39:33 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:39.465 12:39:33 -- host/discovery.sh@74 -- # jq '. | length' 00:25:39.465 12:39:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.465 12:39:33 -- common/autotest_common.sh@10 -- # set +x 00:25:39.465 12:39:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.465 12:39:33 -- host/discovery.sh@74 -- # notification_count=0 00:25:39.465 12:39:33 -- host/discovery.sh@75 -- # notify_id=2 00:25:39.465 12:39:33 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:25:39.465 12:39:33 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:25:39.465 12:39:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:39.465 12:39:33 -- common/autotest_common.sh@10 -- # set +x 00:25:39.466 12:39:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:39.466 12:39:33 -- host/discovery.sh@135 -- # sleep 1 00:25:40.400 12:39:34 -- host/discovery.sh@136 -- # get_subsystem_names 00:25:40.400 12:39:34 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:25:40.400 12:39:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.400 12:39:34 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:25:40.400 12:39:34 -- common/autotest_common.sh@10 -- # set +x 00:25:40.400 12:39:34 -- host/discovery.sh@59 -- # sort 00:25:40.400 12:39:34 -- host/discovery.sh@59 -- # xargs 00:25:40.400 12:39:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.400 12:39:34 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:25:40.400 12:39:34 -- host/discovery.sh@137 -- # get_bdev_list 00:25:40.400 12:39:34 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:40.400 12:39:34 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:40.400 12:39:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.400 12:39:34 -- common/autotest_common.sh@10 -- # set +x 00:25:40.400 12:39:34 -- host/discovery.sh@55 -- # sort 00:25:40.400 12:39:34 -- host/discovery.sh@55 -- # xargs 00:25:40.400 12:39:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.400 12:39:34 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:25:40.400 12:39:34 -- host/discovery.sh@138 -- # get_notification_count 00:25:40.400 12:39:34 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:25:40.400 12:39:34 -- host/discovery.sh@74 -- # jq '. | length' 00:25:40.400 12:39:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.400 12:39:34 -- common/autotest_common.sh@10 -- # set +x 00:25:40.400 12:39:34 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:40.660 12:39:34 -- host/discovery.sh@74 -- # notification_count=2 00:25:40.660 12:39:34 -- host/discovery.sh@75 -- # notify_id=4 00:25:40.660 12:39:34 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:25:40.660 12:39:34 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:40.660 12:39:34 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:40.660 12:39:34 -- common/autotest_common.sh@10 -- # set +x 00:25:41.655 [2024-07-12 12:39:35.390997] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:41.655 [2024-07-12 12:39:35.391022] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:41.655 [2024-07-12 12:39:35.391043] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:41.655 [2024-07-12 12:39:35.477338] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:25:41.912 [2024-07-12 12:39:35.585454] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:41.912 [2024-07-12 12:39:35.585495] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:41.912 12:39:35 -- common/autotest_common.sh@640 -- # local es=0 00:25:41.912 12:39:35 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:41.912 12:39:35 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:41.912 12:39:35 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:41.912 request: 00:25:41.912 { 00:25:41.912 "name": "nvme", 00:25:41.912 "trtype": "tcp", 00:25:41.912 "traddr": "10.0.0.2", 00:25:41.912 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:41.912 "adrfam": "ipv4", 00:25:41.912 "trsvcid": "8009", 00:25:41.912 "wait_for_attach": true, 00:25:41.912 "method": "bdev_nvme_start_discovery", 00:25:41.912 "req_id": 1 00:25:41.912 } 00:25:41.912 Got JSON-RPC error response 00:25:41.912 response: 00:25:41.912 { 00:25:41.912 "code": -17, 00:25:41.912 "message": "File exists" 00:25:41.912 } 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:41.912 12:39:35 -- common/autotest_common.sh@643 -- # es=1 00:25:41.912 12:39:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:41.912 12:39:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:41.912 12:39:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:41.912 12:39:35 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # sort 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # xargs 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:25:41.912 12:39:35 -- host/discovery.sh@147 -- # get_bdev_list 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # sort 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # xargs 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:41.912 12:39:35 -- common/autotest_common.sh@640 -- # local es=0 00:25:41.912 12:39:35 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:41.912 12:39:35 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:41.912 12:39:35 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:41.912 request: 00:25:41.912 { 00:25:41.912 "name": "nvme_second", 00:25:41.912 "trtype": "tcp", 00:25:41.912 "traddr": "10.0.0.2", 00:25:41.912 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:41.912 "adrfam": "ipv4", 00:25:41.912 "trsvcid": "8009", 00:25:41.912 "wait_for_attach": true, 00:25:41.912 "method": "bdev_nvme_start_discovery", 00:25:41.912 "req_id": 1 00:25:41.912 } 00:25:41.912 Got JSON-RPC error response 00:25:41.912 response: 00:25:41.912 { 00:25:41.912 "code": -17, 00:25:41.912 "message": "File exists" 00:25:41.912 } 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:41.912 12:39:35 -- common/autotest_common.sh@643 -- # es=1 00:25:41.912 12:39:35 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:41.912 12:39:35 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:41.912 12:39:35 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:41.912 12:39:35 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # sort 00:25:41.912 12:39:35 -- host/discovery.sh@67 -- # xargs 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:25:41.912 12:39:35 -- host/discovery.sh@153 -- # get_bdev_list 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # sort 00:25:41.912 12:39:35 -- host/discovery.sh@55 -- # xargs 00:25:41.912 12:39:35 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:25:41.912 12:39:35 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:41.912 12:39:35 -- common/autotest_common.sh@640 -- # local es=0 00:25:41.912 12:39:35 -- common/autotest_common.sh@642 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:41.912 12:39:35 -- common/autotest_common.sh@628 -- # local arg=rpc_cmd 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # type -t rpc_cmd 00:25:41.912 12:39:35 -- common/autotest_common.sh@632 -- # case "$(type -t "$arg")" in 00:25:41.912 12:39:35 -- common/autotest_common.sh@643 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:25:41.912 12:39:35 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:41.912 12:39:35 -- common/autotest_common.sh@10 -- # set +x 00:25:43.288 [2024-07-12 12:39:36.785773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:43.288 [2024-07-12 12:39:36.785953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:43.288 [2024-07-12 12:39:36.785981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f15070 with addr=10.0.0.2, port=8010 00:25:43.288 [2024-07-12 12:39:36.786002] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:43.288 [2024-07-12 12:39:36.786016] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:43.288 [2024-07-12 12:39:36.786028] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:44.225 [2024-07-12 12:39:37.788210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:44.225 [2024-07-12 12:39:37.788348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:44.225 [2024-07-12 12:39:37.788377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f15070 with addr=10.0.0.2, port=8010 00:25:44.225 [2024-07-12 12:39:37.788399] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:25:44.225 [2024-07-12 12:39:37.788413] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:25:44.225 [2024-07-12 12:39:37.788426] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:25:45.163 [2024-07-12 12:39:38.790485] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:25:45.163 request: 00:25:45.163 { 00:25:45.163 "name": "nvme_second", 00:25:45.163 "trtype": "tcp", 00:25:45.163 "traddr": "10.0.0.2", 00:25:45.163 "hostnqn": "nqn.2021-12.io.spdk:test", 00:25:45.163 "adrfam": "ipv4", 00:25:45.163 "trsvcid": "8010", 00:25:45.163 "attach_timeout_ms": 3000, 00:25:45.163 "method": "bdev_nvme_start_discovery", 00:25:45.163 "req_id": 1 00:25:45.163 } 00:25:45.163 Got JSON-RPC error response 00:25:45.163 response: 00:25:45.163 { 00:25:45.163 "code": -110, 00:25:45.163 "message": "Connection timed out" 00:25:45.164 } 00:25:45.164 12:39:38 -- common/autotest_common.sh@579 -- # [[ 1 == 0 ]] 00:25:45.164 12:39:38 -- common/autotest_common.sh@643 -- # es=1 00:25:45.164 12:39:38 -- common/autotest_common.sh@651 -- # (( es > 128 )) 00:25:45.164 12:39:38 -- common/autotest_common.sh@662 -- # [[ -n '' ]] 00:25:45.164 12:39:38 -- common/autotest_common.sh@667 -- # (( !es == 0 )) 00:25:45.164 12:39:38 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:25:45.164 12:39:38 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:25:45.164 12:39:38 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:25:45.164 12:39:38 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:45.164 12:39:38 -- common/autotest_common.sh@10 -- # set +x 00:25:45.164 12:39:38 -- host/discovery.sh@67 -- # sort 00:25:45.164 12:39:38 -- host/discovery.sh@67 -- # xargs 00:25:45.164 12:39:38 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:45.164 12:39:38 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:25:45.164 12:39:38 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:25:45.164 12:39:38 -- host/discovery.sh@162 -- # kill 1371470 00:25:45.164 12:39:38 -- host/discovery.sh@163 -- # nvmftestfini 00:25:45.164 12:39:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:45.164 12:39:38 -- nvmf/common.sh@116 -- # sync 00:25:45.164 12:39:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:45.164 12:39:38 -- nvmf/common.sh@119 -- # set +e 00:25:45.164 12:39:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:45.164 12:39:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:45.164 rmmod nvme_tcp 00:25:45.164 rmmod nvme_fabrics 00:25:45.164 rmmod nvme_keyring 00:25:45.164 12:39:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:45.164 12:39:38 -- nvmf/common.sh@123 -- # set -e 00:25:45.164 12:39:38 -- nvmf/common.sh@124 -- # return 0 00:25:45.164 12:39:38 -- nvmf/common.sh@477 -- # '[' -n 1371311 ']' 00:25:45.164 12:39:38 -- nvmf/common.sh@478 -- # killprocess 1371311 00:25:45.164 12:39:38 -- common/autotest_common.sh@926 -- # '[' -z 1371311 ']' 00:25:45.164 12:39:38 -- common/autotest_common.sh@930 -- # kill -0 1371311 00:25:45.164 12:39:38 -- common/autotest_common.sh@931 -- # uname 00:25:45.164 12:39:38 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:25:45.164 12:39:38 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1371311 00:25:45.164 12:39:38 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:25:45.164 12:39:38 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:25:45.164 12:39:38 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1371311' 00:25:45.164 killing process with pid 1371311 00:25:45.164 12:39:38 -- common/autotest_common.sh@945 -- # kill 1371311 00:25:45.164 12:39:38 -- common/autotest_common.sh@950 -- # wait 1371311 00:25:45.422 12:39:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:45.422 12:39:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:45.422 12:39:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:45.422 12:39:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:45.422 12:39:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:45.422 12:39:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:45.422 12:39:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:45.422 12:39:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.326 12:39:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:47.326 00:25:47.326 real 0m17.325s 00:25:47.326 user 0m26.913s 00:25:47.326 sys 0m2.919s 00:25:47.326 12:39:41 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:25:47.326 12:39:41 -- common/autotest_common.sh@10 -- # set +x 00:25:47.326 ************************************ 00:25:47.326 END TEST nvmf_discovery 00:25:47.326 ************************************ 00:25:47.326 12:39:41 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:47.326 12:39:41 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:25:47.326 12:39:41 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:25:47.326 12:39:41 -- common/autotest_common.sh@10 -- # set +x 00:25:47.326 ************************************ 00:25:47.326 START TEST nvmf_discovery_remove_ifc 00:25:47.326 ************************************ 00:25:47.326 12:39:41 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:25:47.587 * Looking for test storage... 00:25:47.587 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:47.587 12:39:41 -- nvmf/common.sh@7 -- # uname -s 00:25:47.587 12:39:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:47.587 12:39:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:47.587 12:39:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:47.587 12:39:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:47.587 12:39:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:47.587 12:39:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:47.587 12:39:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:47.587 12:39:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:47.587 12:39:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:47.587 12:39:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:47.587 12:39:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.587 12:39:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.587 12:39:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:47.587 12:39:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:47.587 12:39:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:47.587 12:39:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:47.587 12:39:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:47.587 12:39:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:47.587 12:39:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:47.587 12:39:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.587 12:39:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.587 12:39:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.587 12:39:41 -- paths/export.sh@5 -- # export PATH 00:25:47.587 12:39:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.587 12:39:41 -- nvmf/common.sh@46 -- # : 0 00:25:47.587 12:39:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:47.587 12:39:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:47.587 12:39:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:47.587 12:39:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:47.587 12:39:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:47.587 12:39:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:47.587 12:39:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:47.587 12:39:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:25:47.587 12:39:41 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:25:47.587 12:39:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:47.587 12:39:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:47.587 12:39:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:47.587 12:39:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:47.587 12:39:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:47.587 12:39:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.587 12:39:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.587 12:39:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.587 12:39:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:47.587 12:39:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:47.587 12:39:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:47.587 12:39:41 -- common/autotest_common.sh@10 -- # set +x 00:25:49.519 12:39:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:49.519 12:39:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:49.519 12:39:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:49.519 12:39:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:49.519 12:39:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:49.519 12:39:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:49.519 12:39:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:49.519 12:39:43 -- nvmf/common.sh@294 -- # net_devs=() 00:25:49.519 12:39:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:49.519 12:39:43 -- nvmf/common.sh@295 -- # e810=() 00:25:49.519 12:39:43 -- nvmf/common.sh@295 -- # local -ga e810 00:25:49.519 12:39:43 -- nvmf/common.sh@296 -- # x722=() 00:25:49.519 12:39:43 -- nvmf/common.sh@296 -- # local -ga x722 00:25:49.519 12:39:43 -- nvmf/common.sh@297 -- # mlx=() 00:25:49.519 12:39:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:49.519 12:39:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:49.519 12:39:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:49.519 12:39:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:49.519 12:39:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:49.519 12:39:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.519 12:39:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:49.519 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:49.519 12:39:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.519 12:39:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:49.519 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:49.519 12:39:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:49.519 12:39:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.519 12:39:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.519 12:39:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.519 12:39:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.519 12:39:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:49.519 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:49.519 12:39:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.519 12:39:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.519 12:39:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.519 12:39:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.519 12:39:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.519 12:39:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:49.519 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:49.519 12:39:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.519 12:39:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:49.519 12:39:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:49.519 12:39:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:49.519 12:39:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:49.519 12:39:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:49.519 12:39:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:49.519 12:39:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:49.519 12:39:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:49.519 12:39:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:49.519 12:39:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:49.519 12:39:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:49.519 12:39:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:49.519 12:39:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:49.519 12:39:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:49.519 12:39:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:49.519 12:39:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:49.519 12:39:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:49.519 12:39:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:49.519 12:39:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:49.519 12:39:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:49.519 12:39:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:49.519 12:39:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:49.519 12:39:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:49.519 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:49.519 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:25:49.519 00:25:49.519 --- 10.0.0.2 ping statistics --- 00:25:49.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.519 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:25:49.519 12:39:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:49.519 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:49.519 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:25:49.519 00:25:49.519 --- 10.0.0.1 ping statistics --- 00:25:49.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.519 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:25:49.519 12:39:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:49.519 12:39:43 -- nvmf/common.sh@410 -- # return 0 00:25:49.519 12:39:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:49.519 12:39:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:49.519 12:39:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:49.519 12:39:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:49.519 12:39:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:49.519 12:39:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:49.782 12:39:43 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:25:49.782 12:39:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:49.782 12:39:43 -- common/autotest_common.sh@712 -- # xtrace_disable 00:25:49.782 12:39:43 -- common/autotest_common.sh@10 -- # set +x 00:25:49.782 12:39:43 -- nvmf/common.sh@469 -- # nvmfpid=1375060 00:25:49.782 12:39:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:25:49.782 12:39:43 -- nvmf/common.sh@470 -- # waitforlisten 1375060 00:25:49.782 12:39:43 -- common/autotest_common.sh@819 -- # '[' -z 1375060 ']' 00:25:49.782 12:39:43 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:49.782 12:39:43 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:49.782 12:39:43 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:49.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:49.782 12:39:43 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:49.782 12:39:43 -- common/autotest_common.sh@10 -- # set +x 00:25:49.782 [2024-07-12 12:39:43.484485] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:49.782 [2024-07-12 12:39:43.484575] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:49.782 EAL: No free 2048 kB hugepages reported on node 1 00:25:49.782 [2024-07-12 12:39:43.548441] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:49.782 [2024-07-12 12:39:43.656310] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:49.782 [2024-07-12 12:39:43.656479] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:49.782 [2024-07-12 12:39:43.656498] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:49.782 [2024-07-12 12:39:43.656510] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:49.782 [2024-07-12 12:39:43.656539] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:50.717 12:39:44 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:50.717 12:39:44 -- common/autotest_common.sh@852 -- # return 0 00:25:50.717 12:39:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.717 12:39:44 -- common/autotest_common.sh@718 -- # xtrace_disable 00:25:50.717 12:39:44 -- common/autotest_common.sh@10 -- # set +x 00:25:50.717 12:39:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.717 12:39:44 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:25:50.717 12:39:44 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:50.717 12:39:44 -- common/autotest_common.sh@10 -- # set +x 00:25:50.717 [2024-07-12 12:39:44.493628] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:50.717 [2024-07-12 12:39:44.501775] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:25:50.717 null0 00:25:50.717 [2024-07-12 12:39:44.533772] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:50.717 12:39:44 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:50.717 12:39:44 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1375219 00:25:50.717 12:39:44 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:25:50.717 12:39:44 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1375219 /tmp/host.sock 00:25:50.717 12:39:44 -- common/autotest_common.sh@819 -- # '[' -z 1375219 ']' 00:25:50.717 12:39:44 -- common/autotest_common.sh@823 -- # local rpc_addr=/tmp/host.sock 00:25:50.717 12:39:44 -- common/autotest_common.sh@824 -- # local max_retries=100 00:25:50.717 12:39:44 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:25:50.717 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:25:50.717 12:39:44 -- common/autotest_common.sh@828 -- # xtrace_disable 00:25:50.717 12:39:44 -- common/autotest_common.sh@10 -- # set +x 00:25:50.717 [2024-07-12 12:39:44.592992] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:25:50.717 [2024-07-12 12:39:44.593071] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1375219 ] 00:25:50.717 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.976 [2024-07-12 12:39:44.654626] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:50.976 [2024-07-12 12:39:44.770350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:50.976 [2024-07-12 12:39:44.770502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:51.919 12:39:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:25:51.919 12:39:45 -- common/autotest_common.sh@852 -- # return 0 00:25:51.919 12:39:45 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:51.919 12:39:45 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:25:51.919 12:39:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:51.919 12:39:45 -- common/autotest_common.sh@10 -- # set +x 00:25:51.919 12:39:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:51.919 12:39:45 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:25:51.919 12:39:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:51.919 12:39:45 -- common/autotest_common.sh@10 -- # set +x 00:25:51.919 12:39:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:51.919 12:39:45 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:25:51.919 12:39:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:51.919 12:39:45 -- common/autotest_common.sh@10 -- # set +x 00:25:52.855 [2024-07-12 12:39:46.662935] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:25:52.855 [2024-07-12 12:39:46.662967] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:25:52.855 [2024-07-12 12:39:46.662991] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:25:53.113 [2024-07-12 12:39:46.789430] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:25:53.113 [2024-07-12 12:39:46.968540] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:25:53.113 [2024-07-12 12:39:46.968595] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:25:53.113 [2024-07-12 12:39:46.968639] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:25:53.113 [2024-07-12 12:39:46.968666] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:25:53.114 [2024-07-12 12:39:46.968693] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:25:53.114 12:39:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:53.114 12:39:46 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:25:53.114 12:39:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:53.114 [2024-07-12 12:39:46.971649] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x15591f0 was disconnected and freed. delete nvme_qpair. 00:25:53.114 12:39:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:53.114 12:39:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:53.114 12:39:46 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:53.114 12:39:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:53.114 12:39:46 -- common/autotest_common.sh@10 -- # set +x 00:25:53.114 12:39:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:53.114 12:39:46 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:53.114 12:39:47 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:25:53.114 12:39:47 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:25:53.114 12:39:47 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:53.374 12:39:47 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:53.374 12:39:47 -- common/autotest_common.sh@10 -- # set +x 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:53.374 12:39:47 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:53.374 12:39:47 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:54.313 12:39:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:54.313 12:39:48 -- common/autotest_common.sh@10 -- # set +x 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:54.313 12:39:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:54.313 12:39:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:55.249 12:39:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:55.249 12:39:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:55.249 12:39:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:55.249 12:39:49 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:55.249 12:39:49 -- common/autotest_common.sh@10 -- # set +x 00:25:55.249 12:39:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:55.249 12:39:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:55.509 12:39:49 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:55.509 12:39:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:55.509 12:39:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:56.443 12:39:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:56.443 12:39:50 -- common/autotest_common.sh@10 -- # set +x 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:56.443 12:39:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:56.443 12:39:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:57.383 12:39:51 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:57.383 12:39:51 -- common/autotest_common.sh@10 -- # set +x 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:57.383 12:39:51 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:57.383 12:39:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:58.758 12:39:52 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:58.758 12:39:52 -- common/autotest_common.sh@10 -- # set +x 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:58.758 12:39:52 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:25:58.758 12:39:52 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:25:58.759 [2024-07-12 12:39:52.410026] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:25:58.759 [2024-07-12 12:39:52.410098] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.759 [2024-07-12 12:39:52.410118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.759 [2024-07-12 12:39:52.410136] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.759 [2024-07-12 12:39:52.410159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.759 [2024-07-12 12:39:52.410181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.759 [2024-07-12 12:39:52.410218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.759 [2024-07-12 12:39:52.410246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.759 [2024-07-12 12:39:52.410275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.759 [2024-07-12 12:39:52.410292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:25:58.759 [2024-07-12 12:39:52.410307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:58.759 [2024-07-12 12:39:52.410321] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x151f810 is same with the state(5) to be set 00:25:58.759 [2024-07-12 12:39:52.420045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151f810 (9): Bad file descriptor 00:25:58.759 [2024-07-12 12:39:52.430094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:59.696 12:39:53 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:25:59.696 12:39:53 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:25:59.696 12:39:53 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:25:59.696 12:39:53 -- common/autotest_common.sh@551 -- # xtrace_disable 00:25:59.696 12:39:53 -- common/autotest_common.sh@10 -- # set +x 00:25:59.696 12:39:53 -- host/discovery_remove_ifc.sh@29 -- # sort 00:25:59.696 12:39:53 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:25:59.696 [2024-07-12 12:39:53.437895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:00.631 [2024-07-12 12:39:54.461912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:00.631 [2024-07-12 12:39:54.461955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x151f810 with addr=10.0.0.2, port=4420 00:26:00.631 [2024-07-12 12:39:54.461979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x151f810 is same with the state(5) to be set 00:26:00.631 [2024-07-12 12:39:54.462011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:00.631 [2024-07-12 12:39:54.462030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:00.631 [2024-07-12 12:39:54.462045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:00.631 [2024-07-12 12:39:54.462061] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:00.631 [2024-07-12 12:39:54.462462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151f810 (9): Bad file descriptor 00:26:00.631 [2024-07-12 12:39:54.462507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:00.631 [2024-07-12 12:39:54.462553] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:00.631 [2024-07-12 12:39:54.462590] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.631 [2024-07-12 12:39:54.462614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.631 [2024-07-12 12:39:54.462633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.631 [2024-07-12 12:39:54.462648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.631 [2024-07-12 12:39:54.462664] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.631 [2024-07-12 12:39:54.462678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.631 [2024-07-12 12:39:54.462693] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.631 [2024-07-12 12:39:54.462709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.631 [2024-07-12 12:39:54.462730] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:00.631 [2024-07-12 12:39:54.462746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:00.631 [2024-07-12 12:39:54.462761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:00.631 [2024-07-12 12:39:54.463014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151fc20 (9): Bad file descriptor 00:26:00.631 [2024-07-12 12:39:54.464031] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:00.631 [2024-07-12 12:39:54.464055] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:00.631 12:39:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:00.631 12:39:54 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:00.631 12:39:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:01.565 12:39:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:01.565 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:01.565 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:01.565 12:39:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:01.565 12:39:55 -- common/autotest_common.sh@10 -- # set +x 00:26:01.565 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:01.565 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:01.823 12:39:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:01.823 12:39:55 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:01.823 12:39:55 -- common/autotest_common.sh@10 -- # set +x 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:01.823 12:39:55 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:01.823 12:39:55 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:02.762 [2024-07-12 12:39:56.520464] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:02.762 [2024-07-12 12:39:56.520492] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:02.762 [2024-07-12 12:39:56.520518] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:02.762 12:39:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:02.762 12:39:56 -- common/autotest_common.sh@10 -- # set +x 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:02.762 12:39:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:02.762 12:39:56 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:02.762 [2024-07-12 12:39:56.648032] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:03.021 [2024-07-12 12:39:56.871257] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:03.021 [2024-07-12 12:39:56.871301] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:03.021 [2024-07-12 12:39:56.871333] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:03.021 [2024-07-12 12:39:56.871362] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:03.021 [2024-07-12 12:39:56.871376] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:03.021 [2024-07-12 12:39:56.878135] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x152e1d0 was disconnected and freed. delete nvme_qpair. 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:03.958 12:39:57 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:03.958 12:39:57 -- common/autotest_common.sh@10 -- # set +x 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:03.958 12:39:57 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:03.958 12:39:57 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1375219 00:26:03.958 12:39:57 -- common/autotest_common.sh@926 -- # '[' -z 1375219 ']' 00:26:03.958 12:39:57 -- common/autotest_common.sh@930 -- # kill -0 1375219 00:26:03.958 12:39:57 -- common/autotest_common.sh@931 -- # uname 00:26:03.958 12:39:57 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:03.958 12:39:57 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1375219 00:26:03.958 12:39:57 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:03.958 12:39:57 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:03.958 12:39:57 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1375219' 00:26:03.958 killing process with pid 1375219 00:26:03.958 12:39:57 -- common/autotest_common.sh@945 -- # kill 1375219 00:26:03.958 12:39:57 -- common/autotest_common.sh@950 -- # wait 1375219 00:26:04.217 12:39:57 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:04.217 12:39:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:04.217 12:39:57 -- nvmf/common.sh@116 -- # sync 00:26:04.218 12:39:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:04.218 12:39:57 -- nvmf/common.sh@119 -- # set +e 00:26:04.218 12:39:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:04.218 12:39:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:04.218 rmmod nvme_tcp 00:26:04.218 rmmod nvme_fabrics 00:26:04.218 rmmod nvme_keyring 00:26:04.218 12:39:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:04.218 12:39:58 -- nvmf/common.sh@123 -- # set -e 00:26:04.218 12:39:58 -- nvmf/common.sh@124 -- # return 0 00:26:04.218 12:39:58 -- nvmf/common.sh@477 -- # '[' -n 1375060 ']' 00:26:04.218 12:39:58 -- nvmf/common.sh@478 -- # killprocess 1375060 00:26:04.218 12:39:58 -- common/autotest_common.sh@926 -- # '[' -z 1375060 ']' 00:26:04.218 12:39:58 -- common/autotest_common.sh@930 -- # kill -0 1375060 00:26:04.218 12:39:58 -- common/autotest_common.sh@931 -- # uname 00:26:04.218 12:39:58 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:04.218 12:39:58 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1375060 00:26:04.218 12:39:58 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:04.218 12:39:58 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:04.218 12:39:58 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1375060' 00:26:04.218 killing process with pid 1375060 00:26:04.218 12:39:58 -- common/autotest_common.sh@945 -- # kill 1375060 00:26:04.218 12:39:58 -- common/autotest_common.sh@950 -- # wait 1375060 00:26:04.476 12:39:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:04.476 12:39:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:04.476 12:39:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:04.476 12:39:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:04.476 12:39:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:04.476 12:39:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:04.476 12:39:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:04.476 12:39:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:07.013 12:40:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:07.013 00:26:07.013 real 0m19.131s 00:26:07.013 user 0m27.264s 00:26:07.013 sys 0m2.993s 00:26:07.013 12:40:00 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:07.013 12:40:00 -- common/autotest_common.sh@10 -- # set +x 00:26:07.013 ************************************ 00:26:07.013 END TEST nvmf_discovery_remove_ifc 00:26:07.013 ************************************ 00:26:07.013 12:40:00 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:07.013 12:40:00 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:07.013 12:40:00 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:07.013 12:40:00 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:07.013 12:40:00 -- common/autotest_common.sh@10 -- # set +x 00:26:07.013 ************************************ 00:26:07.013 START TEST nvmf_digest 00:26:07.013 ************************************ 00:26:07.013 12:40:00 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:07.014 * Looking for test storage... 00:26:07.014 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:07.014 12:40:00 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:07.014 12:40:00 -- nvmf/common.sh@7 -- # uname -s 00:26:07.014 12:40:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:07.014 12:40:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:07.014 12:40:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:07.014 12:40:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:07.014 12:40:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:07.014 12:40:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:07.014 12:40:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:07.014 12:40:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:07.014 12:40:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:07.014 12:40:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:07.014 12:40:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:07.014 12:40:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:07.014 12:40:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:07.014 12:40:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:07.014 12:40:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:07.014 12:40:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:07.014 12:40:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:07.014 12:40:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:07.014 12:40:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:07.014 12:40:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.014 12:40:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.014 12:40:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.014 12:40:00 -- paths/export.sh@5 -- # export PATH 00:26:07.014 12:40:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:07.014 12:40:00 -- nvmf/common.sh@46 -- # : 0 00:26:07.014 12:40:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:07.014 12:40:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:07.014 12:40:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:07.014 12:40:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:07.014 12:40:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:07.014 12:40:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:07.014 12:40:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:07.014 12:40:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:07.014 12:40:00 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:07.014 12:40:00 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:07.014 12:40:00 -- host/digest.sh@16 -- # runtime=2 00:26:07.014 12:40:00 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:07.014 12:40:00 -- host/digest.sh@132 -- # nvmftestinit 00:26:07.014 12:40:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:07.014 12:40:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:07.014 12:40:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:07.014 12:40:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:07.014 12:40:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:07.014 12:40:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:07.014 12:40:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:07.014 12:40:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:07.014 12:40:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:07.014 12:40:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:07.014 12:40:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:07.014 12:40:00 -- common/autotest_common.sh@10 -- # set +x 00:26:08.919 12:40:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:08.919 12:40:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:08.919 12:40:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:08.919 12:40:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:08.919 12:40:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:08.919 12:40:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:08.919 12:40:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:08.919 12:40:02 -- nvmf/common.sh@294 -- # net_devs=() 00:26:08.919 12:40:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:08.919 12:40:02 -- nvmf/common.sh@295 -- # e810=() 00:26:08.919 12:40:02 -- nvmf/common.sh@295 -- # local -ga e810 00:26:08.919 12:40:02 -- nvmf/common.sh@296 -- # x722=() 00:26:08.919 12:40:02 -- nvmf/common.sh@296 -- # local -ga x722 00:26:08.919 12:40:02 -- nvmf/common.sh@297 -- # mlx=() 00:26:08.919 12:40:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:08.919 12:40:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:08.919 12:40:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:08.920 12:40:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:08.920 12:40:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:08.920 12:40:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:08.920 12:40:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:08.920 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:08.920 12:40:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:08.920 12:40:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:08.920 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:08.920 12:40:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:08.920 12:40:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:08.920 12:40:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:08.920 12:40:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:08.920 12:40:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:08.920 12:40:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:08.920 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:08.920 12:40:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.920 12:40:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:08.920 12:40:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:08.920 12:40:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:08.920 12:40:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:08.920 12:40:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:08.920 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:08.920 12:40:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.920 12:40:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:08.920 12:40:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:08.920 12:40:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:08.920 12:40:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:08.920 12:40:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:08.920 12:40:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:08.920 12:40:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:08.920 12:40:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:08.920 12:40:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:08.920 12:40:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:08.920 12:40:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:08.920 12:40:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:08.920 12:40:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:08.920 12:40:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:08.920 12:40:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:08.920 12:40:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:08.920 12:40:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:08.920 12:40:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:08.920 12:40:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:08.920 12:40:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:08.920 12:40:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:08.920 12:40:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:08.920 12:40:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:08.920 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:08.920 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.135 ms 00:26:08.920 00:26:08.920 --- 10.0.0.2 ping statistics --- 00:26:08.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.920 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:26:08.920 12:40:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:08.920 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:08.920 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:26:08.920 00:26:08.920 --- 10.0.0.1 ping statistics --- 00:26:08.920 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.920 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:26:08.920 12:40:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:08.920 12:40:02 -- nvmf/common.sh@410 -- # return 0 00:26:08.920 12:40:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:08.920 12:40:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:08.920 12:40:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:08.920 12:40:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:08.920 12:40:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:08.920 12:40:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:08.920 12:40:02 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:08.920 12:40:02 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:08.920 12:40:02 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:08.920 12:40:02 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:08.920 12:40:02 -- common/autotest_common.sh@10 -- # set +x 00:26:08.920 ************************************ 00:26:08.920 START TEST nvmf_digest_clean 00:26:08.920 ************************************ 00:26:08.920 12:40:02 -- common/autotest_common.sh@1104 -- # run_digest 00:26:08.920 12:40:02 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:08.920 12:40:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:08.920 12:40:02 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:08.920 12:40:02 -- common/autotest_common.sh@10 -- # set +x 00:26:08.920 12:40:02 -- nvmf/common.sh@469 -- # nvmfpid=1378869 00:26:08.920 12:40:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:08.920 12:40:02 -- nvmf/common.sh@470 -- # waitforlisten 1378869 00:26:08.920 12:40:02 -- common/autotest_common.sh@819 -- # '[' -z 1378869 ']' 00:26:08.920 12:40:02 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:08.920 12:40:02 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:08.920 12:40:02 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:08.920 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:08.920 12:40:02 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:08.920 12:40:02 -- common/autotest_common.sh@10 -- # set +x 00:26:08.920 [2024-07-12 12:40:02.674296] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:08.920 [2024-07-12 12:40:02.674363] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:08.920 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.920 [2024-07-12 12:40:02.736894] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:09.180 [2024-07-12 12:40:02.841598] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:09.180 [2024-07-12 12:40:02.841770] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:09.180 [2024-07-12 12:40:02.841794] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:09.180 [2024-07-12 12:40:02.841811] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:09.180 [2024-07-12 12:40:02.841859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:09.180 12:40:02 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:09.180 12:40:02 -- common/autotest_common.sh@852 -- # return 0 00:26:09.180 12:40:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:09.180 12:40:02 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:09.180 12:40:02 -- common/autotest_common.sh@10 -- # set +x 00:26:09.180 12:40:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:09.180 12:40:02 -- host/digest.sh@120 -- # common_target_config 00:26:09.180 12:40:02 -- host/digest.sh@43 -- # rpc_cmd 00:26:09.180 12:40:02 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:09.180 12:40:02 -- common/autotest_common.sh@10 -- # set +x 00:26:09.180 null0 00:26:09.180 [2024-07-12 12:40:03.016607] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:09.180 [2024-07-12 12:40:03.040818] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:09.180 12:40:03 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:09.180 12:40:03 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:09.180 12:40:03 -- host/digest.sh@77 -- # local rw bs qd 00:26:09.180 12:40:03 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:09.180 12:40:03 -- host/digest.sh@80 -- # rw=randread 00:26:09.180 12:40:03 -- host/digest.sh@80 -- # bs=4096 00:26:09.180 12:40:03 -- host/digest.sh@80 -- # qd=128 00:26:09.180 12:40:03 -- host/digest.sh@82 -- # bperfpid=1378896 00:26:09.180 12:40:03 -- host/digest.sh@83 -- # waitforlisten 1378896 /var/tmp/bperf.sock 00:26:09.180 12:40:03 -- common/autotest_common.sh@819 -- # '[' -z 1378896 ']' 00:26:09.180 12:40:03 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:09.180 12:40:03 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:09.180 12:40:03 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:09.180 12:40:03 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:09.180 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:09.180 12:40:03 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:09.180 12:40:03 -- common/autotest_common.sh@10 -- # set +x 00:26:09.180 [2024-07-12 12:40:03.087131] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:09.180 [2024-07-12 12:40:03.087211] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1378896 ] 00:26:09.438 EAL: No free 2048 kB hugepages reported on node 1 00:26:09.438 [2024-07-12 12:40:03.145735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:09.438 [2024-07-12 12:40:03.252634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:09.438 12:40:03 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:09.438 12:40:03 -- common/autotest_common.sh@852 -- # return 0 00:26:09.438 12:40:03 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:09.438 12:40:03 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:09.438 12:40:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:09.695 12:40:03 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:09.695 12:40:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:10.265 nvme0n1 00:26:10.265 12:40:04 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:10.265 12:40:04 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:10.265 Running I/O for 2 seconds... 00:26:12.796 00:26:12.796 Latency(us) 00:26:12.796 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:12.796 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:12.796 nvme0n1 : 2.00 15636.50 61.08 0.00 0.00 8177.94 2742.80 17767.54 00:26:12.796 =================================================================================================================== 00:26:12.796 Total : 15636.50 61.08 0.00 0.00 8177.94 2742.80 17767.54 00:26:12.796 0 00:26:12.796 12:40:06 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:12.796 12:40:06 -- host/digest.sh@92 -- # get_accel_stats 00:26:12.796 12:40:06 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:12.796 12:40:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:12.796 12:40:06 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:12.796 | select(.opcode=="crc32c") 00:26:12.796 | "\(.module_name) \(.executed)"' 00:26:12.796 12:40:06 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:12.796 12:40:06 -- host/digest.sh@93 -- # exp_module=software 00:26:12.796 12:40:06 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:12.796 12:40:06 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:12.796 12:40:06 -- host/digest.sh@97 -- # killprocess 1378896 00:26:12.796 12:40:06 -- common/autotest_common.sh@926 -- # '[' -z 1378896 ']' 00:26:12.796 12:40:06 -- common/autotest_common.sh@930 -- # kill -0 1378896 00:26:12.796 12:40:06 -- common/autotest_common.sh@931 -- # uname 00:26:12.796 12:40:06 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:12.796 12:40:06 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1378896 00:26:12.796 12:40:06 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:12.796 12:40:06 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:12.796 12:40:06 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1378896' 00:26:12.796 killing process with pid 1378896 00:26:12.796 12:40:06 -- common/autotest_common.sh@945 -- # kill 1378896 00:26:12.796 Received shutdown signal, test time was about 2.000000 seconds 00:26:12.796 00:26:12.796 Latency(us) 00:26:12.796 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:12.796 =================================================================================================================== 00:26:12.796 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:12.796 12:40:06 -- common/autotest_common.sh@950 -- # wait 1378896 00:26:12.796 12:40:06 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:12.796 12:40:06 -- host/digest.sh@77 -- # local rw bs qd 00:26:12.796 12:40:06 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:12.796 12:40:06 -- host/digest.sh@80 -- # rw=randread 00:26:12.796 12:40:06 -- host/digest.sh@80 -- # bs=131072 00:26:12.796 12:40:06 -- host/digest.sh@80 -- # qd=16 00:26:12.796 12:40:06 -- host/digest.sh@82 -- # bperfpid=1379312 00:26:12.796 12:40:06 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:12.796 12:40:06 -- host/digest.sh@83 -- # waitforlisten 1379312 /var/tmp/bperf.sock 00:26:12.796 12:40:06 -- common/autotest_common.sh@819 -- # '[' -z 1379312 ']' 00:26:12.796 12:40:06 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:12.796 12:40:06 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:12.796 12:40:06 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:12.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:12.796 12:40:06 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:12.796 12:40:06 -- common/autotest_common.sh@10 -- # set +x 00:26:13.054 [2024-07-12 12:40:06.749240] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:13.054 [2024-07-12 12:40:06.749328] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1379312 ] 00:26:13.054 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:13.054 Zero copy mechanism will not be used. 00:26:13.054 EAL: No free 2048 kB hugepages reported on node 1 00:26:13.054 [2024-07-12 12:40:06.808683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:13.054 [2024-07-12 12:40:06.915787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:13.312 12:40:06 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:13.312 12:40:06 -- common/autotest_common.sh@852 -- # return 0 00:26:13.312 12:40:06 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:13.312 12:40:06 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:13.312 12:40:06 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:13.570 12:40:07 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:13.570 12:40:07 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:14.140 nvme0n1 00:26:14.140 12:40:07 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:14.140 12:40:07 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:14.140 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:14.140 Zero copy mechanism will not be used. 00:26:14.140 Running I/O for 2 seconds... 00:26:16.681 00:26:16.681 Latency(us) 00:26:16.681 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:16.681 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:16.681 nvme0n1 : 2.00 6703.16 837.89 0.00 0.00 2383.31 597.71 5194.33 00:26:16.681 =================================================================================================================== 00:26:16.681 Total : 6703.16 837.89 0.00 0.00 2383.31 597.71 5194.33 00:26:16.681 0 00:26:16.681 12:40:09 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:16.681 12:40:09 -- host/digest.sh@92 -- # get_accel_stats 00:26:16.681 12:40:09 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:16.681 12:40:09 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:16.681 | select(.opcode=="crc32c") 00:26:16.681 | "\(.module_name) \(.executed)"' 00:26:16.681 12:40:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:16.681 12:40:10 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:16.681 12:40:10 -- host/digest.sh@93 -- # exp_module=software 00:26:16.681 12:40:10 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:16.681 12:40:10 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:16.681 12:40:10 -- host/digest.sh@97 -- # killprocess 1379312 00:26:16.681 12:40:10 -- common/autotest_common.sh@926 -- # '[' -z 1379312 ']' 00:26:16.681 12:40:10 -- common/autotest_common.sh@930 -- # kill -0 1379312 00:26:16.681 12:40:10 -- common/autotest_common.sh@931 -- # uname 00:26:16.681 12:40:10 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:16.681 12:40:10 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1379312 00:26:16.681 12:40:10 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:16.681 12:40:10 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:16.681 12:40:10 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1379312' 00:26:16.681 killing process with pid 1379312 00:26:16.681 12:40:10 -- common/autotest_common.sh@945 -- # kill 1379312 00:26:16.681 Received shutdown signal, test time was about 2.000000 seconds 00:26:16.681 00:26:16.681 Latency(us) 00:26:16.681 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:16.681 =================================================================================================================== 00:26:16.681 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:16.681 12:40:10 -- common/autotest_common.sh@950 -- # wait 1379312 00:26:16.681 12:40:10 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:16.681 12:40:10 -- host/digest.sh@77 -- # local rw bs qd 00:26:16.681 12:40:10 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:16.681 12:40:10 -- host/digest.sh@80 -- # rw=randwrite 00:26:16.681 12:40:10 -- host/digest.sh@80 -- # bs=4096 00:26:16.681 12:40:10 -- host/digest.sh@80 -- # qd=128 00:26:16.681 12:40:10 -- host/digest.sh@82 -- # bperfpid=1379853 00:26:16.681 12:40:10 -- host/digest.sh@83 -- # waitforlisten 1379853 /var/tmp/bperf.sock 00:26:16.681 12:40:10 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:16.681 12:40:10 -- common/autotest_common.sh@819 -- # '[' -z 1379853 ']' 00:26:16.681 12:40:10 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:16.681 12:40:10 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:16.681 12:40:10 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:16.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:16.681 12:40:10 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:16.681 12:40:10 -- common/autotest_common.sh@10 -- # set +x 00:26:16.681 [2024-07-12 12:40:10.574721] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:16.681 [2024-07-12 12:40:10.574798] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1379853 ] 00:26:16.939 EAL: No free 2048 kB hugepages reported on node 1 00:26:16.939 [2024-07-12 12:40:10.632844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:16.939 [2024-07-12 12:40:10.737289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:16.939 12:40:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:16.939 12:40:10 -- common/autotest_common.sh@852 -- # return 0 00:26:16.939 12:40:10 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:16.939 12:40:10 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:16.939 12:40:10 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:17.198 12:40:11 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:17.198 12:40:11 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:17.792 nvme0n1 00:26:17.792 12:40:11 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:17.792 12:40:11 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:17.792 Running I/O for 2 seconds... 00:26:19.703 00:26:19.703 Latency(us) 00:26:19.703 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:19.703 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:19.703 nvme0n1 : 2.01 19331.51 75.51 0.00 0.00 6606.79 3082.62 17767.54 00:26:19.703 =================================================================================================================== 00:26:19.703 Total : 19331.51 75.51 0.00 0.00 6606.79 3082.62 17767.54 00:26:19.703 0 00:26:19.703 12:40:13 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:19.703 12:40:13 -- host/digest.sh@92 -- # get_accel_stats 00:26:19.703 12:40:13 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:19.703 12:40:13 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:19.703 | select(.opcode=="crc32c") 00:26:19.703 | "\(.module_name) \(.executed)"' 00:26:19.703 12:40:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:19.960 12:40:13 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:19.960 12:40:13 -- host/digest.sh@93 -- # exp_module=software 00:26:19.960 12:40:13 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:19.960 12:40:13 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:19.960 12:40:13 -- host/digest.sh@97 -- # killprocess 1379853 00:26:19.960 12:40:13 -- common/autotest_common.sh@926 -- # '[' -z 1379853 ']' 00:26:19.960 12:40:13 -- common/autotest_common.sh@930 -- # kill -0 1379853 00:26:19.960 12:40:13 -- common/autotest_common.sh@931 -- # uname 00:26:19.960 12:40:13 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:19.960 12:40:13 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1379853 00:26:19.960 12:40:13 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:19.960 12:40:13 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:19.960 12:40:13 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1379853' 00:26:19.960 killing process with pid 1379853 00:26:19.960 12:40:13 -- common/autotest_common.sh@945 -- # kill 1379853 00:26:19.960 Received shutdown signal, test time was about 2.000000 seconds 00:26:19.960 00:26:19.960 Latency(us) 00:26:19.960 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:19.960 =================================================================================================================== 00:26:19.960 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:19.960 12:40:13 -- common/autotest_common.sh@950 -- # wait 1379853 00:26:20.218 12:40:14 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:26:20.218 12:40:14 -- host/digest.sh@77 -- # local rw bs qd 00:26:20.218 12:40:14 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:20.218 12:40:14 -- host/digest.sh@80 -- # rw=randwrite 00:26:20.218 12:40:14 -- host/digest.sh@80 -- # bs=131072 00:26:20.218 12:40:14 -- host/digest.sh@80 -- # qd=16 00:26:20.218 12:40:14 -- host/digest.sh@82 -- # bperfpid=1380268 00:26:20.218 12:40:14 -- host/digest.sh@83 -- # waitforlisten 1380268 /var/tmp/bperf.sock 00:26:20.218 12:40:14 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:20.218 12:40:14 -- common/autotest_common.sh@819 -- # '[' -z 1380268 ']' 00:26:20.218 12:40:14 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:20.218 12:40:14 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:20.218 12:40:14 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:20.218 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:20.218 12:40:14 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:20.218 12:40:14 -- common/autotest_common.sh@10 -- # set +x 00:26:20.218 [2024-07-12 12:40:14.112006] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:20.218 [2024-07-12 12:40:14.112089] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1380268 ] 00:26:20.218 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:20.218 Zero copy mechanism will not be used. 00:26:20.475 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.475 [2024-07-12 12:40:14.174767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:20.475 [2024-07-12 12:40:14.289194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:20.475 12:40:14 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:20.475 12:40:14 -- common/autotest_common.sh@852 -- # return 0 00:26:20.475 12:40:14 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:20.475 12:40:14 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:20.475 12:40:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:20.734 12:40:14 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:20.734 12:40:14 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:21.302 nvme0n1 00:26:21.302 12:40:14 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:21.302 12:40:14 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:21.302 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:21.302 Zero copy mechanism will not be used. 00:26:21.302 Running I/O for 2 seconds... 00:26:23.208 00:26:23.208 Latency(us) 00:26:23.208 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:23.208 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:23.208 nvme0n1 : 2.00 6752.62 844.08 0.00 0.00 2362.44 1832.58 4757.43 00:26:23.208 =================================================================================================================== 00:26:23.208 Total : 6752.62 844.08 0.00 0.00 2362.44 1832.58 4757.43 00:26:23.208 0 00:26:23.208 12:40:17 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:23.208 12:40:17 -- host/digest.sh@92 -- # get_accel_stats 00:26:23.208 12:40:17 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:23.208 12:40:17 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:23.208 12:40:17 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:23.208 | select(.opcode=="crc32c") 00:26:23.208 | "\(.module_name) \(.executed)"' 00:26:23.467 12:40:17 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:23.467 12:40:17 -- host/digest.sh@93 -- # exp_module=software 00:26:23.467 12:40:17 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:23.467 12:40:17 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:23.467 12:40:17 -- host/digest.sh@97 -- # killprocess 1380268 00:26:23.467 12:40:17 -- common/autotest_common.sh@926 -- # '[' -z 1380268 ']' 00:26:23.467 12:40:17 -- common/autotest_common.sh@930 -- # kill -0 1380268 00:26:23.467 12:40:17 -- common/autotest_common.sh@931 -- # uname 00:26:23.467 12:40:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:23.467 12:40:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1380268 00:26:23.467 12:40:17 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:23.467 12:40:17 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:23.467 12:40:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1380268' 00:26:23.467 killing process with pid 1380268 00:26:23.467 12:40:17 -- common/autotest_common.sh@945 -- # kill 1380268 00:26:23.467 Received shutdown signal, test time was about 2.000000 seconds 00:26:23.467 00:26:23.467 Latency(us) 00:26:23.467 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:23.467 =================================================================================================================== 00:26:23.467 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:23.467 12:40:17 -- common/autotest_common.sh@950 -- # wait 1380268 00:26:23.726 12:40:17 -- host/digest.sh@126 -- # killprocess 1378869 00:26:23.726 12:40:17 -- common/autotest_common.sh@926 -- # '[' -z 1378869 ']' 00:26:23.726 12:40:17 -- common/autotest_common.sh@930 -- # kill -0 1378869 00:26:23.726 12:40:17 -- common/autotest_common.sh@931 -- # uname 00:26:23.726 12:40:17 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:23.726 12:40:17 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1378869 00:26:23.726 12:40:17 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:23.726 12:40:17 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:23.726 12:40:17 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1378869' 00:26:23.726 killing process with pid 1378869 00:26:23.726 12:40:17 -- common/autotest_common.sh@945 -- # kill 1378869 00:26:23.726 12:40:17 -- common/autotest_common.sh@950 -- # wait 1378869 00:26:23.984 00:26:23.984 real 0m15.271s 00:26:23.984 user 0m30.023s 00:26:23.984 sys 0m4.346s 00:26:23.984 12:40:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:23.984 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:26:23.984 ************************************ 00:26:23.984 END TEST nvmf_digest_clean 00:26:23.984 ************************************ 00:26:24.242 12:40:17 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:26:24.242 12:40:17 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:26:24.242 12:40:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:24.242 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:26:24.242 ************************************ 00:26:24.242 START TEST nvmf_digest_error 00:26:24.242 ************************************ 00:26:24.242 12:40:17 -- common/autotest_common.sh@1104 -- # run_digest_error 00:26:24.242 12:40:17 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:26:24.242 12:40:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:24.242 12:40:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:24.242 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:26:24.242 12:40:17 -- nvmf/common.sh@469 -- # nvmfpid=1380724 00:26:24.242 12:40:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:24.242 12:40:17 -- nvmf/common.sh@470 -- # waitforlisten 1380724 00:26:24.242 12:40:17 -- common/autotest_common.sh@819 -- # '[' -z 1380724 ']' 00:26:24.242 12:40:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:24.242 12:40:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:24.242 12:40:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:24.242 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:24.242 12:40:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:24.242 12:40:17 -- common/autotest_common.sh@10 -- # set +x 00:26:24.242 [2024-07-12 12:40:17.978020] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:24.242 [2024-07-12 12:40:17.978095] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:24.242 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.242 [2024-07-12 12:40:18.040952] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:24.242 [2024-07-12 12:40:18.144417] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:24.242 [2024-07-12 12:40:18.144575] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:24.242 [2024-07-12 12:40:18.144592] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:24.242 [2024-07-12 12:40:18.144604] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:24.242 [2024-07-12 12:40:18.144637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:24.500 12:40:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:24.500 12:40:18 -- common/autotest_common.sh@852 -- # return 0 00:26:24.500 12:40:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:24.500 12:40:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:24.500 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.500 12:40:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:24.500 12:40:18 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:26:24.500 12:40:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.500 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.500 [2024-07-12 12:40:18.201201] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:26:24.500 12:40:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.500 12:40:18 -- host/digest.sh@104 -- # common_target_config 00:26:24.500 12:40:18 -- host/digest.sh@43 -- # rpc_cmd 00:26:24.500 12:40:18 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:24.500 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.500 null0 00:26:24.500 [2024-07-12 12:40:18.318652] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:24.500 [2024-07-12 12:40:18.342879] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:24.500 12:40:18 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:24.500 12:40:18 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:26:24.500 12:40:18 -- host/digest.sh@54 -- # local rw bs qd 00:26:24.500 12:40:18 -- host/digest.sh@56 -- # rw=randread 00:26:24.500 12:40:18 -- host/digest.sh@56 -- # bs=4096 00:26:24.500 12:40:18 -- host/digest.sh@56 -- # qd=128 00:26:24.500 12:40:18 -- host/digest.sh@58 -- # bperfpid=1380865 00:26:24.500 12:40:18 -- host/digest.sh@60 -- # waitforlisten 1380865 /var/tmp/bperf.sock 00:26:24.500 12:40:18 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:26:24.500 12:40:18 -- common/autotest_common.sh@819 -- # '[' -z 1380865 ']' 00:26:24.500 12:40:18 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:24.500 12:40:18 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:24.500 12:40:18 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:24.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:24.500 12:40:18 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:24.500 12:40:18 -- common/autotest_common.sh@10 -- # set +x 00:26:24.500 [2024-07-12 12:40:18.385783] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:24.500 [2024-07-12 12:40:18.385862] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1380865 ] 00:26:24.500 EAL: No free 2048 kB hugepages reported on node 1 00:26:24.758 [2024-07-12 12:40:18.444889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:24.758 [2024-07-12 12:40:18.550516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:25.696 12:40:19 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:25.696 12:40:19 -- common/autotest_common.sh@852 -- # return 0 00:26:25.696 12:40:19 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:25.696 12:40:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:25.954 12:40:19 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:25.954 12:40:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:25.954 12:40:19 -- common/autotest_common.sh@10 -- # set +x 00:26:25.954 12:40:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:25.954 12:40:19 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:25.954 12:40:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:26.214 nvme0n1 00:26:26.214 12:40:20 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:26.474 12:40:20 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:26.474 12:40:20 -- common/autotest_common.sh@10 -- # set +x 00:26:26.474 12:40:20 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:26.474 12:40:20 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:26.474 12:40:20 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:26.474 Running I/O for 2 seconds... 00:26:26.474 [2024-07-12 12:40:20.285052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.474 [2024-07-12 12:40:20.285101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13726 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.474 [2024-07-12 12:40:20.285122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.474 [2024-07-12 12:40:20.295756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.474 [2024-07-12 12:40:20.295789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:639 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.474 [2024-07-12 12:40:20.295807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.474 [2024-07-12 12:40:20.312078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.474 [2024-07-12 12:40:20.312122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:2610 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.474 [2024-07-12 12:40:20.312140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.475 [2024-07-12 12:40:20.327703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.475 [2024-07-12 12:40:20.327731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.475 [2024-07-12 12:40:20.327771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.475 [2024-07-12 12:40:20.342788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.475 [2024-07-12 12:40:20.342816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:15745 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.475 [2024-07-12 12:40:20.342847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.475 [2024-07-12 12:40:20.352607] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.475 [2024-07-12 12:40:20.352635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:3540 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.475 [2024-07-12 12:40:20.352667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.475 [2024-07-12 12:40:20.367198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.475 [2024-07-12 12:40:20.367226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:13860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.475 [2024-07-12 12:40:20.367256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.475 [2024-07-12 12:40:20.382473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.475 [2024-07-12 12:40:20.382502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:1715 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.475 [2024-07-12 12:40:20.382532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.397908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.397938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:11181 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.397954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.413210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.413238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:909 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.413270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.429105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.429134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:12114 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.429151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.442265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.442298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:14973 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.442318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.455675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.455715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4001 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.455735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.467679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.467712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:12657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.467731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.484131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.484160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.484176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.735 [2024-07-12 12:40:20.500673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.735 [2024-07-12 12:40:20.500707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:6739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.735 [2024-07-12 12:40:20.500726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.517330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.517362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:17995 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.517380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.527939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.527967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23100 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.527999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.549756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.549789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:22436 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.549808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.566677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.566710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25510 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.566729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.577941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.577970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:14343 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.577988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.594397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.594431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:12183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.594450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.611830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.611863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:3332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.611893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.628724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.628758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14807 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.628777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.736 [2024-07-12 12:40:20.644615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.736 [2024-07-12 12:40:20.644648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:4771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.736 [2024-07-12 12:40:20.644668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.656995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.657023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:19483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.657055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.671736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.671770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:16405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.671789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.689112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.689139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:4152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.689171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.706054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.706082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:20318 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.706112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.723689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.723723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:8530 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.723750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.740516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.740550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:4107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.740569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.757356] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.757390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:13323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.757409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.768063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.768089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:3299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.768120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.783696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.783729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:14773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.783748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.800539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.800572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:4238 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.800591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.816150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.816178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:12928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.816194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.832079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.832106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:3409 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.832138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.847629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.847662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:18093 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.847681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.859650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.859683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.859702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.877064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.877091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.877122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.894155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.894201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19509 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.894221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:26.997 [2024-07-12 12:40:20.910326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:26.997 [2024-07-12 12:40:20.910359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:17044 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:26.997 [2024-07-12 12:40:20.910378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:20.925210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:20.925246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:2046 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:20.925265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:20.936386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:20.936419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:16330 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:20.936439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:20.952346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:20.952378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:10381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:20.952398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:20.969706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:20.969740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:10933 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:20.969758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:20.986969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:20.986997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:20.987033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.003954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.003982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:19120 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.004012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.020279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.020313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.020332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.031685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.031718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:15687 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.031736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.049247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.049281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:11344 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.049300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.066311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.066345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:6240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.066366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.077806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.077839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:16062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.077858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.094032] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.094059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:20340 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.094090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.111764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.111797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:23954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.111816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.128524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.128564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:24506 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.128584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.145183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.145217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:24003 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.145236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.258 [2024-07-12 12:40:21.162412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.258 [2024-07-12 12:40:21.162447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:16215 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.258 [2024-07-12 12:40:21.162466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.517 [2024-07-12 12:40:21.179514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.517 [2024-07-12 12:40:21.179549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:13936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.517 [2024-07-12 12:40:21.179568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.517 [2024-07-12 12:40:21.196596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.517 [2024-07-12 12:40:21.196630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:7056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.517 [2024-07-12 12:40:21.196649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.517 [2024-07-12 12:40:21.213583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.517 [2024-07-12 12:40:21.213616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:4241 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.517 [2024-07-12 12:40:21.213635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.517 [2024-07-12 12:40:21.229852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.229892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:24056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.229911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.240689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.240721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:12706 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.240739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.256444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.256477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:2211 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.256496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.273605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.273637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:18774 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.273656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.290626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.290659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:5458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.290678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.307600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.307634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:15946 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.307652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.325122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.325148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:2981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.325164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.348666] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.348700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:21936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.348719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.365537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.365570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:15949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.365590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.381036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.381066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:19969 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.381083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.392201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.392233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:12088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.392253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.409898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.409944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.409966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.518 [2024-07-12 12:40:21.425466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.518 [2024-07-12 12:40:21.425494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:1731 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.518 [2024-07-12 12:40:21.425524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.442861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.442917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:1738 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.442934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.459814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.459847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:25068 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.459873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.476056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.476085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:4296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.476102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.492151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.492181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:21374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.492199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.504048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.504074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:18716 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.504106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.521067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.521093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22596 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.521125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.534242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.534269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:9713 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.534299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.551851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.551895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12855 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.551916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.562524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.562556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:18908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.562575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.578746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.578779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:4784 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.578798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.594585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.594618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:1926 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.594637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.612616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.612649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:7063 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.612668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.628586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.628620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:12383 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.628639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.640553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.640587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:1939 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.640606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.657108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.657138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:25169 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.657155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.671567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.671600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:10553 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.671625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:27.777 [2024-07-12 12:40:21.688287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:27.777 [2024-07-12 12:40:21.688321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:2156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:27.777 [2024-07-12 12:40:21.688340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.705525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.705560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:9534 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.705578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.717424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.717457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10899 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.717476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.732414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.732447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:1957 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.732466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.748399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.748432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:9270 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.748451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.760305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.760337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:4082 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.760357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.774815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.774848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:24057 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.774873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.792025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.792054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:86 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.792086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.809597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.809638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:6757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.809659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.821225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.821258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:20450 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.821278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.837216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.837249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:5534 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.837268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.853992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.854018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:11188 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.854049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.871341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.871375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:19469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.871395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.888909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.888958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.888975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.900004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.900047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.900064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.914751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.914785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14105 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.914804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.036 [2024-07-12 12:40:21.926073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.036 [2024-07-12 12:40:21.926100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:17077 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.036 [2024-07-12 12:40:21.926131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.037 [2024-07-12 12:40:21.942345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.037 [2024-07-12 12:40:21.942378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:25574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.037 [2024-07-12 12:40:21.942397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.295 [2024-07-12 12:40:21.958739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.295 [2024-07-12 12:40:21.958772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:17234 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.295 [2024-07-12 12:40:21.958791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.295 [2024-07-12 12:40:21.975925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.295 [2024-07-12 12:40:21.975952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:3791 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.295 [2024-07-12 12:40:21.975982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.295 [2024-07-12 12:40:21.993026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.295 [2024-07-12 12:40:21.993053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:6737 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.295 [2024-07-12 12:40:21.993085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.295 [2024-07-12 12:40:22.010759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.295 [2024-07-12 12:40:22.010792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:2575 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.295 [2024-07-12 12:40:22.010812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.295 [2024-07-12 12:40:22.021571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.295 [2024-07-12 12:40:22.021604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:4811 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.295 [2024-07-12 12:40:22.021624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.295 [2024-07-12 12:40:22.037465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.295 [2024-07-12 12:40:22.037498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:1039 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.295 [2024-07-12 12:40:22.037517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.055518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.055551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:11078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.055570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.070974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.071001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5528 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.071036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.088946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.088973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:12635 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.089004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.105873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.105919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:12034 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.105935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.122812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.122844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.122863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.139796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.139829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5220 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.139848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.155874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.155922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:15183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.155939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.167886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.167929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5315 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.167945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.183828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.183875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.183909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.296 [2024-07-12 12:40:22.201643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.296 [2024-07-12 12:40:22.201677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:13380 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.296 [2024-07-12 12:40:22.201696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.554 [2024-07-12 12:40:22.218064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.554 [2024-07-12 12:40:22.218100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:2149 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.554 [2024-07-12 12:40:22.218118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.554 [2024-07-12 12:40:22.229442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.554 [2024-07-12 12:40:22.229475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.554 [2024-07-12 12:40:22.229494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.554 [2024-07-12 12:40:22.245715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.554 [2024-07-12 12:40:22.245748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5834 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.554 [2024-07-12 12:40:22.245767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.554 [2024-07-12 12:40:22.261097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x16adf00) 00:26:28.554 [2024-07-12 12:40:22.261124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:24824 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:28.554 [2024-07-12 12:40:22.261155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:28.554 00:26:28.554 Latency(us) 00:26:28.554 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.554 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:28.554 nvme0n1 : 2.00 16356.92 63.89 0.00 0.00 7815.33 3470.98 26214.40 00:26:28.554 =================================================================================================================== 00:26:28.554 Total : 16356.92 63.89 0.00 0.00 7815.33 3470.98 26214.40 00:26:28.554 0 00:26:28.554 12:40:22 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:28.554 12:40:22 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:28.554 12:40:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:28.554 12:40:22 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:28.554 | .driver_specific 00:26:28.554 | .nvme_error 00:26:28.554 | .status_code 00:26:28.554 | .command_transient_transport_error' 00:26:28.815 12:40:22 -- host/digest.sh@71 -- # (( 128 > 0 )) 00:26:28.815 12:40:22 -- host/digest.sh@73 -- # killprocess 1380865 00:26:28.815 12:40:22 -- common/autotest_common.sh@926 -- # '[' -z 1380865 ']' 00:26:28.815 12:40:22 -- common/autotest_common.sh@930 -- # kill -0 1380865 00:26:28.815 12:40:22 -- common/autotest_common.sh@931 -- # uname 00:26:28.815 12:40:22 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:28.815 12:40:22 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1380865 00:26:28.815 12:40:22 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:28.815 12:40:22 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:28.815 12:40:22 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1380865' 00:26:28.815 killing process with pid 1380865 00:26:28.815 12:40:22 -- common/autotest_common.sh@945 -- # kill 1380865 00:26:28.815 Received shutdown signal, test time was about 2.000000 seconds 00:26:28.815 00:26:28.815 Latency(us) 00:26:28.815 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:28.815 =================================================================================================================== 00:26:28.815 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:28.815 12:40:22 -- common/autotest_common.sh@950 -- # wait 1380865 00:26:29.074 12:40:22 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:26:29.074 12:40:22 -- host/digest.sh@54 -- # local rw bs qd 00:26:29.074 12:40:22 -- host/digest.sh@56 -- # rw=randread 00:26:29.074 12:40:22 -- host/digest.sh@56 -- # bs=131072 00:26:29.074 12:40:22 -- host/digest.sh@56 -- # qd=16 00:26:29.074 12:40:22 -- host/digest.sh@58 -- # bperfpid=1381351 00:26:29.074 12:40:22 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:26:29.074 12:40:22 -- host/digest.sh@60 -- # waitforlisten 1381351 /var/tmp/bperf.sock 00:26:29.074 12:40:22 -- common/autotest_common.sh@819 -- # '[' -z 1381351 ']' 00:26:29.074 12:40:22 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:29.074 12:40:22 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:29.074 12:40:22 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:29.074 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:29.074 12:40:22 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:29.074 12:40:22 -- common/autotest_common.sh@10 -- # set +x 00:26:29.074 [2024-07-12 12:40:22.858221] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:29.074 [2024-07-12 12:40:22.858316] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1381351 ] 00:26:29.074 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:29.074 Zero copy mechanism will not be used. 00:26:29.074 EAL: No free 2048 kB hugepages reported on node 1 00:26:29.074 [2024-07-12 12:40:22.921964] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:29.332 [2024-07-12 12:40:23.035010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:30.269 12:40:23 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:30.269 12:40:23 -- common/autotest_common.sh@852 -- # return 0 00:26:30.269 12:40:23 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:30.269 12:40:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:30.269 12:40:24 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:30.269 12:40:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.269 12:40:24 -- common/autotest_common.sh@10 -- # set +x 00:26:30.269 12:40:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.269 12:40:24 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:30.269 12:40:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:30.837 nvme0n1 00:26:30.837 12:40:24 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:30.837 12:40:24 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:30.837 12:40:24 -- common/autotest_common.sh@10 -- # set +x 00:26:30.837 12:40:24 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:30.837 12:40:24 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:30.837 12:40:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:30.837 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:30.837 Zero copy mechanism will not be used. 00:26:30.837 Running I/O for 2 seconds... 00:26:30.837 [2024-07-12 12:40:24.619540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.619597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.619619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.626131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.626187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.626209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.631098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.631129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.631148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.636844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.636888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.636923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.642321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.642355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.642376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.647903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.647934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.647966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.653362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.653396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.653416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.658882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.658930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.658948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.664501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.664535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.664554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.670178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.670232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.670252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.675721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.837 [2024-07-12 12:40:24.675755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.837 [2024-07-12 12:40:24.675775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:30.837 [2024-07-12 12:40:24.681406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.681440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.681459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.686958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.686988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.687006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.692485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.692518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.692538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.698216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.698265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.698285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.703351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.703385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.703405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.707391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.707424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.707444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.711432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.711464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.711484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.716142] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.716191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.716211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.721069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.721099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.721116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.725363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.725396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.725415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.730593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.730627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.730645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.736365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.736399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.736419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.741506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.741540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.741560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.746341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.746375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.746395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:30.838 [2024-07-12 12:40:24.751540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:30.838 [2024-07-12 12:40:24.751575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:30.838 [2024-07-12 12:40:24.751594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.098 [2024-07-12 12:40:24.757460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.098 [2024-07-12 12:40:24.757496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.098 [2024-07-12 12:40:24.757521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.098 [2024-07-12 12:40:24.763358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.098 [2024-07-12 12:40:24.763393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.098 [2024-07-12 12:40:24.763413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.098 [2024-07-12 12:40:24.769479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.098 [2024-07-12 12:40:24.769514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.098 [2024-07-12 12:40:24.769534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.098 [2024-07-12 12:40:24.775351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.098 [2024-07-12 12:40:24.775386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.098 [2024-07-12 12:40:24.775405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.098 [2024-07-12 12:40:24.780968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.098 [2024-07-12 12:40:24.781013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.098 [2024-07-12 12:40:24.781031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.098 [2024-07-12 12:40:24.787054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.098 [2024-07-12 12:40:24.787085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.787102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.792807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.792841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.792861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.798399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.798433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.798453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.804753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.804787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.804807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.812423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.812467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.812487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.818564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.818599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.818619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.824439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.824473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.824493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.829977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.830008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.830026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.835311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.835345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.835365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.840991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.841020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.841052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.847542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.847577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.847597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.853329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.853363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.853382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.859226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.859260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.859279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.865821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.865855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.865883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.871710] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.871744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.871763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.876526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.876557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.876575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.881045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.881075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.881093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.885276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.885309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.885328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.889463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.889495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.889514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.893553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.893585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.893605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.897554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.897586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.897604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.901722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.901754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.901778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.905791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.905823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.905842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.909544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.909575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.909594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.913915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.913945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.913962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.918994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.919024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.919041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.924244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.924278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.924297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.929982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.930012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.930029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.935025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.935055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.935073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.099 [2024-07-12 12:40:24.941924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.099 [2024-07-12 12:40:24.941955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.099 [2024-07-12 12:40:24.941972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.948481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.948519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.948539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.955930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.955960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.955978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.962994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.963025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.963043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.968431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.968465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.968485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.973545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.973579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.973598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.976933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.976962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.976980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.982652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.982686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.982705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.987512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.987547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.987566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.992177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.992223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.992243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:24.996275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:24.996307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:24.996326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:25.000647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:25.000681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:25.000700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:25.005525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:25.005559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:25.005578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:25.009920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:25.009951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:25.009969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.100 [2024-07-12 12:40:25.014676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.100 [2024-07-12 12:40:25.014710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.100 [2024-07-12 12:40:25.014728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.019999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.020029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.020061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.025789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.025824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.025844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.031021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.031051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.031084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.036652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.036698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.036723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.042193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.042242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.042261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.048261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.048295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.048314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.054671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.054710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.054731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.060754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.060799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.060819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.066994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.067025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.067057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.072340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.072375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.072394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.078421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.078455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.078475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.083967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.084007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.084025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.089501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.089541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.089561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.095693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.095739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.095759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.360 [2024-07-12 12:40:25.100971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.360 [2024-07-12 12:40:25.101002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.360 [2024-07-12 12:40:25.101020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.105895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.105952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.105969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.111622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.111656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.111675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.117627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.117662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.117681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.124404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.124439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.124458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.130818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.130862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.130891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.137117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.137151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.137169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.143249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.143283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.143303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.149244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.149279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.149298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.155812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.155847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.155874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.161656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.161690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.161709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.166786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.166819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.166839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.171565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.171598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.171616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.176831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.176872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.176893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.182831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.182864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.182895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.187890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.187936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.187968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.192853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.192893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.192937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.198221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.198253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.198272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.204920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.204950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.204967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.212378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.212412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.212431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.218509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.218542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.218562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.224066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.224097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.224114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.228972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.229002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.229020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.233881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.233914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.233947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.238645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.238679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.238697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.243373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.243406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.243425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.249293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.249326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.249345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.254546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.254578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.254597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.259571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.259603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.259621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.361 [2024-07-12 12:40:25.264835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.361 [2024-07-12 12:40:25.264877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.361 [2024-07-12 12:40:25.264899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.362 [2024-07-12 12:40:25.271079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.362 [2024-07-12 12:40:25.271111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.362 [2024-07-12 12:40:25.271129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.362 [2024-07-12 12:40:25.277682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.362 [2024-07-12 12:40:25.277716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.362 [2024-07-12 12:40:25.277736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.284470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.284505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.284530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.290974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.291004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.291022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.297344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.297378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.297398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.303718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.303752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.303771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.309470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.309504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.309524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.314656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.314689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.314708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.320000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.320031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.320048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.325321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.325355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.325374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.330984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.331028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.331045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.336387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.336426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.336446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.342608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.342642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.342661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.348364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.348398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.348417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.353951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.353981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.353999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.359442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.359476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.359495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.364486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.364519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.364538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.369566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.621 [2024-07-12 12:40:25.369599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.621 [2024-07-12 12:40:25.369618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.621 [2024-07-12 12:40:25.375330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.375364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.375382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.380376] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.380406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.380423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.385729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.385762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.385781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.388747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.388779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.388797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.393747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.393779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.393798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.399946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.399976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.399993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.404948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.404992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.405009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.410215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.410260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.410278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.415397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.415429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.415448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.420451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.420483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.420502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.425612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.425643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.425668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.431681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.431714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.431734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.437483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.437516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.437535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.444671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.444704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.444723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.451584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.451618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.451637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.457688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.457721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.457740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.464497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.464530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.464549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.470005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.470033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.470066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.476454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.476487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.476506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.481630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.481668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.481688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.486250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.486283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.486301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.491493] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.491525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.491543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.496636] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.496667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.496686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.501655] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.501687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.501706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.506570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.506601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.506619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.511505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.511536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.511554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.516716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.516748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.516768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.521806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.521838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.521856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.526980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.527008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.622 [2024-07-12 12:40:25.527041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.622 [2024-07-12 12:40:25.532037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.622 [2024-07-12 12:40:25.532067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.623 [2024-07-12 12:40:25.532084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.623 [2024-07-12 12:40:25.538117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.623 [2024-07-12 12:40:25.538146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.623 [2024-07-12 12:40:25.538163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.882 [2024-07-12 12:40:25.543197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.882 [2024-07-12 12:40:25.543230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.882 [2024-07-12 12:40:25.543249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.882 [2024-07-12 12:40:25.548258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.882 [2024-07-12 12:40:25.548291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.882 [2024-07-12 12:40:25.548309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.882 [2024-07-12 12:40:25.552846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.882 [2024-07-12 12:40:25.552888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.882 [2024-07-12 12:40:25.552923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.882 [2024-07-12 12:40:25.557621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.882 [2024-07-12 12:40:25.557653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.882 [2024-07-12 12:40:25.557671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.562814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.562846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.562864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.567880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.567912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.567936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.573012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.573040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.573056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.578047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.578075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.578106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.583661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.583691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.583708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.588282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.588315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.588333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.593456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.593488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.593506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.597882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.597928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.597945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.602777] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.602810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.602829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.607640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.607672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.607691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.613273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.613305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.613324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.617483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.617514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.617533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.623596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.623630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.623649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.628900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.628931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.628948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.633247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.633278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.633296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.637397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.637428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.637446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.641410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.641442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.641461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.645368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.645400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.645420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.649832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.649864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.649915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.654619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.654651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.654670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.659002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.659031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.659053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.663422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.663453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.663472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.668336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.668368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.668387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.673272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.673304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.673323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.678347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.883 [2024-07-12 12:40:25.678379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.883 [2024-07-12 12:40:25.678397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.883 [2024-07-12 12:40:25.683287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.683319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.683337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.688089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.688116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.688132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.693169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.693219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.693239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.698163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.698208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.698226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.703888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.703934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.703952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.708382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.708413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.708432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.713334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.713366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.713385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.718338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.718370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.718389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.723970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.724015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.724032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.728347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.728378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.728397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.733524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.733556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.733575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.738575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.738608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.738627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.743890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.743935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.743952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.749071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.749099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.749115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.754103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.754131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.754147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.759076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.759103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.759135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.764062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.764091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.764123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.768989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.769017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.769034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.773958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.773986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.774018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.778805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.778836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.778860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.783842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.783882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.783902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.788645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.788676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.788696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.793543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.793575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.793593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:31.884 [2024-07-12 12:40:25.798642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:31.884 [2024-07-12 12:40:25.798674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:31.884 [2024-07-12 12:40:25.798693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.146 [2024-07-12 12:40:25.803615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.146 [2024-07-12 12:40:25.803647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.803665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.808631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.808663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.808682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.813593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.813625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.813643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.818523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.818554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.818573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.823589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.823625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.823645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.828509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.828541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.828560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.833546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.833578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.833596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.838613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.838646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.838665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.844460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.844492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.844511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.848980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.849008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.849026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.854115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.854144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.854162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.859305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.859337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.859356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.864479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.864512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.864531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.869510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.869542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.869561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.874443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.874475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.874493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.879592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.879625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.879643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.885122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.885153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.885171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.891283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.891317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.891336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.898696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.898731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.898750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.906095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.906142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.906159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.913862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.913920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.913937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.922333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.922368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.922393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.929491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.929525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.929545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.937685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.147 [2024-07-12 12:40:25.937719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.147 [2024-07-12 12:40:25.937739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.147 [2024-07-12 12:40:25.945186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.945234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.945253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:25.953004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.953035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.953053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:25.960582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.960617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.960637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:25.968322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.968357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.968376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:25.976132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.976179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.976200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:25.984322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.984358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.984378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:25.991969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:25.992014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:25.992032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.000211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.000246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.000265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.008188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.008233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.008253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.015144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.015196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.015216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.021278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.021313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.021334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.027159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.027193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.027212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.032680] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.032714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.032734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.038158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.038188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.038221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.043645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.043678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.043703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.048644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.048676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.048695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.053483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.053515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.053533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.057791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.057824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.057843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.148 [2024-07-12 12:40:26.062274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.148 [2024-07-12 12:40:26.062306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.148 [2024-07-12 12:40:26.062325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.466 [2024-07-12 12:40:26.067378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.466 [2024-07-12 12:40:26.067413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.466 [2024-07-12 12:40:26.067432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.466 [2024-07-12 12:40:26.072723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.466 [2024-07-12 12:40:26.072755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.466 [2024-07-12 12:40:26.072774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.466 [2024-07-12 12:40:26.078153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.466 [2024-07-12 12:40:26.078199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.466 [2024-07-12 12:40:26.078219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.466 [2024-07-12 12:40:26.083591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.466 [2024-07-12 12:40:26.083624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.083643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.089289] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.089328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.089348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.094615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.094648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.094668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.099958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.099988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.100006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.105552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.105585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.105604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.111855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.111912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.111931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.118059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.118090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.118107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.124059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.124098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.124116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.130542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.130576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.130595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.136364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.136398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.136418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.141542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.141574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.141593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.147030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.147060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.147093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.153889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.153937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.153954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.161381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.161415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.161434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.167442] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.167478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.167498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.172779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.172814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.172833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.177625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.177660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.177679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.182648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.182683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.182702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.188133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.188179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.188204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.193771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.193805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.193824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.199476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.199511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.199531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.205481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.205515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.205536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.211608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.211643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.211663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.217331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.217365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.217384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.222929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.222974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.222992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.228795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.228829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.228849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.234473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.234507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.234526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.239944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.239984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.240003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.467 [2024-07-12 12:40:26.244507] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.467 [2024-07-12 12:40:26.244542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.467 [2024-07-12 12:40:26.244561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.248446] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.248481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.248500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.252685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.252718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.252737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.257501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.257533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.257553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.262285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.262318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.262338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.266575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.266608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.266626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.270717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.270749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.270767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.274528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.274560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.274579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.278969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.278998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.279015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.283718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.283751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.283769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.288760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.288792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.288810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.294020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.294049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.294066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.298965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.298993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.299010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.303812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.303843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.303861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.308788] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.308819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.308837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.314007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.314036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.314053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.319096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.319125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.319156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.324158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.324186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.324203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.329254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.329286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.329304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.334185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.334233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.334251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.339312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.339344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.339362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.344230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.344273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.344292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.349140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.349169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.349185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.468 [2024-07-12 12:40:26.354254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.468 [2024-07-12 12:40:26.354286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.468 [2024-07-12 12:40:26.354305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.359267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.359300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.359319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.364240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.364277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.364296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.369277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.369309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.369328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.374335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.374368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.374387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.378640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.378672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.378690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.381994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.382023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.382039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.386435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.386464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.386495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.391328] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.391361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.391380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.395608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.395639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.395658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.399719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.399750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.399769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.403785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.403816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.403835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.407698] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.407730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.407748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.728 [2024-07-12 12:40:26.411520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.728 [2024-07-12 12:40:26.411552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.728 [2024-07-12 12:40:26.411570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.416022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.416064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.416080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.421221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.421252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.421271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.426050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.426078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.426094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.431072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.431099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.431132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.436068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.436096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.436128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.441042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.441070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.441107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.446009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.446036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.446068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.451096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.451124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.451140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.455930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.455957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.455989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.460879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.460923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.460939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.466085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.466114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.466131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.471122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.471151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.471168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.476021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.476048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.476081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.480923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.480951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.480983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.485942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.485970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.486001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.490792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.490824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.490843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.495609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.495641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.495659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.500688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.500720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.500738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.505538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.505569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.505588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.510447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.510478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.510497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.515440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.515472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.515490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.520367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.520397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.520416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.525331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.525362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.525381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.530331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.530362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.530381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.535327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.535360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.535378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.540084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.540112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.540143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.544765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.544797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.544815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.549248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.729 [2024-07-12 12:40:26.549281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.729 [2024-07-12 12:40:26.549300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.729 [2024-07-12 12:40:26.554383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.554416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.554435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.559923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.559954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.559971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.566366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.566400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.566420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.570950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.570980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.571003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.575888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.575934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.575952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.581303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.581336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.581356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.587054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.587084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.587101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.593382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.593415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.593434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.599232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.599265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.599285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.606303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.606336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.606356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.611944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.611973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.611990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:32.730 [2024-07-12 12:40:26.616697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x6c3880) 00:26:32.730 [2024-07-12 12:40:26.616730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:32.730 [2024-07-12 12:40:26.616748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:32.730 00:26:32.730 Latency(us) 00:26:32.730 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:32.730 Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:32.730 nvme0n1 : 2.00 5774.54 721.82 0.00 0.00 2766.69 631.09 8252.68 00:26:32.730 =================================================================================================================== 00:26:32.730 Total : 5774.54 721.82 0.00 0.00 2766.69 631.09 8252.68 00:26:32.730 0 00:26:32.730 12:40:26 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:32.730 12:40:26 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:32.730 12:40:26 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:32.730 | .driver_specific 00:26:32.730 | .nvme_error 00:26:32.730 | .status_code 00:26:32.730 | .command_transient_transport_error' 00:26:32.730 12:40:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:32.989 12:40:26 -- host/digest.sh@71 -- # (( 372 > 0 )) 00:26:32.989 12:40:26 -- host/digest.sh@73 -- # killprocess 1381351 00:26:32.989 12:40:26 -- common/autotest_common.sh@926 -- # '[' -z 1381351 ']' 00:26:32.989 12:40:26 -- common/autotest_common.sh@930 -- # kill -0 1381351 00:26:32.989 12:40:26 -- common/autotest_common.sh@931 -- # uname 00:26:32.989 12:40:26 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:32.989 12:40:26 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1381351 00:26:32.989 12:40:26 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:32.989 12:40:26 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:32.989 12:40:26 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1381351' 00:26:32.989 killing process with pid 1381351 00:26:32.989 12:40:26 -- common/autotest_common.sh@945 -- # kill 1381351 00:26:32.989 Received shutdown signal, test time was about 2.000000 seconds 00:26:32.989 00:26:32.989 Latency(us) 00:26:32.989 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:32.989 =================================================================================================================== 00:26:32.989 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:32.989 12:40:26 -- common/autotest_common.sh@950 -- # wait 1381351 00:26:33.555 12:40:27 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:26:33.555 12:40:27 -- host/digest.sh@54 -- # local rw bs qd 00:26:33.555 12:40:27 -- host/digest.sh@56 -- # rw=randwrite 00:26:33.555 12:40:27 -- host/digest.sh@56 -- # bs=4096 00:26:33.555 12:40:27 -- host/digest.sh@56 -- # qd=128 00:26:33.555 12:40:27 -- host/digest.sh@58 -- # bperfpid=1381855 00:26:33.555 12:40:27 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:26:33.555 12:40:27 -- host/digest.sh@60 -- # waitforlisten 1381855 /var/tmp/bperf.sock 00:26:33.555 12:40:27 -- common/autotest_common.sh@819 -- # '[' -z 1381855 ']' 00:26:33.555 12:40:27 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:33.555 12:40:27 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:33.555 12:40:27 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:33.555 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:33.555 12:40:27 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:33.555 12:40:27 -- common/autotest_common.sh@10 -- # set +x 00:26:33.555 [2024-07-12 12:40:27.207892] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:33.555 [2024-07-12 12:40:27.207968] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1381855 ] 00:26:33.555 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.555 [2024-07-12 12:40:27.266685] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:33.555 [2024-07-12 12:40:27.375155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:34.489 12:40:28 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:34.489 12:40:28 -- common/autotest_common.sh@852 -- # return 0 00:26:34.489 12:40:28 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:34.489 12:40:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:34.489 12:40:28 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:34.489 12:40:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:34.489 12:40:28 -- common/autotest_common.sh@10 -- # set +x 00:26:34.489 12:40:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:34.489 12:40:28 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:34.489 12:40:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:35.057 nvme0n1 00:26:35.057 12:40:28 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:26:35.057 12:40:28 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:35.057 12:40:28 -- common/autotest_common.sh@10 -- # set +x 00:26:35.057 12:40:28 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:35.057 12:40:28 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:35.057 12:40:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:35.314 Running I/O for 2 seconds... 00:26:35.314 [2024-07-12 12:40:29.059680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190eea00 00:26:35.314 [2024-07-12 12:40:29.061071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:7104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.061110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.072790] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190eea00 00:26:35.314 [2024-07-12 12:40:29.073787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:18373 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.073821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.085058] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e73e0 00:26:35.314 [2024-07-12 12:40:29.085984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:16235 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.086012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.097193] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e1b48 00:26:35.314 [2024-07-12 12:40:29.098769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:19228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.098801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.109585] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fe2e8 00:26:35.314 [2024-07-12 12:40:29.111121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:10643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.111161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.122255] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e3498 00:26:35.314 [2024-07-12 12:40:29.123333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:12449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.123365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.134441] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fac10 00:26:35.314 [2024-07-12 12:40:29.135185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:17834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.135218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.146749] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0350 00:26:35.314 [2024-07-12 12:40:29.147530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:3616 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.147563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.158968] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed920 00:26:35.314 [2024-07-12 12:40:29.159658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:3953 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.159690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.171233] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f5378 00:26:35.314 [2024-07-12 12:40:29.171880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:2245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.171911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.183514] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fa7d8 00:26:35.314 [2024-07-12 12:40:29.184191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:4064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.184223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.195800] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fac10 00:26:35.314 [2024-07-12 12:40:29.196411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:17811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.196443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.208007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f46d0 00:26:35.314 [2024-07-12 12:40:29.208549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:15643 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.208580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.220074] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed0b0 00:26:35.314 [2024-07-12 12:40:29.220582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:3276 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.220613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:35.314 [2024-07-12 12:40:29.232372] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ddc00 00:26:35.314 [2024-07-12 12:40:29.232852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:4450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.314 [2024-07-12 12:40:29.232895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.244772] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f9b30 00:26:35.572 [2024-07-12 12:40:29.245194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:24679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.245223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.256953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190efae0 00:26:35.572 [2024-07-12 12:40:29.257537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:13567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.257568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.269136] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fac10 00:26:35.572 [2024-07-12 12:40:29.269701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:4480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.269732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.281422] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fc128 00:26:35.572 [2024-07-12 12:40:29.282049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:7993 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.282077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.293486] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed920 00:26:35.572 [2024-07-12 12:40:29.294856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:8387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.294896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.305743] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed4e8 00:26:35.572 [2024-07-12 12:40:29.306975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:10815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.307004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.318913] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f2948 00:26:35.572 [2024-07-12 12:40:29.319537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.319568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.331375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f7da8 00:26:35.572 [2024-07-12 12:40:29.332193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:23069 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.332230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.343725] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f31b8 00:26:35.572 [2024-07-12 12:40:29.344536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:14841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.344568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.355958] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fa7d8 00:26:35.572 [2024-07-12 12:40:29.356675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:24233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.356707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.368180] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f7538 00:26:35.572 [2024-07-12 12:40:29.368876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:21780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.368923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:006c p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.380325] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fbcf0 00:26:35.572 [2024-07-12 12:40:29.380983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:20596 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.381011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.392942] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f6020 00:26:35.572 [2024-07-12 12:40:29.393983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:12938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.394011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.405455] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fc560 00:26:35.572 [2024-07-12 12:40:29.406714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:14523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.406745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.417670] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f5378 00:26:35.572 [2024-07-12 12:40:29.418823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:24698 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.418854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.429721] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ec408 00:26:35.572 [2024-07-12 12:40:29.430809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:2135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.430840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.441938] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fe2e8 00:26:35.572 [2024-07-12 12:40:29.442741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25134 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.442771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.454109] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0350 00:26:35.572 [2024-07-12 12:40:29.454858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:13736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.454913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.466379] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fb8b8 00:26:35.572 [2024-07-12 12:40:29.467084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:2458 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.467112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.478632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fa7d8 00:26:35.572 [2024-07-12 12:40:29.479311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.572 [2024-07-12 12:40:29.479343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:35.572 [2024-07-12 12:40:29.490995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f2510 00:26:35.832 [2024-07-12 12:40:29.491664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:5062 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.491702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.503258] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fcdd0 00:26:35.832 [2024-07-12 12:40:29.503851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19276 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.503907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.515393] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e2c28 00:26:35.832 [2024-07-12 12:40:29.516017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:14388 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.516046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.527436] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f20d8 00:26:35.832 [2024-07-12 12:40:29.528041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:8076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.528070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.539527] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f8a50 00:26:35.832 [2024-07-12 12:40:29.540236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:24420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.540265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.551540] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190de038 00:26:35.832 [2024-07-12 12:40:29.552481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:19002 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.552513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.563779] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f8e88 00:26:35.832 [2024-07-12 12:40:29.564732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.564764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.576032] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ee190 00:26:35.832 [2024-07-12 12:40:29.577032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.577061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.588765] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190efae0 00:26:35.832 [2024-07-12 12:40:29.589653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:20558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.589685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.601080] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ea680 00:26:35.832 [2024-07-12 12:40:29.602659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:19374 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.602691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.613537] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ea680 00:26:35.832 [2024-07-12 12:40:29.614943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.614985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.625999] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e9e10 00:26:35.832 [2024-07-12 12:40:29.627355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:7737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.627386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.639199] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fdeb0 00:26:35.832 [2024-07-12 12:40:29.640038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:9975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.640066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.651578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f7100 00:26:35.832 [2024-07-12 12:40:29.652573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:16281 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.652613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.663791] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190edd58 00:26:35.832 [2024-07-12 12:40:29.664718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:10484 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.664750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.675995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fc560 00:26:35.832 [2024-07-12 12:40:29.676894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:20037 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.676940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.688184] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fda78 00:26:35.832 [2024-07-12 12:40:29.689032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:20226 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.689060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.700324] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fc128 00:26:35.832 [2024-07-12 12:40:29.701119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:1690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.701163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.712408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e3060 00:26:35.832 [2024-07-12 12:40:29.713235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:13440 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.713280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:35.832 [2024-07-12 12:40:29.724706] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190eaab8 00:26:35.832 [2024-07-12 12:40:29.725481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:13784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.832 [2024-07-12 12:40:29.725512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:35.833 [2024-07-12 12:40:29.736995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f7100 00:26:35.833 [2024-07-12 12:40:29.737742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:1346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.833 [2024-07-12 12:40:29.737773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:26:35.833 [2024-07-12 12:40:29.749242] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f2948 00:26:35.833 [2024-07-12 12:40:29.749927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:1027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:35.833 [2024-07-12 12:40:29.749955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.761495] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ec408 00:26:36.092 [2024-07-12 12:40:29.762198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:18174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.092 [2024-07-12 12:40:29.762230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.773642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0ff8 00:26:36.092 [2024-07-12 12:40:29.774489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:17628 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.092 [2024-07-12 12:40:29.774521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.785885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fe2e8 00:26:36.092 [2024-07-12 12:40:29.786739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.092 [2024-07-12 12:40:29.786770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.797912] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f8a50 00:26:36.092 [2024-07-12 12:40:29.799622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:20432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.092 [2024-07-12 12:40:29.799655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.811113] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e8d30 00:26:36.092 [2024-07-12 12:40:29.812955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:1864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.092 [2024-07-12 12:40:29.812984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.821947] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f1430 00:26:36.092 [2024-07-12 12:40:29.822829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.092 [2024-07-12 12:40:29.822861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:36.092 [2024-07-12 12:40:29.833978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f81e0 00:26:36.092 [2024-07-12 12:40:29.835318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:15778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.835343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.846290] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed4e8 00:26:36.093 [2024-07-12 12:40:29.847731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:23731 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.847762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.857467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e01f8 00:26:36.093 [2024-07-12 12:40:29.858170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:11372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.858215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0019 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.871428] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e49b0 00:26:36.093 [2024-07-12 12:40:29.872024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:7489 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.872051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.883814] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed4e8 00:26:36.093 [2024-07-12 12:40:29.884586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.884617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.896100] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e4de8 00:26:36.093 [2024-07-12 12:40:29.896793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:22026 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.896823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.908313] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f6cc8 00:26:36.093 [2024-07-12 12:40:29.909001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8099 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.909042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.920409] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ea680 00:26:36.093 [2024-07-12 12:40:29.921045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:7393 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.921072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.934253] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f7da8 00:26:36.093 [2024-07-12 12:40:29.935761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:23156 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.935792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.944365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f1430 00:26:36.093 [2024-07-12 12:40:29.944998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:11749 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.945027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.956517] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e6b70 00:26:36.093 [2024-07-12 12:40:29.957228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:19033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.957260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.971118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190de8a8 00:26:36.093 [2024-07-12 12:40:29.972924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3183 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.972958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.983541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e6fa8 00:26:36.093 [2024-07-12 12:40:29.984645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.984677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:29.994398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f1868 00:26:36.093 [2024-07-12 12:40:29.995581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:25348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:29.995615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:36.093 [2024-07-12 12:40:30.006053] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e99d8 00:26:36.093 [2024-07-12 12:40:30.007384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:16427 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.093 [2024-07-12 12:40:30.007417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.018575] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f1868 00:26:36.351 [2024-07-12 12:40:30.019962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:3650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.020005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.031629] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190efae0 00:26:36.351 [2024-07-12 12:40:30.033086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:11537 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.033119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.044038] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190de8a8 00:26:36.351 [2024-07-12 12:40:30.045416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:9941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.045453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.056365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190de038 00:26:36.351 [2024-07-12 12:40:30.057742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:11491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.057776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.068491] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f35f0 00:26:36.351 [2024-07-12 12:40:30.069960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:8803 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.069989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.081284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ebb98 00:26:36.351 [2024-07-12 12:40:30.082049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:13739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.082078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.093939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fa3a0 00:26:36.351 [2024-07-12 12:40:30.094655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:22394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.094687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.106234] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0ff8 00:26:36.351 [2024-07-12 12:40:30.106935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:9852 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.106964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.118418] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ef270 00:26:36.351 [2024-07-12 12:40:30.119031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.119060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.130574] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ebfd0 00:26:36.351 [2024-07-12 12:40:30.131745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:4567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.131776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.141812] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190efae0 00:26:36.351 [2024-07-12 12:40:30.142945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:18880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.142973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:003f p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.156011] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e6738 00:26:36.351 [2024-07-12 12:40:30.157928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:3875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.351 [2024-07-12 12:40:30.157957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:36.351 [2024-07-12 12:40:30.166730] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e88f8 00:26:36.351 [2024-07-12 12:40:30.167844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:23063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.167887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.178859] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ed4e8 00:26:36.352 [2024-07-12 12:40:30.180430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:24344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.180473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.191191] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f2d80 00:26:36.352 [2024-07-12 12:40:30.193088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:808 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.193116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.204020] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190de470 00:26:36.352 [2024-07-12 12:40:30.205387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:19251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.205419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.215708] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190dece0 00:26:36.352 [2024-07-12 12:40:30.216075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:3115 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.216102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.228056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f6458 00:26:36.352 [2024-07-12 12:40:30.228613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:22562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.228644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.240263] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f2510 00:26:36.352 [2024-07-12 12:40:30.240774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:23521 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.240805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.252651] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fda78 00:26:36.352 [2024-07-12 12:40:30.253116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:10039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.253143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:36.352 [2024-07-12 12:40:30.264633] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e5a90 00:26:36.352 [2024-07-12 12:40:30.265062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:5513 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.352 [2024-07-12 12:40:30.265105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.276975] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f9f68 00:26:36.611 [2024-07-12 12:40:30.277321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:19160 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.277349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.288974] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190eff18 00:26:36.611 [2024-07-12 12:40:30.289330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.289364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.301360] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f4f40 00:26:36.611 [2024-07-12 12:40:30.301741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:8684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.301772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.313564] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190dece0 00:26:36.611 [2024-07-12 12:40:30.313950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10409 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.313983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.327860] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fdeb0 00:26:36.611 [2024-07-12 12:40:30.329528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:9805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.329560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.340181] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e01f8 00:26:36.611 [2024-07-12 12:40:30.341930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:18803 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.341958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.352372] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e5a90 00:26:36.611 [2024-07-12 12:40:30.354028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:7739 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.354055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.364787] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ddc00 00:26:36.611 [2024-07-12 12:40:30.365721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:435 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.365751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.375695] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f7538 00:26:36.611 [2024-07-12 12:40:30.376788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:4295 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.376821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.387450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ea680 00:26:36.611 [2024-07-12 12:40:30.388598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:11804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.388630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.399159] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f3a28 00:26:36.611 [2024-07-12 12:40:30.399604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:11586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.399635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.411632] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fcdd0 00:26:36.611 [2024-07-12 12:40:30.412604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:7295 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.412636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0032 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.423890] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e9e10 00:26:36.611 [2024-07-12 12:40:30.424856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:5558 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.424895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0031 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.436504] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0bc0 00:26:36.611 [2024-07-12 12:40:30.437276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:6580 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.437307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.449121] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0bc0 00:26:36.611 [2024-07-12 12:40:30.450097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:3147 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.450126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.462219] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e5ec8 00:26:36.611 [2024-07-12 12:40:30.462822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:3731 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.462853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.474845] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f20d8 00:26:36.611 [2024-07-12 12:40:30.476208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:7103 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.476240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.487300] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e6b70 00:26:36.611 [2024-07-12 12:40:30.488627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:4059 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.488657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.499710] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e6b70 00:26:36.611 [2024-07-12 12:40:30.501046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:10962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.501075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.511982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f20d8 00:26:36.611 [2024-07-12 12:40:30.513568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:21800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.513599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:26:36.611 [2024-07-12 12:40:30.524350] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f8618 00:26:36.611 [2024-07-12 12:40:30.525771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:3767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.611 [2024-07-12 12:40:30.525803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.536936] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fcdd0 00:26:36.869 [2024-07-12 12:40:30.538391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:3808 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.869 [2024-07-12 12:40:30.538423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.550160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fef90 00:26:36.869 [2024-07-12 12:40:30.551181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:131 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.869 [2024-07-12 12:40:30.551225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.561113] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f8e88 00:26:36.869 [2024-07-12 12:40:30.562207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:22308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.869 [2024-07-12 12:40:30.562235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.573791] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0bc0 00:26:36.869 [2024-07-12 12:40:30.574552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:17824 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.869 [2024-07-12 12:40:30.574583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.587416] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fd208 00:26:36.869 [2024-07-12 12:40:30.588347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:18882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.869 [2024-07-12 12:40:30.588378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.597926] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190eb760 00:26:36.869 [2024-07-12 12:40:30.599307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:7992 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.869 [2024-07-12 12:40:30.599339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:36.869 [2024-07-12 12:40:30.610167] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fef90 00:26:36.869 [2024-07-12 12:40:30.611637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:12064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.611668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.621945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e01f8 00:26:36.870 [2024-07-12 12:40:30.623074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:23724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.623101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.634371] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190ecc78 00:26:36.870 [2024-07-12 12:40:30.635464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:22066 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.635495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.646690] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fb048 00:26:36.870 [2024-07-12 12:40:30.647768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:12542 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.647800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.659029] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190df550 00:26:36.870 [2024-07-12 12:40:30.660408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.660440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0045 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.671391] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e12d8 00:26:36.870 [2024-07-12 12:40:30.672544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:11073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.672577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.683755] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f35f0 00:26:36.870 [2024-07-12 12:40:30.685093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:19085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.685123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0043 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.696308] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e0ea0 00:26:36.870 [2024-07-12 12:40:30.697467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:12816 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.697500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0042 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.709033] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e5658 00:26:36.870 [2024-07-12 12:40:30.709750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:24036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.709787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.721232] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e4de8 00:26:36.870 [2024-07-12 12:40:30.721649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:1523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.721680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.733578] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fc128 00:26:36.870 [2024-07-12 12:40:30.734020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:15333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.734048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.745726] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e0ea0 00:26:36.870 [2024-07-12 12:40:30.746048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.746076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.757698] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e12d8 00:26:36.870 [2024-07-12 12:40:30.758061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:16971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.758089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.769802] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f31b8 00:26:36.870 [2024-07-12 12:40:30.770082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:21635 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.770110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:26:36.870 [2024-07-12 12:40:30.784040] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f2510 00:26:36.870 [2024-07-12 12:40:30.786067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:11256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:36.870 [2024-07-12 12:40:30.786095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.796574] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f0788 00:26:37.128 [2024-07-12 12:40:30.798387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:4597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.798419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.808793] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fc560 00:26:37.128 [2024-07-12 12:40:30.810660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:3055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.810692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.821123] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f5be8 00:26:37.128 [2024-07-12 12:40:30.822943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25574 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.822972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.833494] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e3d08 00:26:37.128 [2024-07-12 12:40:30.835291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:5943 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.835319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.846188] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e73e0 00:26:37.128 [2024-07-12 12:40:30.847987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:6704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.848016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.856747] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e1710 00:26:37.128 [2024-07-12 12:40:30.857924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:18903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.857950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.869440] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e0630 00:26:37.128 [2024-07-12 12:40:30.870666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:16447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.870694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.881329] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e84c0 00:26:37.128 [2024-07-12 12:40:30.881717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:16064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.881748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.893796] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190efae0 00:26:37.128 [2024-07-12 12:40:30.894442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:20612 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.894474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.906011] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190eaab8 00:26:37.128 [2024-07-12 12:40:30.906524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:8892 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.906555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.918154] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190efae0 00:26:37.128 [2024-07-12 12:40:30.918648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:22242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.918679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.930346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e9e10 00:26:37.128 [2024-07-12 12:40:30.930806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:23139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.930843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.942714] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e73e0 00:26:37.128 [2024-07-12 12:40:30.943148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:11805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.943190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.954953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f6458 00:26:37.128 [2024-07-12 12:40:30.955334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:4869 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.955365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.967232] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e84c0 00:26:37.128 [2024-07-12 12:40:30.967587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:24658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.967618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.979400] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fe720 00:26:37.128 [2024-07-12 12:40:30.979719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:11936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.979750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:30.991586] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f20d8 00:26:37.128 [2024-07-12 12:40:30.991948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:30.991977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:31.003827] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190e84c0 00:26:37.128 [2024-07-12 12:40:31.004231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:13001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:31.004263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:31.016172] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fe720 00:26:37.128 [2024-07-12 12:40:31.016631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:9794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:31.016662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:31.028389] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190f20d8 00:26:37.128 [2024-07-12 12:40:31.028879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:8869 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:31.028923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:26:37.128 [2024-07-12 12:40:31.043088] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1a4c1a0) with pdu=0x2000190fef90 00:26:37.128 [2024-07-12 12:40:31.044154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:3264 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:37.128 [2024-07-12 12:40:31.044197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:26:37.386 00:26:37.386 Latency(us) 00:26:37.386 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:37.386 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:37.386 nvme0n1 : 2.00 20736.69 81.00 0.00 0.00 6164.60 2548.62 14757.74 00:26:37.386 =================================================================================================================== 00:26:37.386 Total : 20736.69 81.00 0.00 0.00 6164.60 2548.62 14757.74 00:26:37.386 0 00:26:37.386 12:40:31 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:37.386 12:40:31 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:37.386 12:40:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:37.386 12:40:31 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:37.386 | .driver_specific 00:26:37.386 | .nvme_error 00:26:37.386 | .status_code 00:26:37.386 | .command_transient_transport_error' 00:26:37.386 12:40:31 -- host/digest.sh@71 -- # (( 162 > 0 )) 00:26:37.386 12:40:31 -- host/digest.sh@73 -- # killprocess 1381855 00:26:37.386 12:40:31 -- common/autotest_common.sh@926 -- # '[' -z 1381855 ']' 00:26:37.386 12:40:31 -- common/autotest_common.sh@930 -- # kill -0 1381855 00:26:37.386 12:40:31 -- common/autotest_common.sh@931 -- # uname 00:26:37.386 12:40:31 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:37.386 12:40:31 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1381855 00:26:37.645 12:40:31 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:37.645 12:40:31 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:37.645 12:40:31 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1381855' 00:26:37.645 killing process with pid 1381855 00:26:37.645 12:40:31 -- common/autotest_common.sh@945 -- # kill 1381855 00:26:37.645 Received shutdown signal, test time was about 2.000000 seconds 00:26:37.645 00:26:37.645 Latency(us) 00:26:37.645 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:37.645 =================================================================================================================== 00:26:37.645 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:37.645 12:40:31 -- common/autotest_common.sh@950 -- # wait 1381855 00:26:37.904 12:40:31 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:26:37.904 12:40:31 -- host/digest.sh@54 -- # local rw bs qd 00:26:37.904 12:40:31 -- host/digest.sh@56 -- # rw=randwrite 00:26:37.904 12:40:31 -- host/digest.sh@56 -- # bs=131072 00:26:37.904 12:40:31 -- host/digest.sh@56 -- # qd=16 00:26:37.904 12:40:31 -- host/digest.sh@58 -- # bperfpid=1382410 00:26:37.904 12:40:31 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:26:37.904 12:40:31 -- host/digest.sh@60 -- # waitforlisten 1382410 /var/tmp/bperf.sock 00:26:37.904 12:40:31 -- common/autotest_common.sh@819 -- # '[' -z 1382410 ']' 00:26:37.904 12:40:31 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:37.904 12:40:31 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:37.904 12:40:31 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:37.904 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:37.904 12:40:31 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:37.904 12:40:31 -- common/autotest_common.sh@10 -- # set +x 00:26:37.904 [2024-07-12 12:40:31.622912] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:37.904 [2024-07-12 12:40:31.622990] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1382410 ] 00:26:37.904 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:37.904 Zero copy mechanism will not be used. 00:26:37.904 EAL: No free 2048 kB hugepages reported on node 1 00:26:37.904 [2024-07-12 12:40:31.685657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:37.904 [2024-07-12 12:40:31.798053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:38.838 12:40:32 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:38.838 12:40:32 -- common/autotest_common.sh@852 -- # return 0 00:26:38.838 12:40:32 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:38.838 12:40:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:26:39.096 12:40:32 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:26:39.096 12:40:32 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:39.096 12:40:32 -- common/autotest_common.sh@10 -- # set +x 00:26:39.096 12:40:32 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:39.096 12:40:32 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:39.096 12:40:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:39.354 nvme0n1 00:26:39.614 12:40:33 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:26:39.614 12:40:33 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:39.614 12:40:33 -- common/autotest_common.sh@10 -- # set +x 00:26:39.614 12:40:33 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:39.614 12:40:33 -- host/digest.sh@69 -- # bperf_py perform_tests 00:26:39.614 12:40:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:39.614 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:39.614 Zero copy mechanism will not be used. 00:26:39.614 Running I/O for 2 seconds... 00:26:39.614 [2024-07-12 12:40:33.414856] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.415370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.415412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.419599] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.420006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.420038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.424694] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.424979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.425029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.431261] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.431473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.431552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.436352] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.436585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.436615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.441160] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.441362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.441393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.446299] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.446390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.614 [2024-07-12 12:40:33.446433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.614 [2024-07-12 12:40:33.451804] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.614 [2024-07-12 12:40:33.452150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.452180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.456791] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.457005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.457036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.462627] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.463032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.463114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.467816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.468340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.468370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.472809] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.473277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.473351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.478141] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.478363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.478448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.483321] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.483684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.483719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.488412] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.488902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.488933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.493606] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.493821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.493851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.498919] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.499162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.499192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.504462] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.504780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.504813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.509623] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.509961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.509996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.514922] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.515231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.515319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.520095] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.520467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.520496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.525759] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.525900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.525929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.615 [2024-07-12 12:40:33.532235] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.615 [2024-07-12 12:40:33.532627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.615 [2024-07-12 12:40:33.532714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.536885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.537196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.537242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.541477] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.541669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.541701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.546417] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.546746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.546778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.551297] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.551565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.551618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.555946] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.556304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.556347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.560635] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.560789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.560834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.566256] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.566506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.566538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.571573] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.572031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.572063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.876 [2024-07-12 12:40:33.577593] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.876 [2024-07-12 12:40:33.577763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.876 [2024-07-12 12:40:33.577791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.583416] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.583724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.583768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.589006] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.589326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.589378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.594290] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.594506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.594534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.599939] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.600196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.600235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.605914] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.606215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.606279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.611362] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.611550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.611580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.617007] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.617353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.617409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.622460] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.622685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.622735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.628140] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.628411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.628441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.633826] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.634145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.634218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.639103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.639331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.639362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.644659] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.644906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.644935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.650361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.650540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.650569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.655915] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.656058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.656106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.661447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.661749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.661778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.666896] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.667259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.667356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.671837] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.672166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.672229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.676536] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.676765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.676839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.682029] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.682419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.682505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.687071] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.687350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.687380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.692222] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.692550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.692579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.697435] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.697774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.697807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.702574] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.702900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.702934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.708080] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.708289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.708372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.714432] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.714625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.714683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.720494] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.720693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.720722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.726797] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.726938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.726999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.732365] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.732554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.732584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.738336] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.877 [2024-07-12 12:40:33.738512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.877 [2024-07-12 12:40:33.738541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.877 [2024-07-12 12:40:33.744874] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.745029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.745059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.751140] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.751419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.751464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.757704] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.757829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.757884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.764375] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.764704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.764738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.771142] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.771432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.771462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.776903] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.777023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.777052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.782210] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.782337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.782421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.787072] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.787499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.787528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:39.878 [2024-07-12 12:40:33.791696] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:39.878 [2024-07-12 12:40:33.792207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:39.878 [2024-07-12 12:40:33.792240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.796344] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.796946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.796977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.800773] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.801218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.801250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.805349] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.805558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.805614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.810738] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.811020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.811049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.816093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.816262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.816302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.822022] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.822310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.822341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.827563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.827893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.827963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.833220] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.833443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.833486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.838572] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.838722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.838769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.844012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.844268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.844307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.849729] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.850116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.850170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.855091] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.855326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.855391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.860541] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.860874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.860941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.865367] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.865613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.865688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.870892] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.870990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.871039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.875950] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.876393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.876448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.880709] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.881086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.881117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.885471] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.885683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.885766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.890260] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.890571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.138 [2024-07-12 12:40:33.890669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.138 [2024-07-12 12:40:33.894824] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.138 [2024-07-12 12:40:33.895067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.895162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.899417] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.899854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.899923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.903837] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.904265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.904306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.908181] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.908665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.908695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.912660] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.913075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.913124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.917118] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.917539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.917601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.921607] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.921900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.921986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.925925] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.926462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.926492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.930330] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.930723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.930808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.935177] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.935253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.935337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.940259] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.940666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.940696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.944602] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.945201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.945231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.949050] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.949377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.949407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.953487] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.953857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.953938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.957823] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.958216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.958245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.962262] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.962583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.962613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.966683] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.967077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.967115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.970992] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.971284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.971324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.975387] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.975768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.975878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.979970] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.980286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.980316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.984292] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.984611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.984678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.988600] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.988976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.989006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.993149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.993643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.993747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:33.997857] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:33.998557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:33.998600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:34.002480] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:34.002858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:34.002934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:34.007971] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:34.008177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:34.008211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:34.013445] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:34.013674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:34.013741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:34.019205] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:34.019396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:34.019434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:34.024642] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:34.025028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.139 [2024-07-12 12:40:34.025073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.139 [2024-07-12 12:40:34.029844] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.139 [2024-07-12 12:40:34.030279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.140 [2024-07-12 12:40:34.030310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.140 [2024-07-12 12:40:34.034863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.140 [2024-07-12 12:40:34.035234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.140 [2024-07-12 12:40:34.035264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.140 [2024-07-12 12:40:34.040125] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.140 [2024-07-12 12:40:34.040400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.140 [2024-07-12 12:40:34.040479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.140 [2024-07-12 12:40:34.045232] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.140 [2024-07-12 12:40:34.045454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.140 [2024-07-12 12:40:34.045534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.140 [2024-07-12 12:40:34.050377] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.140 [2024-07-12 12:40:34.050560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.140 [2024-07-12 12:40:34.050647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.140 [2024-07-12 12:40:34.055657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.140 [2024-07-12 12:40:34.056077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.140 [2024-07-12 12:40:34.056107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.061120] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.061341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.061419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.066336] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.066779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.066824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.071519] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.072027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.072101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.076755] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.077185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.077216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.081936] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.082142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.082188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.087213] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.087619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.087649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.092514] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.092820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.092850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.098263] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.098448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.098478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.104036] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.104347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.104377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.110102] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.110246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.110283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.115673] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.115819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.115848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.121168] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.121377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.121407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.125996] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.126203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.126303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.130959] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.131126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.131170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.136524] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.136948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.137016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.140836] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.141099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.141179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.145429] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.145894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.145925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.149792] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.150360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.150449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.154232] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.154548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.154584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.159028] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.159257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.159286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.164481] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.165012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.165041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.168837] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.169290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.169394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.173423] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.173769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.173844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.177970] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.178126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.178225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.183101] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.183378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.183407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.188666] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.188853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.188947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.195027] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.195285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.195358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.199887] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.200184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.401 [2024-07-12 12:40:34.200213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.401 [2024-07-12 12:40:34.204229] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.401 [2024-07-12 12:40:34.204741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.204805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.208758] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.209081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.209178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.213417] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.213582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.213626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.218583] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.219065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.219135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.223109] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.223607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.223698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.227568] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.227959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.228050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.232012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.232585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.232645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.236492] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.236938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.236976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.241055] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.241572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.241659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.245563] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.245981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.246010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.250069] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.250465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.250501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.254496] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.254931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.255017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.259278] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.259586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.259615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.264495] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.264765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.264833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.270135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.270266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.270294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.276467] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.276668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.276697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.281368] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.281581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.281674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.286097] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.286426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.286513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.291187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.291348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.291376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.296676] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.296983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.297035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.302225] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.302419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.302448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.308169] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.308427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.308455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.312861] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.313063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.313125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.402 [2024-07-12 12:40:34.317816] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.402 [2024-07-12 12:40:34.318036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.402 [2024-07-12 12:40:34.318100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.322855] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.323209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.323252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.327873] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.328129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.328219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.332688] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.332954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.333017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.337535] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.337833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.337920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.342402] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.342736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.342815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.347103] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.347447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.347484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.351535] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.351938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.351969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.356735] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.357004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.357034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.362248] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.362373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.362402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.368174] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.368431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.368474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.374070] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.374316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.374383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.379558] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.379769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.379845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.384769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.385034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.385065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.389769] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.389971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.390001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.395784] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.395969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.395998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.401469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.401605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.401634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.408035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.408339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.408367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.414441] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.414622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.414667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.420978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.421153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.421181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.427444] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.427676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.427763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.433947] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.434186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.434216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.440351] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.440553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.440581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.446523] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.446674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.446702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.453108] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.453457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.663 [2024-07-12 12:40:34.453486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.663 [2024-07-12 12:40:34.459671] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.663 [2024-07-12 12:40:34.459995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.460038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.466284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.466545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.466586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.472680] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.472842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.472879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.479219] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.479421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.479453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.485782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.486014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.486074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.491901] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.492201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.492229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.497041] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.497205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.497273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.501834] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.501971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.502047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.507240] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.507444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.507474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.512777] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.512962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.512992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.518315] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.518647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.518676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.523723] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.524148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.524183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.529187] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.529466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.529503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.534841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.535051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.535128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.540453] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.540606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.540655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.546280] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.546461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.546551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.551705] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.551957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.551986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.557014] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.557285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.557342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.562475] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.562648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.562677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.568054] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.568189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.568233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.573412] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.573593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.573622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.664 [2024-07-12 12:40:34.579060] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.664 [2024-07-12 12:40:34.579228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.664 [2024-07-12 12:40:34.579297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.924 [2024-07-12 12:40:34.584668] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.924 [2024-07-12 12:40:34.584862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.924 [2024-07-12 12:40:34.584897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.924 [2024-07-12 12:40:34.590273] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.924 [2024-07-12 12:40:34.590459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.924 [2024-07-12 12:40:34.590512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.924 [2024-07-12 12:40:34.596102] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.924 [2024-07-12 12:40:34.596313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.924 [2024-07-12 12:40:34.596342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.924 [2024-07-12 12:40:34.601673] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.924 [2024-07-12 12:40:34.602067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.924 [2024-07-12 12:40:34.602110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.924 [2024-07-12 12:40:34.607433] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.607700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.607730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.612689] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.612886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.612922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.618208] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.618369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.618431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.623750] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.623946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.623975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.629398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.629661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.629690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.635405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.635507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.635536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.641481] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.641692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.641727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.646174] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.646558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.646587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.650795] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.651199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.651250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.656140] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.656248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.656277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.661885] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.662176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.662205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.667158] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.667380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.667414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.672535] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.672606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.672635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.677931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.678114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.678143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.683454] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.683568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.683625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.689293] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.689438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.689493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.694655] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.694725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.694753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.700347] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.700569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.700598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.706431] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.706690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.706719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.712059] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.712303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.712333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.717941] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.718031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.718060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.723819] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.724050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.724154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.729450] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.729544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.729573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.734361] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.734517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.734561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.739834] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.739957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.739987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.744931] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.745121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.745202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.750113] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.750386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.750415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.755982] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.756242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.756271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.761782] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.762017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.925 [2024-07-12 12:40:34.762045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.925 [2024-07-12 12:40:34.767786] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.925 [2024-07-12 12:40:34.767978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.768056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.773512] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.773760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.773789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.779405] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.779512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.779541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.785477] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.785749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.785779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.791441] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.791752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.791805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.797320] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.797536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.797573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.803086] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.803299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.803327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.808284] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.808466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.808496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.813376] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.813481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.813578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.818668] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.818756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.818789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.823971] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.824150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.824179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.829265] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.829501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.829600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.834532] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.834743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.834830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:40.926 [2024-07-12 12:40:34.839647] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:40.926 [2024-07-12 12:40:34.839769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:40.926 [2024-07-12 12:40:34.839798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.845012] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.845135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.845164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.850149] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.850248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.850276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.855278] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.855351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.855400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.860616] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.860748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.860776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.865841] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.866064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.866093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.870883] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.871071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.871100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.876035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.876247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.876290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.881346] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.881459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.881486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.886385] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.886480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.886509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.891484] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.891699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.891742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.896529] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.896665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.896730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.901925] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.902154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.186 [2024-07-12 12:40:34.902184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.186 [2024-07-12 12:40:34.906995] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.186 [2024-07-12 12:40:34.907209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.907239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.912045] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.912207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.912237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.917386] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.917494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.917522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.922630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.922824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.922885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.927863] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.927997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.928025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.932993] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.933211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.933241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.938212] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.938578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.938608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.943298] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.943400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.943428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.948469] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.948669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.948703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.953702] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.953813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.953889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.958815] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.958889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.958979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.964143] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.964326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.964429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.969214] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.969374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.969403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.974513] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.974637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.974670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.979705] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.979942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.979971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.985004] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.985260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.985293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.989958] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.990059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.990148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:34.995089] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:34.995239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:34.995268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.000093] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.000247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.000277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.005408] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.005628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.005663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.010491] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.010766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.010795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.015426] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.015617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.015646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.020639] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.020722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.020750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.025892] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.026060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.026102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.030961] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.031090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.031120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.035941] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.036065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.036137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.040973] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.041138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.041183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.046300] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.046518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.046547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.051328] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.187 [2024-07-12 12:40:35.051598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.187 [2024-07-12 12:40:35.051627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.187 [2024-07-12 12:40:35.056447] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.056699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.056728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.061737] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.061943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.061972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.067035] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.067210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.067295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.072198] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.072361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.072390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.077398] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.077536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.077565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.082659] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.082965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.083056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.087894] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.088302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.088331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.093184] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.093334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.093363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.098476] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.098584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.098613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.188 [2024-07-12 12:40:35.103547] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.188 [2024-07-12 12:40:35.103677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.188 [2024-07-12 12:40:35.103706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.108953] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.109221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.109251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.114196] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.114390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.114420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.119433] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.119705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.119734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.124364] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.124577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.124606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.129557] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.129648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.129676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.135683] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.135956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.135986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.142146] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.142383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.142416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.149002] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.149157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.149187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.155749] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.155863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.155927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.162562] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.162729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.162761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.169129] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.169421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.169493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.175663] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.175937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.175972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.182191] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.182441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.182472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.188630] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.188755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.188787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.195182] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.195337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.449 [2024-07-12 12:40:35.195366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.449 [2024-07-12 12:40:35.201577] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.449 [2024-07-12 12:40:35.201777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.201806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.208283] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.208453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.208483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.214395] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.214565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.214594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.220723] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.220921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.220950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.227273] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.227443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.227472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.233748] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.233956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.233985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.239985] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.240239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.240273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.246056] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.246382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.246411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.252283] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.252447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.252480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.257527] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.257721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.257749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.262509] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.262771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.262816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.267861] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.268261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.268290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.272978] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.273203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.273233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.278135] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.278482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.278548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.283493] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.283907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.284003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.288708] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.289214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.289242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.293988] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.294319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.294349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.299318] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.299961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.300031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.304190] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.304680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.304738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.308945] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.309508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.309538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.313858] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.314302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.314332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.318691] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.319086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.319130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.323628] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.324158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.450 [2024-07-12 12:40:35.324218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.450 [2024-07-12 12:40:35.328366] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.450 [2024-07-12 12:40:35.328578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.328608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.333657] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.334063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.334093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.338411] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.338717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.338765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.343216] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.343677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.343740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.347913] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.348272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.348336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.352615] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.353088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.353122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.357272] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.357773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.357803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.361722] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.362173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.362228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.451 [2024-07-12 12:40:35.366250] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.451 [2024-07-12 12:40:35.366717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.451 [2024-07-12 12:40:35.366806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.370658] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.371059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.371118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.375227] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.375626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.375710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.379574] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.380083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.380113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.384032] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.384504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.384590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.388468] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.388931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.388976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.392924] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.393373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.393403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.397337] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.397740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.397784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.401766] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.402323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.402368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.406254] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.406485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.406563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:26:41.710 [2024-07-12 12:40:35.410674] tcp.c:2034:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18ba210) with pdu=0x2000190fef90 00:26:41.710 [2024-07-12 12:40:35.411216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:41.710 [2024-07-12 12:40:35.411300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:26:41.710 00:26:41.710 Latency(us) 00:26:41.710 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:41.710 Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:26:41.710 nvme0n1 : 2.00 5845.96 730.74 0.00 0.00 2727.29 1553.45 7184.69 00:26:41.710 =================================================================================================================== 00:26:41.710 Total : 5845.96 730.74 0.00 0.00 2727.29 1553.45 7184.69 00:26:41.710 0 00:26:41.710 12:40:35 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:26:41.710 12:40:35 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:26:41.710 12:40:35 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:26:41.710 | .driver_specific 00:26:41.710 | .nvme_error 00:26:41.710 | .status_code 00:26:41.710 | .command_transient_transport_error' 00:26:41.710 12:40:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:26:41.970 12:40:35 -- host/digest.sh@71 -- # (( 377 > 0 )) 00:26:41.970 12:40:35 -- host/digest.sh@73 -- # killprocess 1382410 00:26:41.970 12:40:35 -- common/autotest_common.sh@926 -- # '[' -z 1382410 ']' 00:26:41.970 12:40:35 -- common/autotest_common.sh@930 -- # kill -0 1382410 00:26:41.970 12:40:35 -- common/autotest_common.sh@931 -- # uname 00:26:41.970 12:40:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:41.970 12:40:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1382410 00:26:41.970 12:40:35 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:26:41.970 12:40:35 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:26:41.970 12:40:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1382410' 00:26:41.970 killing process with pid 1382410 00:26:41.970 12:40:35 -- common/autotest_common.sh@945 -- # kill 1382410 00:26:41.970 Received shutdown signal, test time was about 2.000000 seconds 00:26:41.970 00:26:41.970 Latency(us) 00:26:41.970 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:41.970 =================================================================================================================== 00:26:41.970 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:41.970 12:40:35 -- common/autotest_common.sh@950 -- # wait 1382410 00:26:42.228 12:40:35 -- host/digest.sh@115 -- # killprocess 1380724 00:26:42.228 12:40:35 -- common/autotest_common.sh@926 -- # '[' -z 1380724 ']' 00:26:42.228 12:40:35 -- common/autotest_common.sh@930 -- # kill -0 1380724 00:26:42.228 12:40:35 -- common/autotest_common.sh@931 -- # uname 00:26:42.228 12:40:35 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:26:42.228 12:40:35 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1380724 00:26:42.228 12:40:35 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:26:42.228 12:40:35 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:26:42.228 12:40:35 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1380724' 00:26:42.228 killing process with pid 1380724 00:26:42.228 12:40:35 -- common/autotest_common.sh@945 -- # kill 1380724 00:26:42.229 12:40:35 -- common/autotest_common.sh@950 -- # wait 1380724 00:26:42.486 00:26:42.487 real 0m18.338s 00:26:42.487 user 0m36.155s 00:26:42.487 sys 0m4.678s 00:26:42.487 12:40:36 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:42.487 12:40:36 -- common/autotest_common.sh@10 -- # set +x 00:26:42.487 ************************************ 00:26:42.487 END TEST nvmf_digest_error 00:26:42.487 ************************************ 00:26:42.487 12:40:36 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:26:42.487 12:40:36 -- host/digest.sh@139 -- # nvmftestfini 00:26:42.487 12:40:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:42.487 12:40:36 -- nvmf/common.sh@116 -- # sync 00:26:42.487 12:40:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:42.487 12:40:36 -- nvmf/common.sh@119 -- # set +e 00:26:42.487 12:40:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:42.487 12:40:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:42.487 rmmod nvme_tcp 00:26:42.487 rmmod nvme_fabrics 00:26:42.487 rmmod nvme_keyring 00:26:42.487 12:40:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:42.487 12:40:36 -- nvmf/common.sh@123 -- # set -e 00:26:42.487 12:40:36 -- nvmf/common.sh@124 -- # return 0 00:26:42.487 12:40:36 -- nvmf/common.sh@477 -- # '[' -n 1380724 ']' 00:26:42.487 12:40:36 -- nvmf/common.sh@478 -- # killprocess 1380724 00:26:42.487 12:40:36 -- common/autotest_common.sh@926 -- # '[' -z 1380724 ']' 00:26:42.487 12:40:36 -- common/autotest_common.sh@930 -- # kill -0 1380724 00:26:42.487 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1380724) - No such process 00:26:42.487 12:40:36 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1380724 is not found' 00:26:42.487 Process with pid 1380724 is not found 00:26:42.487 12:40:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:42.487 12:40:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:42.487 12:40:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:42.487 12:40:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:42.487 12:40:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:42.487 12:40:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:42.487 12:40:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:42.487 12:40:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:45.022 12:40:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:45.022 00:26:45.022 real 0m37.983s 00:26:45.022 user 1m7.011s 00:26:45.022 sys 0m10.566s 00:26:45.022 12:40:38 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:26:45.022 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:26:45.023 ************************************ 00:26:45.023 END TEST nvmf_digest 00:26:45.023 ************************************ 00:26:45.023 12:40:38 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:26:45.023 12:40:38 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:26:45.023 12:40:38 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:26:45.023 12:40:38 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:45.023 12:40:38 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:26:45.023 12:40:38 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:26:45.023 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:26:45.023 ************************************ 00:26:45.023 START TEST nvmf_bdevperf 00:26:45.023 ************************************ 00:26:45.023 12:40:38 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:26:45.023 * Looking for test storage... 00:26:45.023 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:45.023 12:40:38 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:45.023 12:40:38 -- nvmf/common.sh@7 -- # uname -s 00:26:45.023 12:40:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:45.023 12:40:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:45.023 12:40:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:45.023 12:40:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:45.023 12:40:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:45.023 12:40:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:45.023 12:40:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:45.023 12:40:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:45.023 12:40:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:45.023 12:40:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:45.023 12:40:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:45.023 12:40:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:45.023 12:40:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:45.023 12:40:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:45.023 12:40:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:45.023 12:40:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:45.023 12:40:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:45.023 12:40:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:45.023 12:40:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:45.023 12:40:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.023 12:40:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.023 12:40:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.023 12:40:38 -- paths/export.sh@5 -- # export PATH 00:26:45.023 12:40:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:45.023 12:40:38 -- nvmf/common.sh@46 -- # : 0 00:26:45.023 12:40:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:45.023 12:40:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:45.023 12:40:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:45.023 12:40:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:45.023 12:40:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:45.023 12:40:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:45.023 12:40:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:45.023 12:40:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:45.023 12:40:38 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:45.023 12:40:38 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:45.023 12:40:38 -- host/bdevperf.sh@24 -- # nvmftestinit 00:26:45.023 12:40:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:45.023 12:40:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:45.023 12:40:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:45.023 12:40:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:45.023 12:40:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:45.023 12:40:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:45.023 12:40:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:45.023 12:40:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:45.023 12:40:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:45.023 12:40:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:45.023 12:40:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:45.023 12:40:38 -- common/autotest_common.sh@10 -- # set +x 00:26:46.402 12:40:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:46.402 12:40:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:46.402 12:40:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:46.402 12:40:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:46.402 12:40:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:46.402 12:40:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:46.402 12:40:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:46.402 12:40:40 -- nvmf/common.sh@294 -- # net_devs=() 00:26:46.402 12:40:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:46.402 12:40:40 -- nvmf/common.sh@295 -- # e810=() 00:26:46.402 12:40:40 -- nvmf/common.sh@295 -- # local -ga e810 00:26:46.402 12:40:40 -- nvmf/common.sh@296 -- # x722=() 00:26:46.402 12:40:40 -- nvmf/common.sh@296 -- # local -ga x722 00:26:46.402 12:40:40 -- nvmf/common.sh@297 -- # mlx=() 00:26:46.402 12:40:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:46.402 12:40:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:46.402 12:40:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:46.402 12:40:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:46.402 12:40:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:46.402 12:40:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:46.402 12:40:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:46.402 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:46.402 12:40:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:46.402 12:40:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:46.402 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:46.402 12:40:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:46.402 12:40:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:46.402 12:40:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:46.402 12:40:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:46.402 12:40:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:46.402 12:40:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:46.402 12:40:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:46.402 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:46.402 12:40:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:46.402 12:40:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:46.403 12:40:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:46.403 12:40:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:46.403 12:40:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:46.403 12:40:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:46.403 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:46.403 12:40:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:46.403 12:40:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:46.403 12:40:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:46.403 12:40:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:46.403 12:40:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:46.403 12:40:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:46.403 12:40:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:46.403 12:40:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:46.403 12:40:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:46.403 12:40:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:46.403 12:40:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:46.403 12:40:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:46.403 12:40:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:46.403 12:40:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:46.403 12:40:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:46.403 12:40:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:46.661 12:40:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:46.661 12:40:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:46.661 12:40:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:46.661 12:40:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:46.661 12:40:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:46.661 12:40:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:46.661 12:40:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:46.661 12:40:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:46.661 12:40:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:46.661 12:40:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:46.661 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:46.661 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:26:46.661 00:26:46.661 --- 10.0.0.2 ping statistics --- 00:26:46.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:46.661 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:26:46.661 12:40:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:46.661 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:46.661 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:26:46.661 00:26:46.661 --- 10.0.0.1 ping statistics --- 00:26:46.661 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:46.661 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:26:46.661 12:40:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:46.661 12:40:40 -- nvmf/common.sh@410 -- # return 0 00:26:46.661 12:40:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:46.661 12:40:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:46.661 12:40:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:46.661 12:40:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:46.661 12:40:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:46.661 12:40:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:46.661 12:40:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:46.661 12:40:40 -- host/bdevperf.sh@25 -- # tgt_init 00:26:46.661 12:40:40 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:46.661 12:40:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:46.661 12:40:40 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:46.661 12:40:40 -- common/autotest_common.sh@10 -- # set +x 00:26:46.661 12:40:40 -- nvmf/common.sh@469 -- # nvmfpid=1384912 00:26:46.661 12:40:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:46.661 12:40:40 -- nvmf/common.sh@470 -- # waitforlisten 1384912 00:26:46.661 12:40:40 -- common/autotest_common.sh@819 -- # '[' -z 1384912 ']' 00:26:46.661 12:40:40 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:46.661 12:40:40 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:46.661 12:40:40 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:46.661 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:46.661 12:40:40 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:46.661 12:40:40 -- common/autotest_common.sh@10 -- # set +x 00:26:46.661 [2024-07-12 12:40:40.526507] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:46.661 [2024-07-12 12:40:40.526587] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:46.661 EAL: No free 2048 kB hugepages reported on node 1 00:26:46.919 [2024-07-12 12:40:40.593051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:46.919 [2024-07-12 12:40:40.710016] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:46.919 [2024-07-12 12:40:40.710172] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:46.919 [2024-07-12 12:40:40.710189] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:46.919 [2024-07-12 12:40:40.710208] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:46.919 [2024-07-12 12:40:40.710261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:46.919 [2024-07-12 12:40:40.711886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:46.919 [2024-07-12 12:40:40.711898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:47.857 12:40:41 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:47.857 12:40:41 -- common/autotest_common.sh@852 -- # return 0 00:26:47.857 12:40:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:47.857 12:40:41 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:47.857 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.857 12:40:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:47.857 12:40:41 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:47.857 12:40:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.857 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.857 [2024-07-12 12:40:41.523832] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:47.857 12:40:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.857 12:40:41 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:47.857 12:40:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.857 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.857 Malloc0 00:26:47.857 12:40:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.857 12:40:41 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:47.857 12:40:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.857 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.857 12:40:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.857 12:40:41 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:47.857 12:40:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.857 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.857 12:40:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.857 12:40:41 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:47.857 12:40:41 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:47.857 12:40:41 -- common/autotest_common.sh@10 -- # set +x 00:26:47.857 [2024-07-12 12:40:41.582031] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:47.857 12:40:41 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:47.857 12:40:41 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:26:47.857 12:40:41 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:26:47.857 12:40:41 -- nvmf/common.sh@520 -- # config=() 00:26:47.857 12:40:41 -- nvmf/common.sh@520 -- # local subsystem config 00:26:47.857 12:40:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:47.857 12:40:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:47.857 { 00:26:47.857 "params": { 00:26:47.857 "name": "Nvme$subsystem", 00:26:47.857 "trtype": "$TEST_TRANSPORT", 00:26:47.857 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:47.857 "adrfam": "ipv4", 00:26:47.857 "trsvcid": "$NVMF_PORT", 00:26:47.857 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:47.857 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:47.857 "hdgst": ${hdgst:-false}, 00:26:47.857 "ddgst": ${ddgst:-false} 00:26:47.857 }, 00:26:47.857 "method": "bdev_nvme_attach_controller" 00:26:47.857 } 00:26:47.857 EOF 00:26:47.857 )") 00:26:47.857 12:40:41 -- nvmf/common.sh@542 -- # cat 00:26:47.857 12:40:41 -- nvmf/common.sh@544 -- # jq . 00:26:47.857 12:40:41 -- nvmf/common.sh@545 -- # IFS=, 00:26:47.857 12:40:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:47.858 "params": { 00:26:47.858 "name": "Nvme1", 00:26:47.858 "trtype": "tcp", 00:26:47.858 "traddr": "10.0.0.2", 00:26:47.858 "adrfam": "ipv4", 00:26:47.858 "trsvcid": "4420", 00:26:47.858 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:47.858 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:47.858 "hdgst": false, 00:26:47.858 "ddgst": false 00:26:47.858 }, 00:26:47.858 "method": "bdev_nvme_attach_controller" 00:26:47.858 }' 00:26:47.858 [2024-07-12 12:40:41.625974] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:47.858 [2024-07-12 12:40:41.626039] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385069 ] 00:26:47.858 EAL: No free 2048 kB hugepages reported on node 1 00:26:47.858 [2024-07-12 12:40:41.687199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:48.116 [2024-07-12 12:40:41.799514] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:48.374 Running I/O for 1 seconds... 00:26:49.311 00:26:49.311 Latency(us) 00:26:49.311 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:49.311 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:49.311 Verification LBA range: start 0x0 length 0x4000 00:26:49.311 Nvme1n1 : 1.01 12767.41 49.87 0.00 0.00 9978.74 1601.99 16408.27 00:26:49.311 =================================================================================================================== 00:26:49.311 Total : 12767.41 49.87 0.00 0.00 9978.74 1601.99 16408.27 00:26:49.571 12:40:43 -- host/bdevperf.sh@30 -- # bdevperfpid=1385334 00:26:49.571 12:40:43 -- host/bdevperf.sh@32 -- # sleep 3 00:26:49.571 12:40:43 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:26:49.571 12:40:43 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:26:49.571 12:40:43 -- nvmf/common.sh@520 -- # config=() 00:26:49.571 12:40:43 -- nvmf/common.sh@520 -- # local subsystem config 00:26:49.571 12:40:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:26:49.571 12:40:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:26:49.571 { 00:26:49.571 "params": { 00:26:49.571 "name": "Nvme$subsystem", 00:26:49.571 "trtype": "$TEST_TRANSPORT", 00:26:49.571 "traddr": "$NVMF_FIRST_TARGET_IP", 00:26:49.571 "adrfam": "ipv4", 00:26:49.571 "trsvcid": "$NVMF_PORT", 00:26:49.571 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:26:49.571 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:26:49.571 "hdgst": ${hdgst:-false}, 00:26:49.571 "ddgst": ${ddgst:-false} 00:26:49.571 }, 00:26:49.571 "method": "bdev_nvme_attach_controller" 00:26:49.571 } 00:26:49.571 EOF 00:26:49.571 )") 00:26:49.571 12:40:43 -- nvmf/common.sh@542 -- # cat 00:26:49.571 12:40:43 -- nvmf/common.sh@544 -- # jq . 00:26:49.571 12:40:43 -- nvmf/common.sh@545 -- # IFS=, 00:26:49.571 12:40:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:26:49.571 "params": { 00:26:49.571 "name": "Nvme1", 00:26:49.571 "trtype": "tcp", 00:26:49.571 "traddr": "10.0.0.2", 00:26:49.571 "adrfam": "ipv4", 00:26:49.571 "trsvcid": "4420", 00:26:49.571 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:26:49.571 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:26:49.571 "hdgst": false, 00:26:49.571 "ddgst": false 00:26:49.571 }, 00:26:49.571 "method": "bdev_nvme_attach_controller" 00:26:49.571 }' 00:26:49.571 [2024-07-12 12:40:43.411747] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:49.571 [2024-07-12 12:40:43.411822] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1385334 ] 00:26:49.571 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.571 [2024-07-12 12:40:43.473611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:49.829 [2024-07-12 12:40:43.582045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:50.086 Running I/O for 15 seconds... 00:26:52.675 12:40:46 -- host/bdevperf.sh@33 -- # kill -9 1384912 00:26:52.675 12:40:46 -- host/bdevperf.sh@35 -- # sleep 3 00:26:52.675 [2024-07-12 12:40:46.384024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:123224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:123232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:123248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:122616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:122624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:122640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:122648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:123264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:123272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:123280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:123328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:123336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.675 [2024-07-12 12:40:46.384671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:123344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.675 [2024-07-12 12:40:46.384686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:123352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:123392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:123400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:123424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:122768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.384973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.384989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:122832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:123456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.676 [2024-07-12 12:40:46.385174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:123464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.676 [2024-07-12 12:40:46.385208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:123472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:123480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:123488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.676 [2024-07-12 12:40:46.385306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:123496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.676 [2024-07-12 12:40:46.385339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:122864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:122872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:122896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:122928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:122952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:123000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:123008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:123512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.676 [2024-07-12 12:40:46.385672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:123520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.676 [2024-07-12 12:40:46.385738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.676 [2024-07-12 12:40:46.385756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:123536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.385771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.385788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:123544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.385804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.385821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:123552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.385837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.385854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:123560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.385881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.385901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:123568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.385931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.385948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:123576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.385962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.385979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:123584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.385994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:123592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:123600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:123608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:123616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:123624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:123632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:123024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:123032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:123040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:123048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:123064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:123112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:123128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:123640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:123648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:123656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:123664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:123672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:123680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:123688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:123704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.677 [2024-07-12 12:40:46.386766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:123712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:123720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.677 [2024-07-12 12:40:46.386832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.677 [2024-07-12 12:40:46.386850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:123728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.386873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.386892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:123736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.386924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.386940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:123744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.386954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.386970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:123752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.386984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:123760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:123768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:123776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:123792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:123800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:123808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:123816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:123824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:123832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:123840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:123136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:123152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:123160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:123168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:123176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:123184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:123200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:123848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:123856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:123864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:123872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:123880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:123888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:123896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:52.678 [2024-07-12 12:40:46.387877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:123216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:123240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.387974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.678 [2024-07-12 12:40:46.387988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.678 [2024-07-12 12:40:46.388003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:123288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:123296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:123304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:123312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:123320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:123912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:123360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:123376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:123384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:123408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:123416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:123432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:123440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:52.679 [2024-07-12 12:40:46.388456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13aa3a0 is same with the state(5) to be set 00:26:52.679 [2024-07-12 12:40:46.388495] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:52.679 [2024-07-12 12:40:46.388508] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:52.679 [2024-07-12 12:40:46.388521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123448 len:8 PRP1 0x0 PRP2 0x0 00:26:52.679 [2024-07-12 12:40:46.388536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:52.679 [2024-07-12 12:40:46.388602] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13aa3a0 was disconnected and freed. reset controller. 00:26:52.679 [2024-07-12 12:40:46.391024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.679 [2024-07-12 12:40:46.391091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.679 [2024-07-12 12:40:46.391618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.391892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.391945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.679 [2024-07-12 12:40:46.391962] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.679 [2024-07-12 12:40:46.392129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.679 [2024-07-12 12:40:46.392358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.679 [2024-07-12 12:40:46.392382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.679 [2024-07-12 12:40:46.392401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.679 [2024-07-12 12:40:46.394604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.679 [2024-07-12 12:40:46.403787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.679 [2024-07-12 12:40:46.404162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.404294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.404322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.679 [2024-07-12 12:40:46.404340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.679 [2024-07-12 12:40:46.404525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.679 [2024-07-12 12:40:46.404714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.679 [2024-07-12 12:40:46.404738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.679 [2024-07-12 12:40:46.404755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.679 [2024-07-12 12:40:46.407104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.679 [2024-07-12 12:40:46.416490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.679 [2024-07-12 12:40:46.416833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.416982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.417011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.679 [2024-07-12 12:40:46.417035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.679 [2024-07-12 12:40:46.417165] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.679 [2024-07-12 12:40:46.417299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.679 [2024-07-12 12:40:46.417324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.679 [2024-07-12 12:40:46.417340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.679 [2024-07-12 12:40:46.419596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.679 [2024-07-12 12:40:46.429039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.679 [2024-07-12 12:40:46.429360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.429519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.679 [2024-07-12 12:40:46.429547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.679 [2024-07-12 12:40:46.429565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.679 [2024-07-12 12:40:46.429768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.679 [2024-07-12 12:40:46.429966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.679 [2024-07-12 12:40:46.429992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.679 [2024-07-12 12:40:46.430008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.679 [2024-07-12 12:40:46.432255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.441568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.680 [2024-07-12 12:40:46.441906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.442049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.442077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.680 [2024-07-12 12:40:46.442095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.680 [2024-07-12 12:40:46.442279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.680 [2024-07-12 12:40:46.442468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.680 [2024-07-12 12:40:46.442492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.680 [2024-07-12 12:40:46.442508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.680 [2024-07-12 12:40:46.444894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.454232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.680 [2024-07-12 12:40:46.454569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.454724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.454753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.680 [2024-07-12 12:40:46.454771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.680 [2024-07-12 12:40:46.454935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.680 [2024-07-12 12:40:46.455116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.680 [2024-07-12 12:40:46.455142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.680 [2024-07-12 12:40:46.455159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.680 [2024-07-12 12:40:46.457353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.466792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.680 [2024-07-12 12:40:46.467082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.467280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.467305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.680 [2024-07-12 12:40:46.467323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.680 [2024-07-12 12:40:46.467516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.680 [2024-07-12 12:40:46.467698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.680 [2024-07-12 12:40:46.467723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.680 [2024-07-12 12:40:46.467740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.680 [2024-07-12 12:40:46.469936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.479296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.680 [2024-07-12 12:40:46.479708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.479863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.479915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.680 [2024-07-12 12:40:46.479932] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.680 [2024-07-12 12:40:46.480049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.680 [2024-07-12 12:40:46.480214] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.680 [2024-07-12 12:40:46.480239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.680 [2024-07-12 12:40:46.480255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.680 [2024-07-12 12:40:46.482807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.491763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.680 [2024-07-12 12:40:46.492068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.492207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.492234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.680 [2024-07-12 12:40:46.492252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.680 [2024-07-12 12:40:46.492472] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.680 [2024-07-12 12:40:46.492648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.680 [2024-07-12 12:40:46.492673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.680 [2024-07-12 12:40:46.492690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.680 [2024-07-12 12:40:46.495124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.504398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.680 [2024-07-12 12:40:46.504697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.504800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.680 [2024-07-12 12:40:46.504827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.680 [2024-07-12 12:40:46.504845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.680 [2024-07-12 12:40:46.505041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.680 [2024-07-12 12:40:46.505216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.680 [2024-07-12 12:40:46.505240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.680 [2024-07-12 12:40:46.505257] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.680 [2024-07-12 12:40:46.507665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.680 [2024-07-12 12:40:46.517023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.517333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.517485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.517513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.517531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.681 [2024-07-12 12:40:46.517679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.681 [2024-07-12 12:40:46.517849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.681 [2024-07-12 12:40:46.517882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.681 [2024-07-12 12:40:46.517900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.681 [2024-07-12 12:40:46.520356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.681 [2024-07-12 12:40:46.529490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.529793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.529907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.529936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.529954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.681 [2024-07-12 12:40:46.530102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.681 [2024-07-12 12:40:46.530290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.681 [2024-07-12 12:40:46.530320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.681 [2024-07-12 12:40:46.530337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.681 [2024-07-12 12:40:46.532622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.681 [2024-07-12 12:40:46.541664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.541947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.542054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.542082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.542099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.681 [2024-07-12 12:40:46.542283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.681 [2024-07-12 12:40:46.542453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.681 [2024-07-12 12:40:46.542478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.681 [2024-07-12 12:40:46.542494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.681 [2024-07-12 12:40:46.544687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.681 [2024-07-12 12:40:46.554327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.554653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.554819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.554845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.554861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.681 [2024-07-12 12:40:46.555019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.681 [2024-07-12 12:40:46.555201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.681 [2024-07-12 12:40:46.555227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.681 [2024-07-12 12:40:46.555243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.681 [2024-07-12 12:40:46.557566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.681 [2024-07-12 12:40:46.567221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.567637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.567793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.567819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.567834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.681 [2024-07-12 12:40:46.567996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.681 [2024-07-12 12:40:46.568101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.681 [2024-07-12 12:40:46.568122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.681 [2024-07-12 12:40:46.568142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.681 [2024-07-12 12:40:46.570621] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.681 [2024-07-12 12:40:46.579724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.580066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.580202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.580227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.580243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.681 [2024-07-12 12:40:46.580396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.681 [2024-07-12 12:40:46.580584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.681 [2024-07-12 12:40:46.580608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.681 [2024-07-12 12:40:46.580624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.681 [2024-07-12 12:40:46.583006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.681 [2024-07-12 12:40:46.592448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.681 [2024-07-12 12:40:46.592789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.592900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.681 [2024-07-12 12:40:46.592940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.681 [2024-07-12 12:40:46.592958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.939 [2024-07-12 12:40:46.593089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.939 [2024-07-12 12:40:46.593259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.939 [2024-07-12 12:40:46.593283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.939 [2024-07-12 12:40:46.593300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.939 [2024-07-12 12:40:46.595808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.939 [2024-07-12 12:40:46.604852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.939 [2024-07-12 12:40:46.605201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.939 [2024-07-12 12:40:46.605416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.939 [2024-07-12 12:40:46.605442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.605458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.605602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.605757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.605781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.605798] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.608143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.617360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.617678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.617803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.617832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.617850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.618008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.618215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.618239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.618256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.620818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.629905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.630270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.630368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.630393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.630409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.630636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.630807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.630830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.630846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.633324] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.642431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.642788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.642925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.642956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.642974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.643123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.643321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.643348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.643371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.645647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.655295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.655644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.655757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.655784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.655800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.655957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.656176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.656200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.656239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.658671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.667883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.668160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.668297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.668325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.668343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.668546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.668699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.668723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.668739] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.671006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.680405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.680706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.680862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.680901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.680920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.681086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.681238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.681263] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.681279] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.683493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.692921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.693251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.693425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.693451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.693467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.693649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.693819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.693843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.693859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.696283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.705591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.705893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.706061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.706086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.706102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.706280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.706469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.706493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.706509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.708851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.718099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.718403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.718560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.718588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.940 [2024-07-12 12:40:46.718605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.940 [2024-07-12 12:40:46.718790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.940 [2024-07-12 12:40:46.719014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.940 [2024-07-12 12:40:46.719039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.940 [2024-07-12 12:40:46.719055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.940 [2024-07-12 12:40:46.721376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.940 [2024-07-12 12:40:46.730618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.940 [2024-07-12 12:40:46.730909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.731046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.940 [2024-07-12 12:40:46.731075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.731093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.731258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.731393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.731417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.731433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.733846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.743221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.743576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.743715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.743743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.743760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.743902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.744072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.744097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.744113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.746362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.755830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.756129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.756240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.756266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.756282] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.756433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.756606] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.756631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.756647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.758960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.768436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.768746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.768886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.768915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.768941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.769126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.769314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.769338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.769355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.771644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.780745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.781048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.781153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.781180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.781198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.781399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.781623] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.781646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.781663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.784123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.793349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.793621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.793844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.793877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.793896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.794068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.794238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.794262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.794278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.796617] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.805980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.806294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.806419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.806447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.806464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.806636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.806806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.806830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.806846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.809194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.818475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.818841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.818960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.818989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.819006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.819172] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.819323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.819347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.819364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.821794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.831020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.831272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.831464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.831489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.941 [2024-07-12 12:40:46.831505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.941 [2024-07-12 12:40:46.831665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.941 [2024-07-12 12:40:46.831836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.941 [2024-07-12 12:40:46.831861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.941 [2024-07-12 12:40:46.831892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.941 [2024-07-12 12:40:46.834251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.941 [2024-07-12 12:40:46.843660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.941 [2024-07-12 12:40:46.844000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.844127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.941 [2024-07-12 12:40:46.844155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.942 [2024-07-12 12:40:46.844172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.942 [2024-07-12 12:40:46.844338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.942 [2024-07-12 12:40:46.844495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.942 [2024-07-12 12:40:46.844520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.942 [2024-07-12 12:40:46.844536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:52.942 [2024-07-12 12:40:46.846860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:52.942 [2024-07-12 12:40:46.856133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:52.942 [2024-07-12 12:40:46.856376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.942 [2024-07-12 12:40:46.856485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:52.942 [2024-07-12 12:40:46.856515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:52.942 [2024-07-12 12:40:46.856533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:52.942 [2024-07-12 12:40:46.856664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:52.942 [2024-07-12 12:40:46.856881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:52.942 [2024-07-12 12:40:46.856906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:52.942 [2024-07-12 12:40:46.856922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.199 [2024-07-12 12:40:46.859219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.199 [2024-07-12 12:40:46.868560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.199 [2024-07-12 12:40:46.868880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.199 [2024-07-12 12:40:46.869018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.199 [2024-07-12 12:40:46.869047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.199 [2024-07-12 12:40:46.869064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.199 [2024-07-12 12:40:46.869249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.199 [2024-07-12 12:40:46.869401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.199 [2024-07-12 12:40:46.869425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.199 [2024-07-12 12:40:46.869441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.199 [2024-07-12 12:40:46.871729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.199 [2024-07-12 12:40:46.881222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.199 [2024-07-12 12:40:46.881566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.199 [2024-07-12 12:40:46.881721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.199 [2024-07-12 12:40:46.881749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.199 [2024-07-12 12:40:46.881767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.199 [2024-07-12 12:40:46.881944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.199 [2024-07-12 12:40:46.882122] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.199 [2024-07-12 12:40:46.882146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.882163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.884358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.894001] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.894358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.894513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.894541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.894558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.894779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.894983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.895013] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.895038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.897593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.906458] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.906715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.906849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.906888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.906908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.907111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.907281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.907306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.907322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.909559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.919115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.919462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.919593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.919619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.919634] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.919796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.920013] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.920039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.920060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.922399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.931655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.932002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.932143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.932168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.932183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.932314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.932486] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.932510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.932526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.934743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.944262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.944588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.944711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.944738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.944756] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.944951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.945158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.945182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.945198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.947481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.956853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.957187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.957345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.957372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.957389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.957573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.957742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.957766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.957788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.960159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.969499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.969774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.969953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.969980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.969996] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.970145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.970340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.970364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.970380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.972666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.981986] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.982301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.982433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.982462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.982479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.982664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.982833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.982857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.982884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.985208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:46.994530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:46.994802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.994956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:46.994982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:46.994997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:46.995131] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.200 [2024-07-12 12:40:46.995293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.200 [2024-07-12 12:40:46.995317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.200 [2024-07-12 12:40:46.995333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.200 [2024-07-12 12:40:46.997817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.200 [2024-07-12 12:40:47.006935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.200 [2024-07-12 12:40:47.007178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:47.007378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.200 [2024-07-12 12:40:47.007412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.200 [2024-07-12 12:40:47.007449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.200 [2024-07-12 12:40:47.007633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.007804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.007828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.007844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.010120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.019480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.019788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.019942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.019968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.019984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.020144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.020349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.020374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.020390] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.022731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.032213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.032562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.032720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.032748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.032765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.032980] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.033188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.033212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.033228] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.035601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.044745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.045048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.045205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.045230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.045246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.045422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.045556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.045580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.045596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.047811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.057237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.057499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.057671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.057697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.057713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.057897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.058082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.058106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.058122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.060441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.069845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.070213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.070341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.070368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.070384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.070546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.070753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.070777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.070793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.073304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.082514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.082796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.082941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.082971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.082990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.083174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.083344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.083368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.083384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.086004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.095092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.095426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.095557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.095584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.095601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.095822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.096020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.096045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.096061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.098455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.201 [2024-07-12 12:40:47.107726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.201 [2024-07-12 12:40:47.108025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.108195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.201 [2024-07-12 12:40:47.108220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.201 [2024-07-12 12:40:47.108236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.201 [2024-07-12 12:40:47.108415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.201 [2024-07-12 12:40:47.108549] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.201 [2024-07-12 12:40:47.108573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.201 [2024-07-12 12:40:47.108589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.201 [2024-07-12 12:40:47.111028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.120339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.120735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.120890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.120920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.120943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.121111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.121280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.121304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.121320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.123951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.132816] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.133240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.133370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.133396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.133412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.133624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.133759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.133782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.133799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.136224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.145247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.145554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.145691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.145720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.145744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.145971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.146157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.146187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.146211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.148850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.157811] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.158132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.158301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.158327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.158343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.158562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.158751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.158776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.158792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.161224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.170341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.170713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.170881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.170911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.170929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.171114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.171265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.171290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.171306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.173706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.183033] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.183332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.183462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.183490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.183507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.183673] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.183825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.183849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.183876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.186093] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.195516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.195846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.195983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.196010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.196028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.196199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.196352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.196376] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.196392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.198624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.207899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.208179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.208330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.208384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.208402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.208550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.208720] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.460 [2024-07-12 12:40:47.208744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.460 [2024-07-12 12:40:47.208759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.460 [2024-07-12 12:40:47.211341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.460 [2024-07-12 12:40:47.220451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.460 [2024-07-12 12:40:47.220746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.220909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.460 [2024-07-12 12:40:47.220935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.460 [2024-07-12 12:40:47.220951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.460 [2024-07-12 12:40:47.221085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.460 [2024-07-12 12:40:47.221303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.221328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.221344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.223810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.232906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.233220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.233392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.233417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.233433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.233580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.233777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.233802] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.233819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.236222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.245476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.245833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.246033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.246059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.246075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.246208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.246426] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.246450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.246466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.248683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.258125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.258563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.258740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.258768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.258786] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.258999] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.259188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.259213] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.259229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.261579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.270702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.271090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.271272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.271298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.271313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.271442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.271561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.271600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.271618] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.273934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.283166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.283484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.283625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.283651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.283667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.283847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.284045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.284069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.284085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.286334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.295718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.296023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.296154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.296181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.296199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.296418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.296570] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.296595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.296611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.299107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.308166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.308517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.308663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.308688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.308703] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.308873] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.309091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.309116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.309138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.311605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.320636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.320871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.321036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.321064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.321082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.321266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.321435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.321460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.321475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.323706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.333153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.333467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.333622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.333650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.333668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.461 [2024-07-12 12:40:47.333816] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.461 [2024-07-12 12:40:47.334032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.461 [2024-07-12 12:40:47.334057] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.461 [2024-07-12 12:40:47.334073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.461 [2024-07-12 12:40:47.336447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.461 [2024-07-12 12:40:47.345781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.461 [2024-07-12 12:40:47.346093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.346229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.461 [2024-07-12 12:40:47.346257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.461 [2024-07-12 12:40:47.346275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.462 [2024-07-12 12:40:47.346423] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.462 [2024-07-12 12:40:47.346575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.462 [2024-07-12 12:40:47.346600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.462 [2024-07-12 12:40:47.346616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.462 [2024-07-12 12:40:47.348968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.462 [2024-07-12 12:40:47.358463] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.462 [2024-07-12 12:40:47.358794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.462 [2024-07-12 12:40:47.358890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.462 [2024-07-12 12:40:47.358920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.462 [2024-07-12 12:40:47.358938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.462 [2024-07-12 12:40:47.359104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.462 [2024-07-12 12:40:47.359256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.462 [2024-07-12 12:40:47.359281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.462 [2024-07-12 12:40:47.359296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.462 [2024-07-12 12:40:47.361707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.462 [2024-07-12 12:40:47.371151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.462 [2024-07-12 12:40:47.371576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.462 [2024-07-12 12:40:47.371704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.462 [2024-07-12 12:40:47.371730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.462 [2024-07-12 12:40:47.371746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.462 [2024-07-12 12:40:47.371922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.462 [2024-07-12 12:40:47.372103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.462 [2024-07-12 12:40:47.372128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.462 [2024-07-12 12:40:47.372144] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.462 [2024-07-12 12:40:47.374374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.383649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.383914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.384058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.384089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.384107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.384273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.384425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.721 [2024-07-12 12:40:47.384448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.721 [2024-07-12 12:40:47.384464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.721 [2024-07-12 12:40:47.386760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.396002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.396326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.396475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.396509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.396529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.396697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.396891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.721 [2024-07-12 12:40:47.396920] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.721 [2024-07-12 12:40:47.396942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.721 [2024-07-12 12:40:47.399362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.408698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.409003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.409183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.409232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.409251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.409399] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.409587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.721 [2024-07-12 12:40:47.409612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.721 [2024-07-12 12:40:47.409628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.721 [2024-07-12 12:40:47.412062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.421363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.421640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.421810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.421836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.421852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.422088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.422295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.721 [2024-07-12 12:40:47.422320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.721 [2024-07-12 12:40:47.422336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.721 [2024-07-12 12:40:47.424746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.433581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.433930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.434064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.434090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.434106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.434311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.434445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.721 [2024-07-12 12:40:47.434470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.721 [2024-07-12 12:40:47.434486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.721 [2024-07-12 12:40:47.436756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.446309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.446640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.446818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.446844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.446860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.447019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.447199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.721 [2024-07-12 12:40:47.447224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.721 [2024-07-12 12:40:47.447240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.721 [2024-07-12 12:40:47.449596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.721 [2024-07-12 12:40:47.458859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.721 [2024-07-12 12:40:47.459152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.459348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.721 [2024-07-12 12:40:47.459413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.721 [2024-07-12 12:40:47.459431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.721 [2024-07-12 12:40:47.459634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.721 [2024-07-12 12:40:47.459804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.459828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.459844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.462085] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.471312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.471631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.471734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.471768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.471787] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.471989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.472145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.472181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.472195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.474527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.483838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.484126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.484246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.484290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.484311] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.484478] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.484630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.484654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.484670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.486969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.496341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.496653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.496786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.496814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.496832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.497009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.497163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.497187] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.497202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.499562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.508753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.509040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.509167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.509195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.509218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.509402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.509590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.509614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.509630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.512020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.521456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.521782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.521911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.521941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.521959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.522143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.522331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.522355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.522371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.524710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.533979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.534293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.534440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.534486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.534504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.534687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.534821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.534845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.534861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.537174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.546621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.546918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.547024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.547067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.547084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.547237] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.547395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.547419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.547435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.549776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.559196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.559492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.559660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.559686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.559702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.559877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.560111] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.560136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.560152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.562291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.571842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.572123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.572251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.572279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.572297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.572445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.722 [2024-07-12 12:40:47.572634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.722 [2024-07-12 12:40:47.572658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.722 [2024-07-12 12:40:47.572674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.722 [2024-07-12 12:40:47.575004] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.722 [2024-07-12 12:40:47.584281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.722 [2024-07-12 12:40:47.584556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.584648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.722 [2024-07-12 12:40:47.584672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.722 [2024-07-12 12:40:47.584687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.722 [2024-07-12 12:40:47.584832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.723 [2024-07-12 12:40:47.584968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.723 [2024-07-12 12:40:47.584990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.723 [2024-07-12 12:40:47.585005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.723 [2024-07-12 12:40:47.587103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.723 [2024-07-12 12:40:47.596582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.723 [2024-07-12 12:40:47.596938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.597029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.597055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.723 [2024-07-12 12:40:47.597071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.723 [2024-07-12 12:40:47.597250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.723 [2024-07-12 12:40:47.597390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.723 [2024-07-12 12:40:47.597411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.723 [2024-07-12 12:40:47.597424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.723 [2024-07-12 12:40:47.599401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.723 [2024-07-12 12:40:47.609173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.723 [2024-07-12 12:40:47.609513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.609621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.723 [2024-07-12 12:40:47.609662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.723 [2024-07-12 12:40:47.609892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.723 [2024-07-12 12:40:47.610036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.723 [2024-07-12 12:40:47.610058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.723 [2024-07-12 12:40:47.610087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.723 [2024-07-12 12:40:47.612692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.723 [2024-07-12 12:40:47.622071] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.723 [2024-07-12 12:40:47.622412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.622540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.622569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.723 [2024-07-12 12:40:47.622586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.723 [2024-07-12 12:40:47.622697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.723 [2024-07-12 12:40:47.622849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.723 [2024-07-12 12:40:47.622893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.723 [2024-07-12 12:40:47.622927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.723 [2024-07-12 12:40:47.625091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.723 [2024-07-12 12:40:47.634593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.723 [2024-07-12 12:40:47.634921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.635025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.723 [2024-07-12 12:40:47.635068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.723 [2024-07-12 12:40:47.635084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.723 [2024-07-12 12:40:47.635217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.723 [2024-07-12 12:40:47.635424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.723 [2024-07-12 12:40:47.635447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.723 [2024-07-12 12:40:47.635463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.723 [2024-07-12 12:40:47.637819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.982 [2024-07-12 12:40:47.647341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.982 [2024-07-12 12:40:47.647678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.982 [2024-07-12 12:40:47.647841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.982 [2024-07-12 12:40:47.647880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.982 [2024-07-12 12:40:47.647902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.982 [2024-07-12 12:40:47.648038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.982 [2024-07-12 12:40:47.648222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.982 [2024-07-12 12:40:47.648248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.982 [2024-07-12 12:40:47.648265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.982 [2024-07-12 12:40:47.650932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.982 [2024-07-12 12:40:47.659628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.982 [2024-07-12 12:40:47.659947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.982 [2024-07-12 12:40:47.660075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.982 [2024-07-12 12:40:47.660102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.982 [2024-07-12 12:40:47.660118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.982 [2024-07-12 12:40:47.660257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.982 [2024-07-12 12:40:47.660416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.660439] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.660470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.662593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.671773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.672063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.672221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.672247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.672263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.672460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.672636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.672656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.672670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.674795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.684343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.684654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.684821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.684846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.684862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.685020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.685195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.685218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.685235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.687403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.697102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.697403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.697571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.697596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.697612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.697776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.697966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.697991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.698008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.700481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.709668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.710010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.710137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.710166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.710182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.710303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.710485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.710510] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.710526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.713037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.722255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.722569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.722703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.722730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.722747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.722941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.723129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.723153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.723169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.725417] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.734856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.735161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.735316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.735345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.735363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.735546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.735734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.735758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.735774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.738250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.747443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.747759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.747873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.747902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.747919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.748104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.748293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.748316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.748332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.750911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.760067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.760397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.760520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.760545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.983 [2024-07-12 12:40:47.760561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.983 [2024-07-12 12:40:47.760767] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.983 [2024-07-12 12:40:47.760951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.983 [2024-07-12 12:40:47.760976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.983 [2024-07-12 12:40:47.760992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.983 [2024-07-12 12:40:47.763383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.983 [2024-07-12 12:40:47.772480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.983 [2024-07-12 12:40:47.772810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.772976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.983 [2024-07-12 12:40:47.773005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.773023] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.773225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.773378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.773402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.773418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.775720] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.785274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.785543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.785674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.785700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.785716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.785964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.786153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.786177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.786194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.788514] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.797937] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.798295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.798425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.798451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.798467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.798610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.798779] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.798804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.798820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.801206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.810346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.810709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.810879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.810914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.810930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.811094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.811273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.811297] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.811314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.813579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.822964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.823304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.823540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.823570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.823586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.823736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.823936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.823961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.823977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.826297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.835424] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.835753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.835850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.835885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.835903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.836059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.836227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.836252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.836269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.838679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.848050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.848414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.848600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.848626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.848643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.848848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.849040] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.849065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.849082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.851275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.860495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.860816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.860978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.861004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.861025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.861148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.861291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.861316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.861332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.863616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.873199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.873513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.873636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.873663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.873679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.873858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.874016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.874040] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.874056] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.876483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.885697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.886068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.886189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.886215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.984 [2024-07-12 12:40:47.886231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.984 [2024-07-12 12:40:47.886411] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.984 [2024-07-12 12:40:47.886563] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.984 [2024-07-12 12:40:47.886587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.984 [2024-07-12 12:40:47.886602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:53.984 [2024-07-12 12:40:47.888968] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:53.984 [2024-07-12 12:40:47.898431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:53.984 [2024-07-12 12:40:47.898702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.984 [2024-07-12 12:40:47.898803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:53.985 [2024-07-12 12:40:47.898830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:53.985 [2024-07-12 12:40:47.898847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:53.985 [2024-07-12 12:40:47.899102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:53.985 [2024-07-12 12:40:47.899313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:53.985 [2024-07-12 12:40:47.899343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:53.985 [2024-07-12 12:40:47.899368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.243 [2024-07-12 12:40:47.901785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.243 [2024-07-12 12:40:47.910966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.243 [2024-07-12 12:40:47.911280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.911410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.911439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.243 [2024-07-12 12:40:47.911457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.243 [2024-07-12 12:40:47.911606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.243 [2024-07-12 12:40:47.911794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.243 [2024-07-12 12:40:47.911819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.243 [2024-07-12 12:40:47.911835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.243 [2024-07-12 12:40:47.914104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.243 [2024-07-12 12:40:47.923355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.243 [2024-07-12 12:40:47.923689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.923821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.923849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.243 [2024-07-12 12:40:47.923876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.243 [2024-07-12 12:40:47.924081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.243 [2024-07-12 12:40:47.924233] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.243 [2024-07-12 12:40:47.924257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.243 [2024-07-12 12:40:47.924273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.243 [2024-07-12 12:40:47.926737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.243 [2024-07-12 12:40:47.935906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.243 [2024-07-12 12:40:47.936201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.936306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.936333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.243 [2024-07-12 12:40:47.936350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.243 [2024-07-12 12:40:47.936462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.243 [2024-07-12 12:40:47.936622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.243 [2024-07-12 12:40:47.936647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.243 [2024-07-12 12:40:47.936663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.243 [2024-07-12 12:40:47.938977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.243 [2024-07-12 12:40:47.948595] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.243 [2024-07-12 12:40:47.948901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.949029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.243 [2024-07-12 12:40:47.949057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.243 [2024-07-12 12:40:47.949074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.243 [2024-07-12 12:40:47.949258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:47.949410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:47.949434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:47.949450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:47.951825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:47.961186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:47.961498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.961625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.961650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:47.961666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:47.961837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:47.962077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:47.962101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:47.962118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:47.964510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:47.973876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:47.974254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.974390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.974416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:47.974431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:47.974597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:47.974782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:47.974811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:47.974829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:47.977105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:47.986556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:47.986894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.987051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.987080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:47.987098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:47.987228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:47.987380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:47.987404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:47.987421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:47.989741] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:47.999120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:47.999460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.999582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:47.999607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:47.999623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:47.999804] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:47.999985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:48.000010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:48.000027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:48.002509] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:48.011594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:48.011970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.012067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.012092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:48.012108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:48.012337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:48.012490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:48.012514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:48.012536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:48.014940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:48.024049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:48.024364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.024512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.024537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:48.024553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:48.024653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:48.024863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:48.024904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:48.024920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:48.027239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:48.036462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:48.036782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.036920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.036948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:48.036964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:48.037144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:48.037332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:48.037356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:48.037372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:48.039899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:48.049242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:48.049558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.049697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.049725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:48.049743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:48.049959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:48.050130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:48.050155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:48.050171] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:48.052522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:48.061800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:48.062092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.062263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.062289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:48.062306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:48.062449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.244 [2024-07-12 12:40:48.062637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.244 [2024-07-12 12:40:48.062662] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.244 [2024-07-12 12:40:48.062678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.244 [2024-07-12 12:40:48.064956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.244 [2024-07-12 12:40:48.074417] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.244 [2024-07-12 12:40:48.074816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.074992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.244 [2024-07-12 12:40:48.075021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.244 [2024-07-12 12:40:48.075039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.244 [2024-07-12 12:40:48.075205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.075339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.075363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.075379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.077564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.245 [2024-07-12 12:40:48.086961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.245 [2024-07-12 12:40:48.087331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.087497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.087540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.245 [2024-07-12 12:40:48.087558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.245 [2024-07-12 12:40:48.087724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.087906] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.087931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.087947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.090373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.245 [2024-07-12 12:40:48.099471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.245 [2024-07-12 12:40:48.099772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.099904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.099930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.245 [2024-07-12 12:40:48.099945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.245 [2024-07-12 12:40:48.100158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.100329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.100353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.100369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.102526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.245 [2024-07-12 12:40:48.112151] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.245 [2024-07-12 12:40:48.112448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.112575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.112603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.245 [2024-07-12 12:40:48.112620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.245 [2024-07-12 12:40:48.112786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.112984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.113009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.113025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.115453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.245 [2024-07-12 12:40:48.124968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.245 [2024-07-12 12:40:48.125356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.125469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.125494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.245 [2024-07-12 12:40:48.125509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.245 [2024-07-12 12:40:48.125656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.125823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.125847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.125864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.128238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.245 [2024-07-12 12:40:48.137516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.245 [2024-07-12 12:40:48.137811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.137967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.137996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.245 [2024-07-12 12:40:48.138013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.245 [2024-07-12 12:40:48.138197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.138331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.138355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.138371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.140674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.245 [2024-07-12 12:40:48.150198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.245 [2024-07-12 12:40:48.150516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.150653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.245 [2024-07-12 12:40:48.150681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.245 [2024-07-12 12:40:48.150699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.245 [2024-07-12 12:40:48.150924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.245 [2024-07-12 12:40:48.151131] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.245 [2024-07-12 12:40:48.151158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.245 [2024-07-12 12:40:48.151174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.245 [2024-07-12 12:40:48.153712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.162803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.163174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.163301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.163328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.163345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.163484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.163632] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.163657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.163673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.166016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.175325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.175670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.175816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.175848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.175874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.176032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.176217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.176241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.176258] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.178526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.188044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.188368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.188496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.188539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.188555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.188704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.188892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.188927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.188940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.191166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.200718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.201031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.201175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.201201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.201217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.201361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.201531] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.201555] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.201571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.204010] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.213231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.213559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.213720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.213746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.213767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.213960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.214141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.214165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.214182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.216429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.225591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.225939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.226065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.226090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.226106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.226281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.226470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.226493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.226509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.228597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.238187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.238556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.238673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.238698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.238714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.238890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.239045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.239070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.504 [2024-07-12 12:40:48.239086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.504 [2024-07-12 12:40:48.241334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.504 [2024-07-12 12:40:48.250759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.504 [2024-07-12 12:40:48.251032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.251144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.504 [2024-07-12 12:40:48.251168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.504 [2024-07-12 12:40:48.251184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.504 [2024-07-12 12:40:48.251364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.504 [2024-07-12 12:40:48.251516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.504 [2024-07-12 12:40:48.251541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.251556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.253825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.263183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.263481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.263612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.263640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.263658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.263889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.264114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.264139] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.264155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.266385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.275892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.276168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.276312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.276340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.276357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.276559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.276712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.276736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.276752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.279041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.288524] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.288829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.288997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.289026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.289044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.289228] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.289439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.289464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.289480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.291567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.301044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.301409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.301532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.301558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.301575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.301735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.301919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.301951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.301966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.304182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.313770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.314068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.314174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.314198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.314214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.314331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.314546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.314570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.314587] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.316973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.326298] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.326604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.326729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.326756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.326773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.326915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.327049] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.327079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.327095] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.329630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.338988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.339243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.339379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.339404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.339420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.339661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.339879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.339904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.339921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.342080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.351559] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.351908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.352015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.352042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.352060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.352279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.352432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.352456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.352472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.354688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.364256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.364585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.364739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.364767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.364784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.364998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.365168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.365193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.505 [2024-07-12 12:40:48.365214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.505 [2024-07-12 12:40:48.367592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.505 [2024-07-12 12:40:48.376757] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.505 [2024-07-12 12:40:48.377078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.377249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.505 [2024-07-12 12:40:48.377274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.505 [2024-07-12 12:40:48.377290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.505 [2024-07-12 12:40:48.377440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.505 [2024-07-12 12:40:48.377590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.505 [2024-07-12 12:40:48.377614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.506 [2024-07-12 12:40:48.377630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.506 [2024-07-12 12:40:48.380072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.506 [2024-07-12 12:40:48.389282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.506 [2024-07-12 12:40:48.389588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.506 [2024-07-12 12:40:48.389713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.506 [2024-07-12 12:40:48.389737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.506 [2024-07-12 12:40:48.389753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.506 [2024-07-12 12:40:48.389962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.506 [2024-07-12 12:40:48.390134] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.506 [2024-07-12 12:40:48.390159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.506 [2024-07-12 12:40:48.390174] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.506 [2024-07-12 12:40:48.392637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.506 [2024-07-12 12:40:48.401984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.506 [2024-07-12 12:40:48.402351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.506 [2024-07-12 12:40:48.402474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.506 [2024-07-12 12:40:48.402505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.506 [2024-07-12 12:40:48.402523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.506 [2024-07-12 12:40:48.402703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.506 [2024-07-12 12:40:48.402909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.506 [2024-07-12 12:40:48.402949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.506 [2024-07-12 12:40:48.402964] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.506 [2024-07-12 12:40:48.405493] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.506 [2024-07-12 12:40:48.414587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.506 [2024-07-12 12:40:48.414886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.506 [2024-07-12 12:40:48.415059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.506 [2024-07-12 12:40:48.415085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.506 [2024-07-12 12:40:48.415102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.506 [2024-07-12 12:40:48.415273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.506 [2024-07-12 12:40:48.415462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.506 [2024-07-12 12:40:48.415486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.506 [2024-07-12 12:40:48.415503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.506 [2024-07-12 12:40:48.417933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.765 [2024-07-12 12:40:48.426930] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.765 [2024-07-12 12:40:48.427298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.427528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.427579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.427598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.427764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.427964] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.427991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.428011] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.430586] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.439372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.439704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.439824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.439849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.440085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.440263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.440433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.440458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.440474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.442706] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.451879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.452186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.452320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.452349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.452367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.452588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.452776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.452800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.452817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.455222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.464575] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.464925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.465055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.465080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.465096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.465253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.465406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.465430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.465446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.467889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.477252] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.477578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.477712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.477741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.477759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.477919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.478127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.478155] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.478172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.480533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.489622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.489963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.490093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.490119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.490135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.490289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.490424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.490450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.490469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.492753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.502221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.502521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.502657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.502686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.502704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.502852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.502996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.503021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.503037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.505320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.514989] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.515275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.515405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.515432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.515450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.515634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.515803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.515827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.515843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.518210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.527600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.527900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.528028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.528063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.528082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.528266] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.528454] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.528478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.528494] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.530656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.540281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.540594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.540731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.766 [2024-07-12 12:40:48.540758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.766 [2024-07-12 12:40:48.540776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.766 [2024-07-12 12:40:48.540953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.766 [2024-07-12 12:40:48.541106] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.766 [2024-07-12 12:40:48.541130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.766 [2024-07-12 12:40:48.541146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.766 [2024-07-12 12:40:48.543574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.766 [2024-07-12 12:40:48.552728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.766 [2024-07-12 12:40:48.553063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.553194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.553221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.553238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.553368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.553555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.553580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.553597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.556016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.565511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.565929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.566051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.566076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.566112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.566262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.566431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.566455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.566471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.568651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.577920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.578256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.578384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.578409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.578425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.578633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.578767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.578791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.578807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.581049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.590416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.590743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.590886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.590916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.590934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.591118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.591306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.591330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.591346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.593777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.603035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.603386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.603515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.603542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.603560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.603732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.603915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.603940] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.603956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.606277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.615493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.615788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.615919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.615948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.615965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.616077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.616246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.616271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.616287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.618590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.627962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.628246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.628398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.628424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.628440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.628651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.628821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.628846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.628862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.631122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.640535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.640875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.640996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.641021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.641037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.641217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.641413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.641438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.641454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.643597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.653171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.653471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.653607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.653637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.653655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.653875] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.654089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.654115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.767 [2024-07-12 12:40:48.654132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.767 [2024-07-12 12:40:48.656650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.767 [2024-07-12 12:40:48.665746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.767 [2024-07-12 12:40:48.666100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.666316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.767 [2024-07-12 12:40:48.666345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.767 [2024-07-12 12:40:48.666362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.767 [2024-07-12 12:40:48.666529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.767 [2024-07-12 12:40:48.666735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.767 [2024-07-12 12:40:48.666759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.768 [2024-07-12 12:40:48.666775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.768 [2024-07-12 12:40:48.669215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:54.768 [2024-07-12 12:40:48.678323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:54.768 [2024-07-12 12:40:48.678603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.768 [2024-07-12 12:40:48.678758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:54.768 [2024-07-12 12:40:48.678786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:54.768 [2024-07-12 12:40:48.678804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:54.768 [2024-07-12 12:40:48.679001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:54.768 [2024-07-12 12:40:48.679191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:54.768 [2024-07-12 12:40:48.679221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:54.768 [2024-07-12 12:40:48.679238] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:54.768 [2024-07-12 12:40:48.681660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.027 [2024-07-12 12:40:48.690922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.027 [2024-07-12 12:40:48.691234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.027 [2024-07-12 12:40:48.691331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.027 [2024-07-12 12:40:48.691359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.027 [2024-07-12 12:40:48.691378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.027 [2024-07-12 12:40:48.691562] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.027 [2024-07-12 12:40:48.691734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.027 [2024-07-12 12:40:48.691758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.027 [2024-07-12 12:40:48.691774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.027 [2024-07-12 12:40:48.693998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.027 [2024-07-12 12:40:48.703459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.027 [2024-07-12 12:40:48.703816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.027 [2024-07-12 12:40:48.703952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.027 [2024-07-12 12:40:48.703981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.027 [2024-07-12 12:40:48.703999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.027 [2024-07-12 12:40:48.704148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.027 [2024-07-12 12:40:48.704282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.027 [2024-07-12 12:40:48.704307] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.027 [2024-07-12 12:40:48.704323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.027 [2024-07-12 12:40:48.706680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.716333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.716686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.716798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.716823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.716838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.717056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.717210] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.717234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.717256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.719632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.728923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.729206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.729337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.729362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.729377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.729543] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.729728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.729752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.729767] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.731892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.741194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.741444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.741572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.741597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.741612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.741810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.741983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.742005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.742020] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.744071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.753854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.754148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.754292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.754319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.754336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.754502] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.754690] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.754714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.754730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.757064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.766286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.766649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.766758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.766786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.766803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.766997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.767150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.767175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.767191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.769552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.778853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.779115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.779248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.779276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.779293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.779495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.779665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.779689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.779706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.782022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.791669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.791959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.792051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.792076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.792092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.792287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.792475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.792500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.792517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.794948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.803994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.804298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.804439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.804466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.804484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.804685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.804855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.804893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.804910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.807231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.816555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.816903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.817013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.817041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.817059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.817189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.817359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.817383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.817399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.819670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.028 [2024-07-12 12:40:48.829279] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.028 [2024-07-12 12:40:48.829560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.829682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.028 [2024-07-12 12:40:48.829709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.028 [2024-07-12 12:40:48.829727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.028 [2024-07-12 12:40:48.829922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.028 [2024-07-12 12:40:48.830074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.028 [2024-07-12 12:40:48.830098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.028 [2024-07-12 12:40:48.830114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.028 [2024-07-12 12:40:48.832274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.841932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.842239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.842397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.842443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.842461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.842609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.842761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.842785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.842801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.845312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.854460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.854762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.854892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.854931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.854948] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.855096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.855241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.855265] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.855281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.857399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.867069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.867380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.867517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.867543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.867559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.867706] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.867900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.867925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.867941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.870302] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.879806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.880128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.880239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.880285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.880301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.880496] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.880699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.880724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.880740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.883108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.892445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.892736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.892877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.892919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.892935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.893100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.893267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.893291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.893307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.895772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.905267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.905635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.905798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.905829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.905847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.906088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.906254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.906280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.906305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.908862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.917904] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.918212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.918361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.918389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.918412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.918615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.918803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.918828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.918845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.921115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.930500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.930820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.930926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.930952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.930968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.931103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.931237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.931260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.931276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.029 [2024-07-12 12:40:48.933528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.029 [2024-07-12 12:40:48.943120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.029 [2024-07-12 12:40:48.943450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.943567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.029 [2024-07-12 12:40:48.943591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.029 [2024-07-12 12:40:48.943607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.029 [2024-07-12 12:40:48.943786] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.029 [2024-07-12 12:40:48.943928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.029 [2024-07-12 12:40:48.943958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.029 [2024-07-12 12:40:48.943977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.288 [2024-07-12 12:40:48.946447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.288 [2024-07-12 12:40:48.955769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.288 [2024-07-12 12:40:48.956095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.956237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.956262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.288 [2024-07-12 12:40:48.956277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.288 [2024-07-12 12:40:48.956416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.288 [2024-07-12 12:40:48.956624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.288 [2024-07-12 12:40:48.956648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.288 [2024-07-12 12:40:48.956664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.288 [2024-07-12 12:40:48.958851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.288 [2024-07-12 12:40:48.968393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.288 [2024-07-12 12:40:48.968716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.968843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.968878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.288 [2024-07-12 12:40:48.968898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.288 [2024-07-12 12:40:48.969086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.288 [2024-07-12 12:40:48.969291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.288 [2024-07-12 12:40:48.969314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.288 [2024-07-12 12:40:48.969331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.288 [2024-07-12 12:40:48.971655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.288 [2024-07-12 12:40:48.981135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.288 [2024-07-12 12:40:48.981502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.981639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.981668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.288 [2024-07-12 12:40:48.981686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.288 [2024-07-12 12:40:48.981854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.288 [2024-07-12 12:40:48.982062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.288 [2024-07-12 12:40:48.982087] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.288 [2024-07-12 12:40:48.982103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.288 [2024-07-12 12:40:48.984676] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.288 [2024-07-12 12:40:48.993923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.288 [2024-07-12 12:40:48.994223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.994348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:48.994376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.288 [2024-07-12 12:40:48.994394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.288 [2024-07-12 12:40:48.994580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.288 [2024-07-12 12:40:48.994756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.288 [2024-07-12 12:40:48.994780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.288 [2024-07-12 12:40:48.994797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.288 [2024-07-12 12:40:48.997126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.288 [2024-07-12 12:40:49.006623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.288 [2024-07-12 12:40:49.006946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:49.007072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.288 [2024-07-12 12:40:49.007097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.007114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.007308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.007496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.007521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.007538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.009809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.019262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.019563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.019696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.019723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.019741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.019921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.020128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.020151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.020169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.022615] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.031765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.032057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.032188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.032215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.032234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.032400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.032588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.032618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.032635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.035258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.044468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.044772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.044899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.044925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.044942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.045126] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.045314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.045338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.045355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.047677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.056952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.057274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.057372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.057400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.057419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.057587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.057756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.057781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.057797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.060308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.069749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.070026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.070178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.070205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.070224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.070355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.070507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.070531] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.070553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.072862] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.082130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.082467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.082618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.082643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.082659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.082835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.083052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.083077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.083093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.085361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.094604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.094934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.095059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.095084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.095101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.095251] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.095431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.095455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.095471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.098146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.107166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.107450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.107572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.107598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.107617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.107802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.108004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.108037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.108055] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.110384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.119806] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.120139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.120272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.120300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.289 [2024-07-12 12:40:49.120318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.289 [2024-07-12 12:40:49.120485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.289 [2024-07-12 12:40:49.120691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.289 [2024-07-12 12:40:49.120714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.289 [2024-07-12 12:40:49.120731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.289 [2024-07-12 12:40:49.123078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.289 [2024-07-12 12:40:49.132467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.289 [2024-07-12 12:40:49.132791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.132962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.289 [2024-07-12 12:40:49.132988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.290 [2024-07-12 12:40:49.133005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.290 [2024-07-12 12:40:49.133186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.290 [2024-07-12 12:40:49.133390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.290 [2024-07-12 12:40:49.133414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.290 [2024-07-12 12:40:49.133431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.290 [2024-07-12 12:40:49.135661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.290 [2024-07-12 12:40:49.144943] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.290 [2024-07-12 12:40:49.145240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.145390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.145417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.290 [2024-07-12 12:40:49.145436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.290 [2024-07-12 12:40:49.145640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.290 [2024-07-12 12:40:49.145810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.290 [2024-07-12 12:40:49.145833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.290 [2024-07-12 12:40:49.145850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.290 [2024-07-12 12:40:49.148107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.290 [2024-07-12 12:40:49.157629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.290 [2024-07-12 12:40:49.157965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.158114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.158146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.290 [2024-07-12 12:40:49.158180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.290 [2024-07-12 12:40:49.158383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.290 [2024-07-12 12:40:49.158536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.290 [2024-07-12 12:40:49.158560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.290 [2024-07-12 12:40:49.158577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.290 [2024-07-12 12:40:49.160737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.290 [2024-07-12 12:40:49.169934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.290 [2024-07-12 12:40:49.170304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.170417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.170445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.290 [2024-07-12 12:40:49.170463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.290 [2024-07-12 12:40:49.170593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.290 [2024-07-12 12:40:49.170762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.290 [2024-07-12 12:40:49.170786] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.290 [2024-07-12 12:40:49.170802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.290 [2024-07-12 12:40:49.172972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.290 [2024-07-12 12:40:49.182525] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.290 [2024-07-12 12:40:49.182822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.182955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.182983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.290 [2024-07-12 12:40:49.183001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.290 [2024-07-12 12:40:49.183186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.290 [2024-07-12 12:40:49.183373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.290 [2024-07-12 12:40:49.183396] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.290 [2024-07-12 12:40:49.183414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.290 [2024-07-12 12:40:49.185941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.290 [2024-07-12 12:40:49.195212] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.290 [2024-07-12 12:40:49.195502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.195626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.290 [2024-07-12 12:40:49.195665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.290 [2024-07-12 12:40:49.195681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.290 [2024-07-12 12:40:49.195842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.290 [2024-07-12 12:40:49.196018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.290 [2024-07-12 12:40:49.196038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.290 [2024-07-12 12:40:49.196052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.290 [2024-07-12 12:40:49.198473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.207948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.208235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.208368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.208395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.549 [2024-07-12 12:40:49.208413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.549 [2024-07-12 12:40:49.208599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.549 [2024-07-12 12:40:49.208805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.549 [2024-07-12 12:40:49.208828] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.549 [2024-07-12 12:40:49.208845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.549 [2024-07-12 12:40:49.211265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.220541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.220849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.220964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.221005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.549 [2024-07-12 12:40:49.221022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.549 [2024-07-12 12:40:49.221218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.549 [2024-07-12 12:40:49.221352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.549 [2024-07-12 12:40:49.221377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.549 [2024-07-12 12:40:49.221393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.549 [2024-07-12 12:40:49.223696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.233059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.233385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.233509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.233543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.549 [2024-07-12 12:40:49.233568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.549 [2024-07-12 12:40:49.233718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.549 [2024-07-12 12:40:49.233899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.549 [2024-07-12 12:40:49.233924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.549 [2024-07-12 12:40:49.233940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.549 [2024-07-12 12:40:49.236317] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.245413] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.245673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.245830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.245858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.549 [2024-07-12 12:40:49.245888] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.549 [2024-07-12 12:40:49.246039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.549 [2024-07-12 12:40:49.246191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.549 [2024-07-12 12:40:49.246215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.549 [2024-07-12 12:40:49.246231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.549 [2024-07-12 12:40:49.248678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.257902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.258250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.258379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.258413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.549 [2024-07-12 12:40:49.258432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.549 [2024-07-12 12:40:49.258599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.549 [2024-07-12 12:40:49.258786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.549 [2024-07-12 12:40:49.258810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.549 [2024-07-12 12:40:49.258827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.549 [2024-07-12 12:40:49.261265] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.270583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.270862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.271011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.271036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.549 [2024-07-12 12:40:49.271064] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.549 [2024-07-12 12:40:49.271260] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.549 [2024-07-12 12:40:49.271468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.549 [2024-07-12 12:40:49.271493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.549 [2024-07-12 12:40:49.271510] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.549 [2024-07-12 12:40:49.273797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.549 [2024-07-12 12:40:49.283284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.549 [2024-07-12 12:40:49.283681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.283831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.549 [2024-07-12 12:40:49.283858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.550 [2024-07-12 12:40:49.283890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.550 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1384912 Killed "${NVMF_APP[@]}" "$@" 00:26:55.550 12:40:49 -- host/bdevperf.sh@36 -- # tgt_init 00:26:55.550 12:40:49 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:26:55.550 12:40:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:55.550 12:40:49 -- common/autotest_common.sh@712 -- # xtrace_disable 00:26:55.550 12:40:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.550 12:40:49 -- nvmf/common.sh@469 -- # nvmfpid=1386029 00:26:55.550 12:40:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:26:55.550 12:40:49 -- nvmf/common.sh@470 -- # waitforlisten 1386029 00:26:55.550 12:40:49 -- common/autotest_common.sh@819 -- # '[' -z 1386029 ']' 00:26:55.550 12:40:49 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:55.550 12:40:49 -- common/autotest_common.sh@824 -- # local max_retries=100 00:26:55.550 12:40:49 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:55.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:55.550 12:40:49 -- common/autotest_common.sh@828 -- # xtrace_disable 00:26:55.550 12:40:49 -- common/autotest_common.sh@10 -- # set +x 00:26:55.550 [2024-07-12 12:40:49.419762] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:26:55.550 [2024-07-12 12:40:49.419861] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:55.550 EAL: No free 2048 kB hugepages reported on node 1 00:26:55.810 [2024-07-12 12:40:49.476734] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.810 [2024-07-12 12:40:49.476788] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:26:55.810 [2024-07-12 12:40:49.476954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.810 [2024-07-12 12:40:49.476976] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.810 [2024-07-12 12:40:49.476994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.810 [2024-07-12 12:40:49.479061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.810 [2024-07-12 12:40:49.486496] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:26:55.810 [2024-07-12 12:40:49.489020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.810 [2024-07-12 12:40:49.489429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.810 [2024-07-12 12:40:49.489578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.810 [2024-07-12 12:40:49.489605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.810 [2024-07-12 12:40:49.489625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.810 [2024-07-12 12:40:49.489810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.810 [2024-07-12 12:40:49.489990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.810 [2024-07-12 12:40:49.490015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.490031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.492043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.501118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.501634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.501810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.501837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.501875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.502068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.502240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.502261] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.502277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.504376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.513348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.513624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.513758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.513783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.513800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.513912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.514082] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.514105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.514120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.516060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.525628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.525997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.526149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.526178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.526195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.526358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.526545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.526566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.526581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.528649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.537918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.538270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.538375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.538401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.538419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.538550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.538683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.538704] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.538718] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.540765] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.550131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.550649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.550800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.550827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.550847] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.551046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.551238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.551260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.551276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.553424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.562445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.562815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.562953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.562993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.563014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.563167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.563353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.563374] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.563389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.565492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.574558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.574893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.574995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.575021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.575038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.575222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.575416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.575437] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.575451] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.577306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.586819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.587142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.587236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.587262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.587279] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.587445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.587639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.587660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.587674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.589714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.595541] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:55.811 [2024-07-12 12:40:49.595663] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:55.811 [2024-07-12 12:40:49.595682] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:55.811 [2024-07-12 12:40:49.595695] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:55.811 [2024-07-12 12:40:49.595753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:55.811 [2024-07-12 12:40:49.595810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:55.811 [2024-07-12 12:40:49.595813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:55.811 [2024-07-12 12:40:49.599249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.599623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.599753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.599778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.811 [2024-07-12 12:40:49.599796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.811 [2024-07-12 12:40:49.599993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.811 [2024-07-12 12:40:49.600117] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.811 [2024-07-12 12:40:49.600140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.811 [2024-07-12 12:40:49.600156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.811 [2024-07-12 12:40:49.602274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.811 [2024-07-12 12:40:49.611720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.811 [2024-07-12 12:40:49.612180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.811 [2024-07-12 12:40:49.612340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.612367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.612387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.612549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.612735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.612760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.612777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.615039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.623926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.624335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.624484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.624515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.624535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.624764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.624948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.624973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.624991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.627213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.636386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.636857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.636993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.637021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.637041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.637154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.637294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.637319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.637337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.639460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.648732] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.649200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.649340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.649368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.649388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.649568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.649706] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.649730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.649747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.652030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.661210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.661557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.661663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.661689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.661710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.661942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.662085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.662109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.662127] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.664255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.673843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.674358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.674504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.674532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.674553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.674765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.674963] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.674989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.675007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.677381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.686302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.686597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.686731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.686758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.686777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.686940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.687095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.687119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.687135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.689259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.698511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.698773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.698897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.698923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.698940] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.699091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.699262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.699285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.699301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.701390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.710935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.711345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.711441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.711469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.711486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.711638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.711790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.711814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.711829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.713938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:55.812 [2024-07-12 12:40:49.723132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:55.812 [2024-07-12 12:40:49.723435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.723568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:55.812 [2024-07-12 12:40:49.723603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:55.812 [2024-07-12 12:40:49.723620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:55.812 [2024-07-12 12:40:49.723820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:55.812 [2024-07-12 12:40:49.724014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:55.812 [2024-07-12 12:40:49.724043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:55.812 [2024-07-12 12:40:49.724060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:55.812 [2024-07-12 12:40:49.726255] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.072 [2024-07-12 12:40:49.735676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.072 [2024-07-12 12:40:49.735936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.736083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.736111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.072 [2024-07-12 12:40:49.736128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.072 [2024-07-12 12:40:49.736267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.072 [2024-07-12 12:40:49.736423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.072 [2024-07-12 12:40:49.736446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.072 [2024-07-12 12:40:49.736466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.072 [2024-07-12 12:40:49.738899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.072 [2024-07-12 12:40:49.748009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.072 [2024-07-12 12:40:49.748298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.748403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.748428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.072 [2024-07-12 12:40:49.748445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.072 [2024-07-12 12:40:49.748613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.072 [2024-07-12 12:40:49.748797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.072 [2024-07-12 12:40:49.748821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.072 [2024-07-12 12:40:49.748836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.072 [2024-07-12 12:40:49.751130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.072 [2024-07-12 12:40:49.760374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.072 [2024-07-12 12:40:49.760737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.760821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.760846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.072 [2024-07-12 12:40:49.760862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.072 [2024-07-12 12:40:49.761053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.072 [2024-07-12 12:40:49.761206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.072 [2024-07-12 12:40:49.761229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.072 [2024-07-12 12:40:49.761244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.072 [2024-07-12 12:40:49.763386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.072 [2024-07-12 12:40:49.772616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.072 [2024-07-12 12:40:49.772881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.773003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.773028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.072 [2024-07-12 12:40:49.773044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.072 [2024-07-12 12:40:49.773211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.072 [2024-07-12 12:40:49.773396] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.072 [2024-07-12 12:40:49.773419] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.072 [2024-07-12 12:40:49.773433] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.072 [2024-07-12 12:40:49.775537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.072 [2024-07-12 12:40:49.784711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.072 [2024-07-12 12:40:49.785024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.785145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.072 [2024-07-12 12:40:49.785169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.072 [2024-07-12 12:40:49.785190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.072 [2024-07-12 12:40:49.785357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.072 [2024-07-12 12:40:49.785524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.072 [2024-07-12 12:40:49.785546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.072 [2024-07-12 12:40:49.785561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.072 [2024-07-12 12:40:49.787603] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.797122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.797356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.797476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.797503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.797519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.797637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.797807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.797846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.797862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.799767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.809594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.809809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.809925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.809951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.809967] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.810150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.810273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.810312] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.810327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.812544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.821879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.822100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.822196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.822222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.822239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.822378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.822548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.822571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.822609] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.824607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.834123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.834391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.834511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.834536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.834553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.834719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.834882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.834927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.834942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.836894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.846443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.846662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.846759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.846784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.846800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.846992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.847195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.847220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.847235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.849388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.858714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.859010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.859133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.859159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.859176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.859309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.859504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.859542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.859557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.861709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.871233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.871491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.871576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.871602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.871619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.871737] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.871859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.871891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.871906] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.873874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.883604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.883878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.883963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.883989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.884006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.884109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.884197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.884220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.884235] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.886375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.895882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.896096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.896214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.896240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.896257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.896407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.896593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.896620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.896636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.898750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.908306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.908564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.908687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.908712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.908729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.908888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.909026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.909049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.909064] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.911077] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.920657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.921005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.921099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.921123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.921139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.921289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.921474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.921497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.921512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.923573] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.933072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.933362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.933487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.933514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.933531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.933681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.933875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.933913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.073 [2024-07-12 12:40:49.933937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.073 [2024-07-12 12:40:49.936059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.073 [2024-07-12 12:40:49.945596] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.073 [2024-07-12 12:40:49.945875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.946022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.073 [2024-07-12 12:40:49.946049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.073 [2024-07-12 12:40:49.946066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.073 [2024-07-12 12:40:49.946217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.073 [2024-07-12 12:40:49.946400] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.073 [2024-07-12 12:40:49.946423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.074 [2024-07-12 12:40:49.946438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.074 [2024-07-12 12:40:49.948577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.074 [2024-07-12 12:40:49.957840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.074 [2024-07-12 12:40:49.958146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.074 [2024-07-12 12:40:49.958262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.074 [2024-07-12 12:40:49.958289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.074 [2024-07-12 12:40:49.958307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.074 [2024-07-12 12:40:49.958457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.074 [2024-07-12 12:40:49.958643] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.074 [2024-07-12 12:40:49.958666] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.074 [2024-07-12 12:40:49.958681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.074 [2024-07-12 12:40:49.960836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.074 [2024-07-12 12:40:49.970440] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.074 [2024-07-12 12:40:49.970703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.074 [2024-07-12 12:40:49.970821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.074 [2024-07-12 12:40:49.970847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.074 [2024-07-12 12:40:49.970863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.074 [2024-07-12 12:40:49.971038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.074 [2024-07-12 12:40:49.971239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.074 [2024-07-12 12:40:49.971262] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.074 [2024-07-12 12:40:49.971277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.074 [2024-07-12 12:40:49.973415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.074 [2024-07-12 12:40:49.982921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.074 [2024-07-12 12:40:49.983144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.074 [2024-07-12 12:40:49.983269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.074 [2024-07-12 12:40:49.983298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.074 [2024-07-12 12:40:49.983316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.074 [2024-07-12 12:40:49.983435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.074 [2024-07-12 12:40:49.983540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.074 [2024-07-12 12:40:49.983562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.074 [2024-07-12 12:40:49.983578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.074 [2024-07-12 12:40:49.985784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.332 [2024-07-12 12:40:49.995286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.332 [2024-07-12 12:40:49.995621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.332 [2024-07-12 12:40:49.995715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.332 [2024-07-12 12:40:49.995740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.332 [2024-07-12 12:40:49.995758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.332 [2024-07-12 12:40:49.995896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.332 [2024-07-12 12:40:49.996088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.332 [2024-07-12 12:40:49.996117] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.332 [2024-07-12 12:40:49.996138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.332 [2024-07-12 12:40:49.998165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.332 [2024-07-12 12:40:50.007671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.332 [2024-07-12 12:40:50.007998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.332 [2024-07-12 12:40:50.008121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.332 [2024-07-12 12:40:50.008155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.332 [2024-07-12 12:40:50.008171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.332 [2024-07-12 12:40:50.008322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.332 [2024-07-12 12:40:50.008522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.332 [2024-07-12 12:40:50.008544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.332 [2024-07-12 12:40:50.008559] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.332 [2024-07-12 12:40:50.010735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.332 [2024-07-12 12:40:50.020773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.332 [2024-07-12 12:40:50.021134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.332 [2024-07-12 12:40:50.021265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.332 [2024-07-12 12:40:50.021300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.332 [2024-07-12 12:40:50.021324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.332 [2024-07-12 12:40:50.021476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.021708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.021740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.021764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.024374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.034029] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.034382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.034496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.034533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.034558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.034712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.034940] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.034975] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.035001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.037724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.047013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.047360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.047506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.047541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.047565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.047776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.048014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.048048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.048074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.050688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.059855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.060171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.060297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.060333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.060357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.060533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.060707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.060741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.060765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.063325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.072896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.073209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.073328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.073367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.073393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.073601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.073775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.073807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.073829] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.076496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.086107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.086408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.086534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.086573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.086603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.086769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.086924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.086956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.086983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.089790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.098585] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.098920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.099032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.099059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.099076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.099243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.099399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.099424] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.099440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.101582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.111055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.111326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.111418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.111444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.111460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.111596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.111750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.111774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.111790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.114031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.123299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.123575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.123701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.123727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.123744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.123970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.124125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.124149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.124179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.126238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.135527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.135807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.135934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.135962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.135984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.136152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.136304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.333 [2024-07-12 12:40:50.136327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.333 [2024-07-12 12:40:50.136342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.333 [2024-07-12 12:40:50.138575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.333 [2024-07-12 12:40:50.147932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.333 [2024-07-12 12:40:50.148285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.148375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.333 [2024-07-12 12:40:50.148400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.333 [2024-07-12 12:40:50.148416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.333 [2024-07-12 12:40:50.148582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.333 [2024-07-12 12:40:50.148751] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.148774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.148789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.150860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.160296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.160563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.160654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.160680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.160697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.160815] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.160947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.160971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.160986] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.163029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.172549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.172839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.172940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.172966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.172982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.173138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.173276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.173300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.173315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.175414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.184704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.185030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.185159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.185184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.185200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.185318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.185503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.185525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.185540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.187691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.197028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.197341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.197487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.197514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.197531] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.197681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.197833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.197877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.197894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.199976] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.209425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.209665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.209762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.209789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.209806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.209965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.210172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.210196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.210210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.212400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.221758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.222031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.222132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.222158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.222174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.222373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.222543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.222565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.222579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.224825] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.234167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.234484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.234583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.234609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.234625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.234743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.234894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.234919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.234934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.237098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.334 [2024-07-12 12:40:50.246398] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.334 [2024-07-12 12:40:50.246655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.246752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.334 [2024-07-12 12:40:50.246778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.334 [2024-07-12 12:40:50.246795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.334 [2024-07-12 12:40:50.246925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.334 [2024-07-12 12:40:50.247114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.334 [2024-07-12 12:40:50.247157] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.334 [2024-07-12 12:40:50.247173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.334 [2024-07-12 12:40:50.249373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.593 [2024-07-12 12:40:50.258824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.593 [2024-07-12 12:40:50.259114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.593 [2024-07-12 12:40:50.259231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.593 [2024-07-12 12:40:50.259257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.593 [2024-07-12 12:40:50.259274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.593 [2024-07-12 12:40:50.259441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.593 [2024-07-12 12:40:50.259611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.593 [2024-07-12 12:40:50.259633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.593 [2024-07-12 12:40:50.259649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.593 [2024-07-12 12:40:50.261740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.593 [2024-07-12 12:40:50.271192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.593 [2024-07-12 12:40:50.271529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.593 [2024-07-12 12:40:50.271677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.593 [2024-07-12 12:40:50.271704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.593 [2024-07-12 12:40:50.271721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.593 [2024-07-12 12:40:50.271897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.593 [2024-07-12 12:40:50.272096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.593 [2024-07-12 12:40:50.272119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.593 [2024-07-12 12:40:50.272134] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.593 [2024-07-12 12:40:50.274206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.593 [2024-07-12 12:40:50.283403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.283690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.283836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.283862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.283891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.284026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.284194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.284231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.284252] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.286215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.295660] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.296004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.296105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.296132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.296148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.296315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.296510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.296532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.296548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.298665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.307804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.308071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.308225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.308251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.308268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.308435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.308617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.308639] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.308654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.310784] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.319949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.320316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.320416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.320443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.320460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.320641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.320818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.320840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.320883] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.322990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.332165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.332534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.332634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.332659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.332676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.332776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.332985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.333008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.333023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.335035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.344556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.344815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.344947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.344974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.344991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.345141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.345338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.345360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.345375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.347356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.356668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.356874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.357033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.357059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.357076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.357291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.357407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.357428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.357443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.359539] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.368929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.369227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.369321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.369347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.369364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.369514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.369650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.369687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.369702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.371652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.381370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.381652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.381739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.381764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.381780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 [2024-07-12 12:40:50.381939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 [2024-07-12 12:40:50.382110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.382134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.382149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 [2024-07-12 12:40:50.384175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.594 [2024-07-12 12:40:50.393620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.594 [2024-07-12 12:40:50.393910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.394036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.594 [2024-07-12 12:40:50.394062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.594 [2024-07-12 12:40:50.394079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.594 12:40:50 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:26:56.594 [2024-07-12 12:40:50.394231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.594 12:40:50 -- common/autotest_common.sh@852 -- # return 0 00:26:56.594 [2024-07-12 12:40:50.394399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.594 [2024-07-12 12:40:50.394423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.594 [2024-07-12 12:40:50.394438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.594 12:40:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:56.594 12:40:50 -- common/autotest_common.sh@718 -- # xtrace_disable 00:26:56.594 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.595 [2024-07-12 12:40:50.396380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 [2024-07-12 12:40:50.406042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.406292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.406424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.406450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.406466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.406632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.406828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.406850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.406889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 [2024-07-12 12:40:50.409040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 [2024-07-12 12:40:50.418334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.418651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.418805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.418832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.418849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.419023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.419193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.419215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.419230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 12:40:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:56.595 12:40:50 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:56.595 12:40:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:56.595 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.595 [2024-07-12 12:40:50.421494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 [2024-07-12 12:40:50.425840] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:56.595 [2024-07-12 12:40:50.430536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.430813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.430943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.430970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.430987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.431137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.431303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.431332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.431348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 12:40:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:56.595 12:40:50 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:56.595 12:40:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:56.595 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.595 [2024-07-12 12:40:50.433587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 [2024-07-12 12:40:50.442883] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.443172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.443304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.443331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.443347] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.443528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.443687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.443709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.443724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 [2024-07-12 12:40:50.445645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 [2024-07-12 12:40:50.455039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.455438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.455561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.455587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.455604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.455739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.455901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.455925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.455940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 [2024-07-12 12:40:50.458027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 [2024-07-12 12:40:50.467254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.467743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.467895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.467926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.467946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.468108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.468316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.468340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.468357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 [2024-07-12 12:40:50.470523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 Malloc0 00:26:56.595 12:40:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:56.595 12:40:50 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:56.595 12:40:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:56.595 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.595 [2024-07-12 12:40:50.479382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.479725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.479858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.479900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.479927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.480106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.480302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.480328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.480344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 12:40:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:56.595 12:40:50 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:56.595 12:40:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:56.595 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.595 [2024-07-12 12:40:50.482623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 12:40:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:56.595 12:40:50 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:56.595 12:40:50 -- common/autotest_common.sh@551 -- # xtrace_disable 00:26:56.595 12:40:50 -- common/autotest_common.sh@10 -- # set +x 00:26:56.595 [2024-07-12 12:40:50.491625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.595 [2024-07-12 12:40:50.491931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.492038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:56.595 [2024-07-12 12:40:50.492064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x138b400 with addr=10.0.0.2, port=4420 00:26:56.595 [2024-07-12 12:40:50.492081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x138b400 is same with the state(5) to be set 00:26:56.595 [2024-07-12 12:40:50.492248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x138b400 (9): Bad file descriptor 00:26:56.595 [2024-07-12 12:40:50.492432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:26:56.595 [2024-07-12 12:40:50.492455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:26:56.595 [2024-07-12 12:40:50.492471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:56.595 [2024-07-12 12:40:50.493318] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:56.595 [2024-07-12 12:40:50.494555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:56.595 12:40:50 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:26:56.595 12:40:50 -- host/bdevperf.sh@38 -- # wait 1385334 00:26:56.595 [2024-07-12 12:40:50.503933] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:56.853 [2024-07-12 12:40:50.580130] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:06.820 00:27:06.820 Latency(us) 00:27:06.820 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:06.820 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:06.820 Verification LBA range: start 0x0 length 0x4000 00:27:06.820 Nvme1n1 : 15.01 9360.30 36.56 15230.45 0.00 5190.43 776.72 195734.19 00:27:06.820 =================================================================================================================== 00:27:06.820 Total : 9360.30 36.56 15230.45 0.00 5190.43 776.72 195734.19 00:27:06.820 12:40:59 -- host/bdevperf.sh@39 -- # sync 00:27:06.820 12:40:59 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:06.820 12:40:59 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:06.820 12:40:59 -- common/autotest_common.sh@10 -- # set +x 00:27:06.820 12:40:59 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:06.820 12:40:59 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:06.820 12:40:59 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:06.820 12:40:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:06.820 12:40:59 -- nvmf/common.sh@116 -- # sync 00:27:06.820 12:40:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:06.820 12:40:59 -- nvmf/common.sh@119 -- # set +e 00:27:06.820 12:40:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:06.820 12:40:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:06.820 rmmod nvme_tcp 00:27:06.820 rmmod nvme_fabrics 00:27:06.820 rmmod nvme_keyring 00:27:06.820 12:40:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:06.820 12:40:59 -- nvmf/common.sh@123 -- # set -e 00:27:06.820 12:40:59 -- nvmf/common.sh@124 -- # return 0 00:27:06.820 12:40:59 -- nvmf/common.sh@477 -- # '[' -n 1386029 ']' 00:27:06.820 12:40:59 -- nvmf/common.sh@478 -- # killprocess 1386029 00:27:06.820 12:40:59 -- common/autotest_common.sh@926 -- # '[' -z 1386029 ']' 00:27:06.820 12:40:59 -- common/autotest_common.sh@930 -- # kill -0 1386029 00:27:06.820 12:40:59 -- common/autotest_common.sh@931 -- # uname 00:27:06.820 12:40:59 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:06.820 12:40:59 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1386029 00:27:06.820 12:40:59 -- common/autotest_common.sh@932 -- # process_name=reactor_1 00:27:06.820 12:40:59 -- common/autotest_common.sh@936 -- # '[' reactor_1 = sudo ']' 00:27:06.820 12:40:59 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1386029' 00:27:06.820 killing process with pid 1386029 00:27:06.820 12:40:59 -- common/autotest_common.sh@945 -- # kill 1386029 00:27:06.820 12:40:59 -- common/autotest_common.sh@950 -- # wait 1386029 00:27:06.820 12:40:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:06.820 12:40:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:06.820 12:40:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:06.820 12:40:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:06.820 12:40:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:06.820 12:40:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:06.820 12:40:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:06.820 12:40:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:07.754 12:41:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:07.754 00:27:07.754 real 0m23.217s 00:27:07.754 user 1m3.397s 00:27:07.754 sys 0m4.048s 00:27:07.754 12:41:01 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:07.754 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:27:07.754 ************************************ 00:27:07.754 END TEST nvmf_bdevperf 00:27:07.754 ************************************ 00:27:07.754 12:41:01 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:07.754 12:41:01 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:07.754 12:41:01 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:07.754 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:27:07.754 ************************************ 00:27:07.754 START TEST nvmf_target_disconnect 00:27:07.754 ************************************ 00:27:07.754 12:41:01 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:08.013 * Looking for test storage... 00:27:08.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:08.013 12:41:01 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:08.013 12:41:01 -- nvmf/common.sh@7 -- # uname -s 00:27:08.013 12:41:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:08.013 12:41:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:08.013 12:41:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:08.013 12:41:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:08.013 12:41:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:08.013 12:41:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:08.013 12:41:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:08.013 12:41:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:08.013 12:41:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:08.013 12:41:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:08.013 12:41:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:08.013 12:41:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:08.013 12:41:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:08.013 12:41:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:08.013 12:41:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:08.013 12:41:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:08.013 12:41:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:08.013 12:41:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:08.013 12:41:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:08.013 12:41:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.013 12:41:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.013 12:41:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.013 12:41:01 -- paths/export.sh@5 -- # export PATH 00:27:08.013 12:41:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:08.013 12:41:01 -- nvmf/common.sh@46 -- # : 0 00:27:08.013 12:41:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:08.013 12:41:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:08.013 12:41:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:08.013 12:41:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:08.013 12:41:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:08.013 12:41:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:08.013 12:41:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:08.013 12:41:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:08.013 12:41:01 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:08.013 12:41:01 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:08.013 12:41:01 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:08.013 12:41:01 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:08.013 12:41:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:08.013 12:41:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:08.013 12:41:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:08.013 12:41:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:08.013 12:41:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:08.013 12:41:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:08.013 12:41:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:08.013 12:41:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:08.013 12:41:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:08.013 12:41:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:08.013 12:41:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:08.013 12:41:01 -- common/autotest_common.sh@10 -- # set +x 00:27:09.914 12:41:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:09.914 12:41:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:09.914 12:41:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:09.914 12:41:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:09.914 12:41:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:09.914 12:41:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:09.914 12:41:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:09.914 12:41:03 -- nvmf/common.sh@294 -- # net_devs=() 00:27:09.914 12:41:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:09.914 12:41:03 -- nvmf/common.sh@295 -- # e810=() 00:27:09.914 12:41:03 -- nvmf/common.sh@295 -- # local -ga e810 00:27:09.914 12:41:03 -- nvmf/common.sh@296 -- # x722=() 00:27:09.914 12:41:03 -- nvmf/common.sh@296 -- # local -ga x722 00:27:09.914 12:41:03 -- nvmf/common.sh@297 -- # mlx=() 00:27:09.914 12:41:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:09.914 12:41:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:09.914 12:41:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:09.914 12:41:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:09.914 12:41:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:09.914 12:41:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:09.914 12:41:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:09.914 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:09.914 12:41:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:09.914 12:41:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:09.914 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:09.914 12:41:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:09.914 12:41:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:09.914 12:41:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:09.914 12:41:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:09.914 12:41:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:09.914 12:41:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:09.914 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:09.914 12:41:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:09.914 12:41:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:09.914 12:41:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:09.914 12:41:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:09.914 12:41:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:09.914 12:41:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:09.914 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:09.914 12:41:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:09.914 12:41:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:09.914 12:41:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:09.914 12:41:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:09.914 12:41:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:09.914 12:41:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:09.914 12:41:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:09.914 12:41:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:09.914 12:41:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:09.914 12:41:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:09.914 12:41:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:09.914 12:41:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:09.914 12:41:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:09.914 12:41:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:09.914 12:41:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:09.914 12:41:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:09.914 12:41:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:09.914 12:41:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:09.914 12:41:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:09.914 12:41:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:09.914 12:41:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:09.914 12:41:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:10.173 12:41:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:10.173 12:41:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:10.173 12:41:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:10.173 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:10.173 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:27:10.173 00:27:10.173 --- 10.0.0.2 ping statistics --- 00:27:10.173 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:10.173 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:27:10.173 12:41:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:10.173 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:10.173 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.190 ms 00:27:10.173 00:27:10.173 --- 10.0.0.1 ping statistics --- 00:27:10.173 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:10.173 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:27:10.173 12:41:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:10.173 12:41:03 -- nvmf/common.sh@410 -- # return 0 00:27:10.173 12:41:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:10.173 12:41:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:10.173 12:41:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:10.173 12:41:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:10.173 12:41:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:10.173 12:41:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:10.173 12:41:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:10.173 12:41:03 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:10.173 12:41:03 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:10.173 12:41:03 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:10.173 12:41:03 -- common/autotest_common.sh@10 -- # set +x 00:27:10.173 ************************************ 00:27:10.173 START TEST nvmf_target_disconnect_tc1 00:27:10.173 ************************************ 00:27:10.173 12:41:03 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc1 00:27:10.173 12:41:03 -- host/target_disconnect.sh@32 -- # set +e 00:27:10.173 12:41:03 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:10.173 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.173 [2024-07-12 12:41:03.974910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.173 [2024-07-12 12:41:03.975141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:10.173 [2024-07-12 12:41:03.975174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ea0920 with addr=10.0.0.2, port=4420 00:27:10.173 [2024-07-12 12:41:03.975208] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:10.173 [2024-07-12 12:41:03.975230] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:10.173 [2024-07-12 12:41:03.975246] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:10.173 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:10.174 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:10.174 Initializing NVMe Controllers 00:27:10.174 12:41:03 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:10.174 12:41:03 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:10.174 12:41:03 -- common/autotest_common.sh@1132 -- # [[ hxBET =~ e ]] 00:27:10.174 12:41:03 -- common/autotest_common.sh@1132 -- # return 0 00:27:10.174 12:41:03 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:10.174 12:41:03 -- host/target_disconnect.sh@41 -- # set -e 00:27:10.174 00:27:10.174 real 0m0.091s 00:27:10.174 user 0m0.032s 00:27:10.174 sys 0m0.058s 00:27:10.174 12:41:03 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:10.174 12:41:03 -- common/autotest_common.sh@10 -- # set +x 00:27:10.174 ************************************ 00:27:10.174 END TEST nvmf_target_disconnect_tc1 00:27:10.174 ************************************ 00:27:10.174 12:41:04 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:10.174 12:41:04 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:10.174 12:41:04 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:10.174 12:41:04 -- common/autotest_common.sh@10 -- # set +x 00:27:10.174 ************************************ 00:27:10.174 START TEST nvmf_target_disconnect_tc2 00:27:10.174 ************************************ 00:27:10.174 12:41:04 -- common/autotest_common.sh@1104 -- # nvmf_target_disconnect_tc2 00:27:10.174 12:41:04 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:10.174 12:41:04 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:10.174 12:41:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:10.174 12:41:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:10.174 12:41:04 -- common/autotest_common.sh@10 -- # set +x 00:27:10.174 12:41:04 -- nvmf/common.sh@469 -- # nvmfpid=1389225 00:27:10.174 12:41:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:10.174 12:41:04 -- nvmf/common.sh@470 -- # waitforlisten 1389225 00:27:10.174 12:41:04 -- common/autotest_common.sh@819 -- # '[' -z 1389225 ']' 00:27:10.174 12:41:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:10.174 12:41:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:10.174 12:41:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:10.174 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:10.174 12:41:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:10.174 12:41:04 -- common/autotest_common.sh@10 -- # set +x 00:27:10.174 [2024-07-12 12:41:04.058982] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:10.174 [2024-07-12 12:41:04.059059] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:10.174 EAL: No free 2048 kB hugepages reported on node 1 00:27:10.432 [2024-07-12 12:41:04.126849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:10.432 [2024-07-12 12:41:04.237083] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:10.432 [2024-07-12 12:41:04.237229] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:10.432 [2024-07-12 12:41:04.237247] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:10.432 [2024-07-12 12:41:04.237258] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:10.432 [2024-07-12 12:41:04.237346] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:10.432 [2024-07-12 12:41:04.237373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:10.432 [2024-07-12 12:41:04.237417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:10.432 [2024-07-12 12:41:04.237420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:11.366 12:41:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:11.366 12:41:05 -- common/autotest_common.sh@852 -- # return 0 00:27:11.366 12:41:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:11.366 12:41:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:11.366 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.366 12:41:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:11.366 12:41:05 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:11.367 12:41:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:11.367 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.367 Malloc0 00:27:11.367 12:41:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:11.367 12:41:05 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:11.367 12:41:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:11.367 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.367 [2024-07-12 12:41:05.051681] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:11.367 12:41:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:11.367 12:41:05 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:11.367 12:41:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:11.367 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.367 12:41:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:11.367 12:41:05 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:11.367 12:41:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:11.367 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.367 12:41:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:11.367 12:41:05 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:11.367 12:41:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:11.367 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.367 [2024-07-12 12:41:05.079950] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:11.367 12:41:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:11.367 12:41:05 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:11.367 12:41:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:11.367 12:41:05 -- common/autotest_common.sh@10 -- # set +x 00:27:11.367 12:41:05 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:11.367 12:41:05 -- host/target_disconnect.sh@50 -- # reconnectpid=1389382 00:27:11.367 12:41:05 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:11.367 12:41:05 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:11.367 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.273 12:41:07 -- host/target_disconnect.sh@53 -- # kill -9 1389225 00:27:13.273 12:41:07 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Write completed with error (sct=0, sc=8) 00:27:13.273 starting I/O failed 00:27:13.273 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 [2024-07-12 12:41:07.103047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 [2024-07-12 12:41:07.103367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 [2024-07-12 12:41:07.103695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Write completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.274 Read completed with error (sct=0, sc=8) 00:27:13.274 starting I/O failed 00:27:13.275 Write completed with error (sct=0, sc=8) 00:27:13.275 starting I/O failed 00:27:13.275 Write completed with error (sct=0, sc=8) 00:27:13.275 starting I/O failed 00:27:13.275 [2024-07-12 12:41:07.104053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:13.275 [2024-07-12 12:41:07.104179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.104333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.104363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.104562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.104723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.104766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.104910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.105134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.105425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.105686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.105830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.105972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.106242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.106510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.106811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.106964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.107092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.107342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.107591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.107845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.107988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.108070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.108284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.108551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.108815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.108934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.109055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.109315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.109599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.109878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.109998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.110113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.110260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.110286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.110404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.110501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.110527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.110615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.110725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.110751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.110880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.111128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.111390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.111677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.275 [2024-07-12 12:41:07.111803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.275 qpair failed and we were unable to recover it. 00:27:13.275 [2024-07-12 12:41:07.111906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.112111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.112344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.112649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.112879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.112967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.113229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.113453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.113671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.113840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.113944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.114149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.114395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.114627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.114824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.114944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.115057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.115352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.115614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.115879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.115992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.116106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.116344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.116597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.116889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.116979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.117124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.117317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.117551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.117789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.117906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.117991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.118283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.118574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.118774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.118895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.118983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.119100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.276 [2024-07-12 12:41:07.119131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.276 qpair failed and we were unable to recover it. 00:27:13.276 [2024-07-12 12:41:07.119286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.119502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.119544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.119644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.119789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.119831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.119928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.120209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.120481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.120697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.120833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.120947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.121184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.121451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.121710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.121893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.121990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.122234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.122462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.122688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.122824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.122934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.123181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.123416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.123683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.123794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.123965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.124207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.124449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.124652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.124912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.124999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.125112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.125382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.125602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.125771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.125888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.126148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.126420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.126676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.126812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.277 qpair failed and we were unable to recover it. 00:27:13.277 [2024-07-12 12:41:07.126959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.127076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.277 [2024-07-12 12:41:07.127101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.127200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.127350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.127375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.127506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.127669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.127695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.127818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.127948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.127975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.128062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.128338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.128561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.128858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.128980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.129165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.129418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.129680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.129877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.130009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.130349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.130575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.130819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.130934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.131046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.131269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.131473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.131712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.131889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.132008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.132270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.132491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.132722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.132878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.132989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.133142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.133178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.133297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.133438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.278 [2024-07-12 12:41:07.133463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.278 qpair failed and we were unable to recover it. 00:27:13.278 [2024-07-12 12:41:07.133581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.133722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.133747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.133908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.134188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.134407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.134606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.134805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.134957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.135075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.135331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.135606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.135837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.135981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.136116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.136369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.136633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.136860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.136968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.137057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.137297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.137551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.137791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.137932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.138028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.138295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.138517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.138739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.138889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.139004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.139252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.139532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.139771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.139890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.140007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.140269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.140491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.140746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.140856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.279 qpair failed and we were unable to recover it. 00:27:13.279 [2024-07-12 12:41:07.141004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.279 [2024-07-12 12:41:07.141148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.141177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.141335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.141419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.141446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.141590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.141704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.141729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.141900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.142187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.142496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.142746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.142893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.143009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.143249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.143467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.143737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.143924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.144052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.144306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.144540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.144814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.144930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.145016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.145311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.145571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.145841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.145996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.146076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.146259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.146457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.146711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.146826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.146953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.147234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.147481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.147680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.147818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.147964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.148213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.148476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.280 [2024-07-12 12:41:07.148767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.280 [2024-07-12 12:41:07.148933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.280 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.149016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.149156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.149181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.149298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.149387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.149414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.149550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.149717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.149758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.149882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.150163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.150424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.150702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.150814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.150937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.151220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.151535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.151798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.151927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.152078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.152335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.152562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.152791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.152937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.153120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.153243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.153269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.153386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.153531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.153556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.153651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.153794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.153820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.153941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.154189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.154405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.154686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.154790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.154887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.155171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.155452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.155709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.155842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.155994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.156230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.156486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.156783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.156916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.281 qpair failed and we were unable to recover it. 00:27:13.281 [2024-07-12 12:41:07.157025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.281 [2024-07-12 12:41:07.157140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.157284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.157508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.157761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.157914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.158033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.158278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.158504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.158752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.158882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.158994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.159251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.159508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.159731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.159924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.160067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.160306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.160530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.160815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.160937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.161076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.161296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.161596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.161883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.161988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.162108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.162377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.162621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.162747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.162847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.163156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.163418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.282 qpair failed and we were unable to recover it. 00:27:13.282 [2024-07-12 12:41:07.163671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.282 [2024-07-12 12:41:07.163812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.163942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.164195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.164420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.164653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.164847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.164996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.165194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.165503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.165854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.165981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.166074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.166184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.166209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.166353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.166491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.166516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.166609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.166719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.166744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.166861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.167138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.167406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.167681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.167826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.167917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.168234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.168515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.168780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.168921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.169040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.169255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.169466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.169774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.169927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.170095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.170342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.170637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.170828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.170991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.171083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.171203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.171228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.171319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.171438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.171464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.171607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.171726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.283 [2024-07-12 12:41:07.171751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.283 qpair failed and we were unable to recover it. 00:27:13.283 [2024-07-12 12:41:07.171830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.171978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.172122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.172321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.172544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.172829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.172992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.173128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.173264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.173293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.173393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.173525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.173550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.173636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.173759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.173785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.173930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.174228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.174524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.174849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.174964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.175127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.175370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.175676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.175802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.175970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.176308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.176581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.176883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.176995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.177186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.177488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.177775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.177887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.177997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.178272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.178619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.178815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.178955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.179068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.179192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.179219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.179361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.179497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.179522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.179614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.179703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.179730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.179903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.180024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.180052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.284 qpair failed and we were unable to recover it. 00:27:13.284 [2024-07-12 12:41:07.180195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.180344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.284 [2024-07-12 12:41:07.180368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.180486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.180600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.180626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.180808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.180929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.180955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.181072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.181319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.181577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.181849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.181975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.182091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.182353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.182586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.182810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.182970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.183159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.183451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.183708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.183823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.183943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.184199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.184536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.184788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.184959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.185094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.185338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.185628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.185809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.185943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.186187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.186416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.186646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.186793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.186937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.187138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.187403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.285 qpair failed and we were unable to recover it. 00:27:13.285 [2024-07-12 12:41:07.187701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.285 [2024-07-12 12:41:07.187875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.188020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.188294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.188514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.188809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.188986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.189078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.189208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.189239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.189384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.189473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.189511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.286 qpair failed and we were unable to recover it. 00:27:13.286 [2024-07-12 12:41:07.189654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.286 [2024-07-12 12:41:07.189795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.189837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.190000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.190231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.190486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.190792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.190928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.191014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.191098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.191123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.191263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.191381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.191409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.191529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.191649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.191676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.191849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.192123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.192400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.192704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.192845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.192978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.193274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.193541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.193743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.193949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.194070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.194231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.194260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.194424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.194537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.194562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.194709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.194825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.194850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.194941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.195254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.195511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.195823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.195965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.196078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.196160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.196189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.196302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.196409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.196437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.196566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.196716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.196744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.196879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.197197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.197475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.563 qpair failed and we were unable to recover it. 00:27:13.563 [2024-07-12 12:41:07.197766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.563 [2024-07-12 12:41:07.197934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.198025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.198269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.198529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.198788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.198922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.199044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.199180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.199207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.199350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.199463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.199488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.199656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.199748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.199774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.199888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.200145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.200400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.200660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.200809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.200961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.201162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.201437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.201716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.201894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.202014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.202293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.202543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.202794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.202944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.203028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.203307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.203566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.203778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.203954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.204097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.204224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.204249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.204338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.204477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.204520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.204651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.204815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.204840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.204971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.205206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.205488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.564 [2024-07-12 12:41:07.205759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.564 [2024-07-12 12:41:07.205912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.564 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.206042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.206184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.206209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.206346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.206438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.206465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.206607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.206722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.206747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.206886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.207245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.207530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.207760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.207895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.208019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.208169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.208195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.208329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.208488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.208517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.208666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.208764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.208793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.208913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.209179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.209432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.209714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.209912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.210069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.210338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.210556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.210765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.210932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.211084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.211238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.211263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.211373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.211522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.211549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.211656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.211767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.211791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.211887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.212216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.212491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.212764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.212909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.213029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.213310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.213520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.213800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.213971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.214116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.214259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.565 [2024-07-12 12:41:07.214283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.565 qpair failed and we were unable to recover it. 00:27:13.565 [2024-07-12 12:41:07.214397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.214517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.214541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.214658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.214738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.214762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.214911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.215128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.215388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.215733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.215838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.215990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.216210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.216445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.216757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.216906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.217025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.217348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.217604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.217831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.217964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.218184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.218465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.218749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.218888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.219029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.219259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.219528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.219823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.219973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.220077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.220186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.220210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.220347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.220517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.220542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.220667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.220776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.220801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.220950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.221217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.221479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.221768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.221929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.222043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.222208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.222235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.222403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.222522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.566 [2024-07-12 12:41:07.222546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.566 qpair failed and we were unable to recover it. 00:27:13.566 [2024-07-12 12:41:07.222712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.222803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.222831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.222956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.223217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.223430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.223699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.223846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.223960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.224235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.224517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.224737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.224883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.225025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.225115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.225168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.225292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.225449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.225474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.225619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.225727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.225752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.225885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.226211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.226460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.226718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.226824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.226953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.227209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.227464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.227716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.227873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.228019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.228309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.228571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.228816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.228953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.567 qpair failed and we were unable to recover it. 00:27:13.567 [2024-07-12 12:41:07.229120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.229233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.567 [2024-07-12 12:41:07.229260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.229419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.229545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.229570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.229689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.229828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.229869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.230015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.230287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.230519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.230744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.230910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.231053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.231284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.231587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.231799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.231940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.232063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.232214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.232239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.232374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.232535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.232563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.232702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.232790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.232816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.232933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.233195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.233446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.233796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.233925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.234011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.234246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.234567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.234784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.234949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.235061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.235331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.235570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.235883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.235988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.236153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.236420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.236636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.236802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.236959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.237109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.237135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.237284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.237373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.568 [2024-07-12 12:41:07.237402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.568 qpair failed and we were unable to recover it. 00:27:13.568 [2024-07-12 12:41:07.237521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.237641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.237667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.237785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.237881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.237907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.238025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.238286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.238542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.238834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.238979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.239097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.239406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.239650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.239795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.239910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.240207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.240550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.240824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.240984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.241073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.241198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.241224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.241366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.241508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.241533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.241664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.241761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.241789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.241927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.242152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.242415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.242780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.242907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.243024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.243163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.243191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.243309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.243449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.243476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.243626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.243778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.243822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.243942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.244199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.244501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.244771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.244949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.245038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.245147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.245175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.245309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.245436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.245463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.245556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.245673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.569 [2024-07-12 12:41:07.245705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.569 qpair failed and we were unable to recover it. 00:27:13.569 [2024-07-12 12:41:07.245901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.246183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.246438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.246649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.246804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.246932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.247132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.247411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.247705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.247823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.247985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.248208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.248435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.248713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.248916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.249036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.249330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.249573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.249841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.249983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.250090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.250311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.250569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.250813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.250971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.251079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.251237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.251265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.251431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.251544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.251569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.251672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.251777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.251805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.251906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.252165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.252472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.252760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.252923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.253083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.253207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.253232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.253399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.253550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.253578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.253740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.253883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.253910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.570 qpair failed and we were unable to recover it. 00:27:13.570 [2024-07-12 12:41:07.254005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.570 [2024-07-12 12:41:07.254113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.254137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.254251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.254343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.254385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.254530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.254695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.254722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.254841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.254993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.255132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.255405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.255736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.255902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.256066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.256194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.256222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.256341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.256504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.256529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.256664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.256780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.256805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.256962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.257226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.257513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.257815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.257946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.258046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.258137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.258170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.258338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.258424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.258449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.258601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.258729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.258757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.258883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.259175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.259522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.259785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.259945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.260049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.260191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.260217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.260345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.260498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.260523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.260674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.260760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.260788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.260939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.261021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.261046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.261132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.261242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.261270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.261384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.261535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.571 [2024-07-12 12:41:07.261563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.571 qpair failed and we were unable to recover it. 00:27:13.571 [2024-07-12 12:41:07.261701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.261788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.261814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.261927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.262180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.262464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.262771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.262936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.263025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.263180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.263209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.263375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.263522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.263564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.263697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.263855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.263887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.264046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.264194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.264222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.264368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.264486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.264512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.264626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.264748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.264776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.264895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.265184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.265465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.265700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.265819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.265985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.266250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.266545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.266798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.266986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.267069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.267187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.267212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.267357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.267469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.267496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.267662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.267804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.267830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.267983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.268246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.268504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.268811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.268957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.269074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.269216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.269244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.269380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.269497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.269523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.269622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.269754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.269782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.269908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.270012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.270040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.572 qpair failed and we were unable to recover it. 00:27:13.572 [2024-07-12 12:41:07.270181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.270303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.572 [2024-07-12 12:41:07.270328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.270443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.270531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.270557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.270670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.270777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.270802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.270919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.271197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.271485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.271769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.271893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.272006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.272243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.272537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.272872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.272975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.273109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.273434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.273705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.273898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.274024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.274306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.274571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.274826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.274969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.275092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.275185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.275210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.275294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.275435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.275463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.275582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.275690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.275715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.275849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.276187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.276407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.276691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.276807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.276969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.277209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.277459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.277702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.277811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.277934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.278043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.278068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.278155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.278280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.573 [2024-07-12 12:41:07.278305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.573 qpair failed and we were unable to recover it. 00:27:13.573 [2024-07-12 12:41:07.278462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.278579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.278607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.278717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.278833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.278859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.279003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.279364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.279594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.279851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.279975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.280113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.280404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.280687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.280847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.280984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.281208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.281518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.281860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.281989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.282197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.282407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.282652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.282806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.282937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.283200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.283444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.283640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.283753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.283900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.284179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.284374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.284706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.284901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.285067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.285320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.285526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.285822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.285994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.286021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.286140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.286232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.286256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.286369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.286485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.286511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.574 qpair failed and we were unable to recover it. 00:27:13.574 [2024-07-12 12:41:07.286646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.574 [2024-07-12 12:41:07.286742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.286770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.286875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.287181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.287480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.287731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.287892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.288020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.288112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.288157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.288248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.288366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.288409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.288551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.288694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.288720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.288889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.289171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.289427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.289678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.289820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.289941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.290240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.290494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.290814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.290928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.291018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.291328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.291629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.291906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.291998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.292141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.292384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.292696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.292808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.292949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.293175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.293398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.293679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.293830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.293921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.294030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.294056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.575 qpair failed and we were unable to recover it. 00:27:13.575 [2024-07-12 12:41:07.294149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.294227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.575 [2024-07-12 12:41:07.294269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.294424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.294556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.294583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.294709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.294835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.294863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.294983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.295201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.295481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.295710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.295881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.296057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.296335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.296559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.296783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.296957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.297119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.297238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.297262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.297429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.297569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.297595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.297715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.297840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.297874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.298005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.298138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.298167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.298292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.298384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.298410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.298544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.298686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.298714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.298893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.299206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.299463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.299699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.299888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.299996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.300275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.300540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.300787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.300958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.301108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.301258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.301299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.301444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.301583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.301612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.301776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.301889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.301916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.302028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.302156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.576 [2024-07-12 12:41:07.302185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.576 qpair failed and we were unable to recover it. 00:27:13.576 [2024-07-12 12:41:07.302303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.302397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.302426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.302585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.302733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.302760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.302883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.303192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.303522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.303769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.303932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.304076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.304196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.304222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.304370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.304534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.304563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.304658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.304784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.304814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.304960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.305175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.305445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.305723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.305894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.305996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.306250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.306522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.306806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.306963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.307083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.307175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.307204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.307336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.307485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.307511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.307655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.307814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.307840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.307983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.308241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.308538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.308812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.308973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.309078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.309208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.309236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.309360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.309452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.309481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.309621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.309761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.309787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.309929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.310286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.310583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.577 qpair failed and we were unable to recover it. 00:27:13.577 [2024-07-12 12:41:07.310873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.577 [2024-07-12 12:41:07.310991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.311124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.311278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.311306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.311446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.311587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.311614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.311746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.311852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.311889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.312003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.312224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.312409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.312664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.312829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.312984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.313245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.313504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.313770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.313933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.314047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.314320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.314635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.314862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.314974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.315102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.315386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.315725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.315905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.316033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.316150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.316178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.316311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.316455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.316481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.316596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.316728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.316756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.316915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.317227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.317517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.317773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.317927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.318046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.318187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.318215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.318387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.318509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.318535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.318659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.318774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.318800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.318941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.319063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.319091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.319221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.319375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.319402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.578 qpair failed and we were unable to recover it. 00:27:13.578 [2024-07-12 12:41:07.319533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.578 [2024-07-12 12:41:07.319662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.319690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.319803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.319915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.319941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.320026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.320246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.320527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.320811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.320964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.321061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.321180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.321207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.321348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.321476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.321504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.321636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.321763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.321792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.321952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.322211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.322541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.322802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.322945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.323054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.323350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.323568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.323859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.323989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.324175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.324483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.324768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.324949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.325107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.325236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.325265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.325391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.325475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.325501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.325622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.325751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.325778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.325935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.326193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.326413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.326655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.326822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.326990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.327282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.327558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.327816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.579 [2024-07-12 12:41:07.327984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.579 qpair failed and we were unable to recover it. 00:27:13.579 [2024-07-12 12:41:07.328086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.328244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.328270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.328389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.328511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.328537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.328629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.328717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.328741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.328876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.329154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.329468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.329755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.329902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.330080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.330339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.330567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.330824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.330991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.331109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.331223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.331247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.331376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.331476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.331520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.331635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.331767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.331795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.331921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.332162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.332411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.332700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.332863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.332989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.333266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.333518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.333758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.333944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.334066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.334341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.334586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.334871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.334991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.580 qpair failed and we were unable to recover it. 00:27:13.580 [2024-07-12 12:41:07.335091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.580 [2024-07-12 12:41:07.335199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.335225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.335319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.335426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.335455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.335595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.335734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.335760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.335913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.336254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.336470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.336750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.336936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.337093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.337190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.337218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.337357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.337479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.337504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.337669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.337793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.337823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.337970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.338225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.338513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.338741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.338939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.339070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.339198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.339225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.339350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.339477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.339505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.339676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.339785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.339811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.339973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.340206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.340448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.340683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.340828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.340936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.341146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.341374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.341600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.341767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.341907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.342151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.342429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.342711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.342853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.343044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.343173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.343201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.581 [2024-07-12 12:41:07.343308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.343433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.581 [2024-07-12 12:41:07.343461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.581 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.343588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.343721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.343749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.343896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.344167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.344493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.344713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.344846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.344984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.345249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.345529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.345760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.345905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.346015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.346133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.346158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.346310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.346466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.346493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.346624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.346745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.346774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.346913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.347139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.347414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.347683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.347828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.347992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.348264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.348566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.348871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.348999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.349194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.349457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.349699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.349882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.349994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.350144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.350187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.350340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.350428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.350456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.350616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.350761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.350804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.350935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.351026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.351056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.582 [2024-07-12 12:41:07.351194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.351350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.582 [2024-07-12 12:41:07.351378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.582 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.351483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.351607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.351635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.351794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.351915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.351940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.352051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.352310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.352586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.352848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.352989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.353100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.353431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.353684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.353799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.353924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.354145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.354399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.354653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.354808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.354946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.355178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.355372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.355603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.355827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.355938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.356025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.356243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.356496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.356747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.356930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.357042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.357357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.357577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.357840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.357987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.358166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.358420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.358674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.358824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.358915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.359003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.583 [2024-07-12 12:41:07.359029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.583 qpair failed and we were unable to recover it. 00:27:13.583 [2024-07-12 12:41:07.359149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.359445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.359651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.359880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.359991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.360071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.360276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.360551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.360894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.360995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.361113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.361364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.361616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.361845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.361994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.362082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.362301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.362536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.362796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.362907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.363019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.363214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.363468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.363685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.363847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.364023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.364260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.364491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.364780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.364956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.365073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.365183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.365208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.584 [2024-07-12 12:41:07.365292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.365410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.584 [2024-07-12 12:41:07.365436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.584 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.365529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.365611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.365637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.365732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.365818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.365845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.365941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.366174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.366397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.366683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.366830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.366977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.367288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.367532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.367788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.367926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.368042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.368275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.368539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.368738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.368854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.368956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.369222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.369502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.369733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.369925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.370017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.370258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.370485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.370715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.370858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.370959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.371181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.371408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.371678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.371849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.371973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.372233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.372444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.372672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.585 qpair failed and we were unable to recover it. 00:27:13.585 [2024-07-12 12:41:07.372878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.585 [2024-07-12 12:41:07.372969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.372994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.373089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.373319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.373576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.373814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.373986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.374114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.374396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.374635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.374892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.374997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.375168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.375482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.375706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.375858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.375984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.376253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.376477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.376705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.376856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.376945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.377191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.377476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.377761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.377916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.378036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.378238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.378520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.378780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.586 [2024-07-12 12:41:07.378946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.586 qpair failed and we were unable to recover it. 00:27:13.586 [2024-07-12 12:41:07.379062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.379274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.379532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.379790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.379910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.380002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.380198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.380444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.380705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.380912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.380997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.381150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.381380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.381607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.381831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.381984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.382076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.382324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.382749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.382899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.383010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.383240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.383465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.383713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.383902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.383995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.384218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.384419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.587 qpair failed and we were unable to recover it. 00:27:13.587 [2024-07-12 12:41:07.384705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.587 [2024-07-12 12:41:07.384823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.384848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.384999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.385248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.385571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.385768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.385880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.385997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.386281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.386510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.386737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.386928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.387045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.387272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.387506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.387708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.387848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.387939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.388131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.388384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.388640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.388803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.388910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.389128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.389377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.389685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.389838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.389965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.390043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.390068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.390184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.390305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.588 [2024-07-12 12:41:07.390330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.588 qpair failed and we were unable to recover it. 00:27:13.588 [2024-07-12 12:41:07.390419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.390499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.390524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.390602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.390728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.390753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.390873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.390957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.390982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.391075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.391390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.391624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.391821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.391940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.392077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.392332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.392565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.392793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.392972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.393096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.393385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.393642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.393896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.393996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.394161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.394439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.394686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.394815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.394944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.395167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.395416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.395679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.395855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.395968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.396211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.396481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.396715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.396861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.589 qpair failed and we were unable to recover it. 00:27:13.589 [2024-07-12 12:41:07.396995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.589 [2024-07-12 12:41:07.397107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.397220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.397468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.397742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.397883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.398024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.398257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.398458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.398651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.398794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.398897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.399188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.399413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.399667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.399897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.399998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.400165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.400356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.400633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.400893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.400976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.401094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.401327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.401584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.401806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.401918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.402001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.402188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.402417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.402671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.402895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.402988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.403164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.403420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.403618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.403880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.403974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.404000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.590 qpair failed and we were unable to recover it. 00:27:13.590 [2024-07-12 12:41:07.404081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.404225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.590 [2024-07-12 12:41:07.404251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.404335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.404411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.404436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.404532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.404616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.404642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.404782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.404897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.404923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.405069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.405264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.405499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.405722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.405862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.405981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.406266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.406491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.406730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.406860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.407030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.407269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.407529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.407744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.407920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.408020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.408225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.408444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.408699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.408815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.408944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.409140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.409387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.409640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.409804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.409917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.410004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.410030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.591 qpair failed and we were unable to recover it. 00:27:13.591 [2024-07-12 12:41:07.410122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.591 [2024-07-12 12:41:07.410230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.410364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.410594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.410841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.410982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.411073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.411307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.411564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.411763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.411902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.411998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.412230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.412515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.412724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.412895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.413008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.413269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.413502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.413734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.413845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.413965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.414220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.414442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.414701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.414819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.414941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.415195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.415497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.415757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.415902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.415988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.416242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.416508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.416766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.416909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.417005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.417085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.417111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.417225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.417365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.417389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.592 qpair failed and we were unable to recover it. 00:27:13.592 [2024-07-12 12:41:07.417502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.592 [2024-07-12 12:41:07.417587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.417614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.417718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.417829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.417855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.417980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.418201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.418493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.418748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.418944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.419049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.419313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.419513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.419772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.419917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.420013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.420251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.420534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.420845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.420998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.421120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.421346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.421569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.421827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.421978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.422061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.422325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.422589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.422815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.422954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.423043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.423299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.423530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.423778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.423923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.424008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.424246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.424435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.424642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.593 [2024-07-12 12:41:07.424871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.424982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.593 [2024-07-12 12:41:07.425007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.593 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.425095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.425303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.425577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.425839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.425963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.426048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.426301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.426523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.426747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.426891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.426973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.427212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.427425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.427673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.427814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.427905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.428173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.428430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.428684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.428850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.429000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.429229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.429483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.429692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.429804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.429921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.430140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.430383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.430617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.430769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.430898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.431152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.431378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.431597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.431848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.431986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.432028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.432142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.432265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.432291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.594 qpair failed and we were unable to recover it. 00:27:13.594 [2024-07-12 12:41:07.432382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.594 [2024-07-12 12:41:07.432500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.432526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.432608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.432686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.432712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.432809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.432924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.432951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.433075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.433290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.433536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.433765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.433875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.433956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.434229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.434422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.434677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.434831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.434951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.435238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.435470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.435665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.435806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.435920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.436148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.436374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.436608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.436837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.436984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.437066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.437290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.437552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.437765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.437928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.438063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.438146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.438171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.438279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.438397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.438423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.595 qpair failed and we were unable to recover it. 00:27:13.595 [2024-07-12 12:41:07.438514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.438608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.595 [2024-07-12 12:41:07.438634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.438769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.438883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.438910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.439024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.439263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.439522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.439782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.439917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.440005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.440254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.440519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.440774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.440890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.440971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.441265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.441493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.441750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.441855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.441973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.442231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.442497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.442757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.442907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.443002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.443287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.443486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.443738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.443909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.444001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.444279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.444485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.444733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.444890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.445050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.445309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.445540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.445747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.445919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.446032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.446148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.446174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.596 qpair failed and we were unable to recover it. 00:27:13.596 [2024-07-12 12:41:07.446266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.596 [2024-07-12 12:41:07.446348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.446375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.446491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.446605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.446632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.446723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.446818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.446843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.446971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.447204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.447394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.447615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.447795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.447892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.448145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.448355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.448651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.448769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.448899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.449127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.449360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.449602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.449837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.449986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.450071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.450347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.450609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.450841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.450988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.451103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.451306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.451606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.451844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.451995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.452139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.452402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.452648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.452887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.452975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.453093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.453332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.453556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.597 [2024-07-12 12:41:07.453700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.597 qpair failed and we were unable to recover it. 00:27:13.597 [2024-07-12 12:41:07.453793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.453909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.453936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.454016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.454240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.454500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.454724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.454857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.455000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.455283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.455547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.455837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.455987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.456077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.456311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.456529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.456755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.456877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.456999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.457234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.457440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.457663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.457854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.457976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.458194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.458424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.458707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.458825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.458920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.459146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.459368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.459591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.459848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.459997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.460145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.460269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.460310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.460445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.460589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.460619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.460785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.460902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.460946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.461061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.461161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.461191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.598 qpair failed and we were unable to recover it. 00:27:13.598 [2024-07-12 12:41:07.461345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.598 [2024-07-12 12:41:07.461465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.461507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.461624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.461743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.461769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.461850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.461973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.462099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.462332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.462590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.462894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.462985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.463133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.463366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.463611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.463734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.463834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.464013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.464046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.599 [2024-07-12 12:41:07.464152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.464293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.599 [2024-07-12 12:41:07.464321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.599 qpair failed and we were unable to recover it. 00:27:13.882 [2024-07-12 12:41:07.464461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.882 [2024-07-12 12:41:07.464557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.882 [2024-07-12 12:41:07.464588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.882 qpair failed and we were unable to recover it. 00:27:13.882 [2024-07-12 12:41:07.464695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.882 [2024-07-12 12:41:07.464799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.882 [2024-07-12 12:41:07.464842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.465223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.465453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.465718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.465889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.466006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.466311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.466573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.466857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.466998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.467188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.467493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.467779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.467944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.468074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.468212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.468248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.468385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.468523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.468559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.468695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.468804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.468841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.469112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.469232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.469261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.469366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.469493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.469522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.469652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.469784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.469819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.469981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.470250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.470538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.470830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.470978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.471138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.471421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.471666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.471794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.471923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.472161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.472390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.472588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.472873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.472974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.473001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.883 [2024-07-12 12:41:07.473080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.473197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.883 [2024-07-12 12:41:07.473222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.883 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.473338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.473422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.473447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.473560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.473697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.473723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.473827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.473957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.473984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.474102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.474222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.474248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.474395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.474516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.474544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.474637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.474740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.474769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.474931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.475194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.475401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.475676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.475825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.475945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.476229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.476466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.476754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.476921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.477037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.477294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.477528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.477808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.477960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.478088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.478344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.478577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.478798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.478911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.479033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.479263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.479488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.479763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.479951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.480090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.480205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.480230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.480324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.480435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.480460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.480577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.480722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.480750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.480883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.481001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.481029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.884 qpair failed and we were unable to recover it. 00:27:13.884 [2024-07-12 12:41:07.481139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.884 [2024-07-12 12:41:07.481216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.481359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.481569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.481810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.481992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.482112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.482338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.482554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.482818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.482980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.483119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.483341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.483596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.483832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.483989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.484132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.484393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.484595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.484844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.484973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.485062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.485199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.485224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.485341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.485455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.485482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.485626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.485717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.485743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.485881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.486178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.486397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.486621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.486848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.486974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.487118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.487388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.487620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.487847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.487989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.488071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.488169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.488194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.488304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.488447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.488472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.488589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.488701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.885 [2024-07-12 12:41:07.488727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.885 qpair failed and we were unable to recover it. 00:27:13.885 [2024-07-12 12:41:07.488818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.488933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.488960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.489047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.489298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.489555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.489786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.489934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.490025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.490264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.490514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.490743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.490890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.490987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.491236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.491470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.491719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.491833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.491949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.492140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.492343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.492637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.492773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.492901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.493181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.493434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.493692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.493860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.494019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.494244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.494470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.494783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.494909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.495053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.495283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.495518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.495768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.495904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.496002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.496119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.496145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.886 qpair failed and we were unable to recover it. 00:27:13.886 [2024-07-12 12:41:07.496233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.886 [2024-07-12 12:41:07.496324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.496350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.496438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.496526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.496552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.496644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.496762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.496788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.496924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.497164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.497362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.497609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.497836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.497955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.498068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.498354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.498613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.498830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.498950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.499066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.499337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.499615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.499827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.499966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.500108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.500356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.500560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.500785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.500916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.501072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.501325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.501584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.501834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.501984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.502076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.502154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.887 [2024-07-12 12:41:07.502179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.887 qpair failed and we were unable to recover it. 00:27:13.887 [2024-07-12 12:41:07.502264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.502347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.502373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.502514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.502604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.502630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.502709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.502782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.502807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.502922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.503229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.503477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.503735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.503844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.503955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.504221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.504457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.504698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.504823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.504949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.505237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.505578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.505830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.505988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.506101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.506415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.506652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.506882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.506992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.507119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.507235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.507262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.507384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.507498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.507523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.507610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.507709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.507738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.507843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.508167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.508450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.508678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.508910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.508996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.509122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.509393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.509731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.888 [2024-07-12 12:41:07.509880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.888 qpair failed and we were unable to recover it. 00:27:13.888 [2024-07-12 12:41:07.509970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.510200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.510510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.510797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.510924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.511012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.511283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.511539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.511789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.511994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.512169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.512455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.512710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.512829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.512955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.513178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.513392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.513779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.513912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.514021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.514263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.514545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.514815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.514980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.515072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.515343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.515557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.515843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.515966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.516158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.516432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.516634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.516798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.516901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.517280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.517552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.517823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.517986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.889 [2024-07-12 12:41:07.518112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.518281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.889 [2024-07-12 12:41:07.518308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.889 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.518452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.518587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.518616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.518729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.518875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.518921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.519008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.519123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.519165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.519292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.519423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.519452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.519609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.519734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.519763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.519909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.520162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.520424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.520690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.520854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.521015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.521164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.521191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.521334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.521471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.521500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.521624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.521751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.521782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.521932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.522190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.522425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.522649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.522805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.522933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.523197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.523533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.523811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.523965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.524053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.524255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.524455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.524773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.524934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.525026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.525302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.525542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.525800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.525942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.526074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.526207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.526234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.526351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.526492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.526518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.890 qpair failed and we were unable to recover it. 00:27:13.890 [2024-07-12 12:41:07.526677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.890 [2024-07-12 12:41:07.526797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.526824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.526965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.527220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.527508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.527763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.527922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.528050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.528319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.528612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.528871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.528999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.529185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.529525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.529844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.529994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.530105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.530269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.530311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.530431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.530558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.530587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.530730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.530843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.530876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.530997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.531119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.531144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.531300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.531419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.531445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.531585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.531740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.531768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.531875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.532161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.532404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.532626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.532810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.532909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.533008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.891 [2024-07-12 12:41:07.533037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.891 qpair failed and we were unable to recover it. 00:27:13.891 [2024-07-12 12:41:07.533148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.533258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.533285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.533434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.533569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.533598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.533727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.533822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.533851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.534028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.534304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.534558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.534834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.534978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.535103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.535249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.535278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.535416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.535536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.535562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.535712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.535830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.535856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.536013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.536159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.536188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.536289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.536427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.536453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.536545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.536665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.536693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.536839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.537175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.537487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.537787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.537967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.538085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.538242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.538270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.538472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.538557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.538586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.538786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.538901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.538942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.539139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.539265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.539315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.539437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.539595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.539635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.539723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.539878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.539917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.540116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.540287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.540313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.540433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.540521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.540547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.540688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.540817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.540846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.540979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.541263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.541552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.541839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.541981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.542010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.892 qpair failed and we were unable to recover it. 00:27:13.892 [2024-07-12 12:41:07.542104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.892 [2024-07-12 12:41:07.542290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.542317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.542458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.542594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.542624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.542756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.542879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.542917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.543011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.543201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.543228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.543319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.543473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.543503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.543630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.543758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.543786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.543985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.544102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.544153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.544317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.544440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.544470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.544598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.544727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.544756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.544911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.545050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.545076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.545217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.545361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.545403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.545559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.545715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.545745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.545898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.546242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.546490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.546692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.546914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.547108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.547211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.547242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.547352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.547481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.547511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.547620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.547759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.547788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.547935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.548258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.548487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.548755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.548916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.549085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.549182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.549212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.549401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.549489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.549515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.549634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.549753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.549781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.549933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.550192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.550574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.550832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.550998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.893 [2024-07-12 12:41:07.551029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.893 qpair failed and we were unable to recover it. 00:27:13.893 [2024-07-12 12:41:07.551145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.551254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.551280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.551413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.551538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.551566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.551697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.551799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.551828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.551937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.552211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.552443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.552705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.552837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.552972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.553277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.553481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.553759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.553934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.554085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.554212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.554242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.554351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.554470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.554497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.554624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.554755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.554784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.554879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.555142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.555436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.555749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.555947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.556063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.556153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.556180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.556294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.556452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.556482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.556585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.556731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.556757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.556892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.557208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.557484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.557764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.557888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.558008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.558291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.558551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.894 [2024-07-12 12:41:07.558803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.894 [2024-07-12 12:41:07.558951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.894 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.559097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.559231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.559261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.559389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.559485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.559529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.559641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.559778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.559804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.559917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.560194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.560495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.560816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.560980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.561110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.561305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.561332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.561494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.561658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.561687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.561842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.561984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.562166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.562512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.562774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.562944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.563081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.563197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.563223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.563344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.563484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.563514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.563674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.563829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.563858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.564011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.564149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.564180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.564307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.564432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.564462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.564588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.564713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.564755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.564907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.565217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.565524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.565818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.565984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.566092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.566221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.566249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.566384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.566473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.566502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.566599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.566759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.566790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.566957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.567290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.567545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.895 [2024-07-12 12:41:07.567778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.895 [2024-07-12 12:41:07.567952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.895 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.568140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.568260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.568287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.568379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.568494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.568521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.568634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.568740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.568769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.568894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.569126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.569426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.569733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.569918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.570056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.570201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.570228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.570403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.570538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.570567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.570732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.570852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.570888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.571067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.571324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.571548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.571802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.571973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.572160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.572447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.572744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.572911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.573025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.573285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.573542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.573795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.573961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.896 [2024-07-12 12:41:07.574078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.574207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.896 [2024-07-12 12:41:07.574233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.896 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.574377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.574535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.574562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.574647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.574780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.574810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.574962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.575216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.575478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.575769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.575926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.576021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.576241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.576462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.576759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.576915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.577050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.577277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.577497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.577766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.577926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.578067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.578368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.578624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.578850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.578983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.579123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.579460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.579747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.579877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.580006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.580276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.580548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.580831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.580998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.581136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.581284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.581311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.581421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.581576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.581605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.581749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.581862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.581905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.582018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.582152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.582179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.897 [2024-07-12 12:41:07.582304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.582443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.897 [2024-07-12 12:41:07.582472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.897 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.582604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.582730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.582759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.582922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.583218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.583480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.583717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.583829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.583949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.584036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.584062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.584216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.584383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.584413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.584538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.584695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.584737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.584852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.585158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.585490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.585836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.585990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.586220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.586483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.586745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.586946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.587036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.587295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.587559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.587802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.587991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.588134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.588414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.588676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.588823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.588922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.589179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.589460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.589751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.589863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.589957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.590070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.590116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.898 qpair failed and we were unable to recover it. 00:27:13.898 [2024-07-12 12:41:07.590217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.898 [2024-07-12 12:41:07.590310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.590341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.590497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.590673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.590699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.590819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.590934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.590962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.591081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.591219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.591249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.591346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.591486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.591512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.591631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.591798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.591828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.591977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.592263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.592532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.592804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.592978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.593100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.593241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.593268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.593412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.593509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.593542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.593672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.593848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.593881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.594002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.594275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.594563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.594835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.594976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.595136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.595441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.595738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.595916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.596002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.596215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.596485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.596758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.596956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.597071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.597218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.597245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.597363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.597522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.597551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.597657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.597771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.597797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.597941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.598199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.598490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.899 [2024-07-12 12:41:07.598812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.899 [2024-07-12 12:41:07.598930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.899 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.599065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.599199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.599228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.599392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.599541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.599570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.599728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.599892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.599923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.600053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.600174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.600202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.600332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.600456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.600487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.600629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.600718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.600744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.600861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.601199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.601482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.601769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.601932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.602070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.602192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.602223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.602390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.602601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.602630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.602761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.602913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.602943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.603100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.603230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.603260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.603415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.603508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.603539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.603649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.603788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.603814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.603956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.604197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.604424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.604755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.604903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.605053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.605208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.605234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.605382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.605497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.605524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.605653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.605777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.605804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.605906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.606021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.606048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.900 qpair failed and we were unable to recover it. 00:27:13.900 [2024-07-12 12:41:07.606141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.900 [2024-07-12 12:41:07.606259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.606286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.606378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.606488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.606515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.606623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.606746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.606774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.606862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.606978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.607148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.607376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.607619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.607848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.607970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.608059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.608318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.608538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.608802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.608937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.609044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.609262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.609507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.609733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.609904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.610038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.610316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.610540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.610835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.610990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.611133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.611371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.611571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.611784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.611953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.612039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.612294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.612524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.612729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.612840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.612970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.613056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.613083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.613248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.613374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.613403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.901 qpair failed and we were unable to recover it. 00:27:13.901 [2024-07-12 12:41:07.613530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.901 [2024-07-12 12:41:07.613627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.613656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.613766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.613878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.613905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.614016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.614309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.614559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.614805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.614981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.615071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.615272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.615591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.615858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.615987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.616077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.616325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.616562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.616775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.616919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.617063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.617266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.617491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.617718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.617852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.617974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.618233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.618434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.618767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.618908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.618999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.619223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.619447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.619759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.619884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.620007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.620212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.620436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.620698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.902 qpair failed and we were unable to recover it. 00:27:13.902 [2024-07-12 12:41:07.620902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.620987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.902 [2024-07-12 12:41:07.621015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.621126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.621348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.621568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.621828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.621963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.622090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.622344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.622580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.622856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.622977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.623089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.623309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.623541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.623827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.623981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.624083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.624179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.624205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.624291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.624411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.624438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.624550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.624676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.624703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.624845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.625135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.625403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.625722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.625838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.625965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.626223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.626431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.626722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.626832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.626927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.627164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.627417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.627668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.627786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.627910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.628022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.628049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.628159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.628254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.628281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.628409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.628502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.903 [2024-07-12 12:41:07.628529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.903 qpair failed and we were unable to recover it. 00:27:13.903 [2024-07-12 12:41:07.628657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.628741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.628767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.628910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.629146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.629377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.629671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.629900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.629982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.630153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.630416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.630683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.630831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.630959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.631242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.631527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.631780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.631921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.632036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.632376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.632629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.632906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.632990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.633104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.633392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.633654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.633890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.633983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.634103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.634339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.634544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.634793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.634913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.635031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.635318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.635551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.635774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.635917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.904 qpair failed and we were unable to recover it. 00:27:13.904 [2024-07-12 12:41:07.636031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.636151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.904 [2024-07-12 12:41:07.636181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.636339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.636458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.636487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.636613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.636740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.636769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.636891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.637120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.637319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.637560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.637838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.637996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.638117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.638257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.638284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.638396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.638480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.638507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.905 qpair failed and we were unable to recover it. 00:27:13.905 [2024-07-12 12:41:07.638599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.905 [2024-07-12 12:41:07.638682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.638708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.638824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.638942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.638969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.639054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.639311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.639573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.639889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.639982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.640127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.640345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.640602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.640862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.640988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.641129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.641336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.641572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.641842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.641995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.642142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.642387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.642615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.642837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.642962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.643102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.643236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.643262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.643379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.643532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.643558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.643682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.643769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.643796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.643978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.644270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.644468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.644669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.644901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.644992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.645135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.645364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.645594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.645819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.645941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.646057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.646176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.906 [2024-07-12 12:41:07.646202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.906 qpair failed and we were unable to recover it. 00:27:13.906 [2024-07-12 12:41:07.646320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.646434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.646476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.646624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.646736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.646762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.646847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.646970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.646997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.647109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.647342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.647601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.647837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.647991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.648133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.648399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.648605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.648886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.648974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.649085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.649316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.649532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.649803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.649967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.650060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.650310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.650568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.650796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.650938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.651061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.651299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.651515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.651719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.651843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.651941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.652188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.652413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.652633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.652877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.652985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.653109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.653339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.907 [2024-07-12 12:41:07.653593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.907 [2024-07-12 12:41:07.653740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.907 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.653851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.653973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.653999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.654084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.654341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.654613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.654879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.654990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.655108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.655343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.655576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.655817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.655974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.656110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.656348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.656543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.656827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.656937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.657054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.657308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.657592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.657829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.657957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.658082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.658177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.658206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.658347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.658475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.658503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.658639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.658758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.658784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.658901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.659169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.659407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.659658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.659800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.659910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.660219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.660475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.660730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.660844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.660962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.661099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.661127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.661221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.661391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.661418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.908 qpair failed and we were unable to recover it. 00:27:13.908 [2024-07-12 12:41:07.661511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.908 [2024-07-12 12:41:07.661640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.661666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.661785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.661875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.661902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.662037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.662293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.662579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.662843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.662994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.663168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.663257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.663285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.663413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.663543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.663572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.663712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.663803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.663829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.663975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.664240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.664495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.664756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.664955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.665069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.665210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.665236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.665368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.665462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.665490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.665657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.665798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.665824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.665998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.666265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.666500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.666700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.666888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.666989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.667266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.667467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.667726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.667845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.668003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.668122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.668149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.668298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.668393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.668419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.909 qpair failed and we were unable to recover it. 00:27:13.909 [2024-07-12 12:41:07.668583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.909 [2024-07-12 12:41:07.668713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.668741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.668863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.669220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.669499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.669772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.669937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.670080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.670236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.670264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.670433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.670568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.670596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.670693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.670798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.670823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.670957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.671247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.671558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.671818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.671963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.672102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.672376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.672646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.672897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.672984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.673129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.673428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.673722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.673844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.673966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.674176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.674415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.674717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.674877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.675013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.675294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.675543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.675796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.675961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.676101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.676337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.676597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.910 [2024-07-12 12:41:07.676900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.676996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.910 [2024-07-12 12:41:07.677039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.910 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.677156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.677303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.677330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.677423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.677584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.677613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.677783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.677943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.677973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.678152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.678274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.678302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.678434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.678542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.678569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.678706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.678900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.678930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.679058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.679186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.679212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.679344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.679445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.679474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.679588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.679728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.679754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.679892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.680136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.680402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.680672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.680816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.680963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.681098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.681124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.681268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.681393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.681421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.681548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.681698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.681725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.681875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.682184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.682473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.682755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.682926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.683042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.683292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.683552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.683802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.683967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.684120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.684242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.684283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.684403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.684498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.684527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.684653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.684811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.684838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.684979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.685219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.685554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.911 qpair failed and we were unable to recover it. 00:27:13.911 [2024-07-12 12:41:07.685798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.911 [2024-07-12 12:41:07.685916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.685946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.686045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.686330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.686608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.686839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.686974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.687100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.687356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.687604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.687748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.687876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.688138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.688366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.688560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.688800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.688954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.689076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.689218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.689244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.689393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.689476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.689501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.689610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.689785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.689815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.689965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.690194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.690486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.690723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.690889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.691046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.691275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.691553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.691788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.691921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.692006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.692270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.692590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.692880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.692977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.693126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.693401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.693712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.912 [2024-07-12 12:41:07.693829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.912 qpair failed and we were unable to recover it. 00:27:13.912 [2024-07-12 12:41:07.693963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.694252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.694568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.694854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.694970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.695080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.695200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.695235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.695367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.695493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.695523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.695651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.695778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.695807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.695935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.696192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.696420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.696667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.696817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.696982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.697124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.697168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.697316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.697460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.697486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.697647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.697775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.697803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.697959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.698223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.698432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.698824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.698997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.699094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.699185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.699211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.699328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.699442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.699469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.699596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.699724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.699753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.699912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.700050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.700078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.700240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.700358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.700386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.700550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.700705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.700749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.700878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.701217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.701476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.701722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.701855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.702009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.702187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.702212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.702330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.702446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.702489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.913 qpair failed and we were unable to recover it. 00:27:13.913 [2024-07-12 12:41:07.702615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.702744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.913 [2024-07-12 12:41:07.702773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.702927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.703232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.703514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.703822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.703967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.704088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.704207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.704233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.704403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.704550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.704585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.704719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.704878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.704925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.705046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.705306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.705554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.705814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.705973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.706103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.706203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.706246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.706373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.706455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.706481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.706597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.706732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.706761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.706854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.707218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.707479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.707766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.707935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.708088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.708311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.708622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.708849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.708996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.709112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.709385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.709656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.709795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.914 [2024-07-12 12:41:07.709926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.710038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.914 [2024-07-12 12:41:07.710063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.914 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.710188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.710267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.710293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.710438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.710562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.710587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.710722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.710841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.710876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.711024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.711155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.711183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.711329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.711470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.711496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.711625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.711748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.711777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.711918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.712121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.712362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.712600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.712789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.712913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.713200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.713496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.713776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.713938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.714067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.714269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.714544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.714811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.714950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.715064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.715209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.715235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.715334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.715495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.715523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.715656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.715778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.715807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.715971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.716259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.716479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.716701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.716862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.716992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.717114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.717162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.717305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.717422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.717447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.717556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.717686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.717711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.717844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.718008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.718038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.718194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.718409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.718480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.915 qpair failed and we were unable to recover it. 00:27:13.915 [2024-07-12 12:41:07.718615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.915 [2024-07-12 12:41:07.718756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.718782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.718951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.719244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.719498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.719839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.719977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.720119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.720468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.720783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.720986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.721130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.721212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.721239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.721356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.721476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.721502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.721661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.721797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.721835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.721989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.722165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.722191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.722306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.722420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.722447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.722564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.722700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.722728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.722893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.723040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.723068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.723257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.723373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.723402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.723555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.723696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.723721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.723899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.724255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.724554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.724785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.724930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.725063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.725289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.725559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.725859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.725992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.726103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.726252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.726278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.726402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.726563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.726591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.726725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.726846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.726878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.727023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.727116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.727149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.727325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.727434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.727460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.916 [2024-07-12 12:41:07.727537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.727704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.916 [2024-07-12 12:41:07.727732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.916 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.727842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.727982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.728130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.728346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.728638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.728816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.728982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.729241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.729518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.729732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.729908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.730031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.730316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.730570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.730843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.730988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.731117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.731465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.731698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.731859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.732024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.732166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.732191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.732315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.732416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.732446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.732630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.732796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.732824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.732953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.733221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.733575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.733860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.733993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.734076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.734314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.734660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.734908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.734998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.735194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.735436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.735704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.735892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.736038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.736154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.917 [2024-07-12 12:41:07.736180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.917 qpair failed and we were unable to recover it. 00:27:13.917 [2024-07-12 12:41:07.736295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.736407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.736433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.736569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.736673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.736703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.736836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.736952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.736981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.737155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.737266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.737291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.737423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.737576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.737604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.737737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.737880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.737917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.738083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.738306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.738358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.738490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.738601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.738632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.738718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.738795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.738820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.738912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.739131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.739429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.739650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.739829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.739952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.740208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.740501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.740817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.740989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.741108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.741398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.741684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.741823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.742000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.742084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.742112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.742272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.742390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.742418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.742570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.742688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.742717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.742847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.743005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.743031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.743192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.743313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.743339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.918 [2024-07-12 12:41:07.743481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.743609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.918 [2024-07-12 12:41:07.743637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.918 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.743768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.743932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.743961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.744067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.744211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.744240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.744366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.744471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.744499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.744629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.744796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.744822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.744953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.745286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.745593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.745906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.745995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.746149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.746425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.746690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.746845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.746959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.747242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.747497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.747702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.747927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.748056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.748320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.748600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.748829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.748987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.749073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.749196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.749225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.749366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.749460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.749505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.749583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.749666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.749692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.749836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.750196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.750483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.750765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.750918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.751033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.751294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.751526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.751799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.751923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.919 qpair failed and we were unable to recover it. 00:27:13.919 [2024-07-12 12:41:07.752036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.752144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.919 [2024-07-12 12:41:07.752172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.752263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.752347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.752376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.752466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.752571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.752599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.752732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.752850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.752883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.753042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.753166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.753194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.753314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.753444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.753472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.753595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.753726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.753751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.753895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.754176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.754485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.754755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.754929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.755068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.755212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.755238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.755383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.755530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.755558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.755680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.755810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.755838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.755981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.756118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.756158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.756288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.756368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.756395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.756545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.756705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.756730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.756877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.757011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.757039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.757216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.757499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.757551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.757663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.757785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.757811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.757911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.758191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.758480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.758789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.758975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.759099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.759215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.759243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.759380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.759523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.759548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.759650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.759811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.759837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.759978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.760238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.760486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.760765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.760931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.920 qpair failed and we were unable to recover it. 00:27:13.920 [2024-07-12 12:41:07.761046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.920 [2024-07-12 12:41:07.761197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.761223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.761365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.761496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.761524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.761652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.761775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.761804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.761931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.762167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.762392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.762622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.762788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.762904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.763163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.763442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.763709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.763904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.764040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.764310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.764558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.764789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.764958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.765077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.765311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.765609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.765820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.765988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.766075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.766231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.766260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.766386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.766507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.766533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.766642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.766762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.766790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.766892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.767025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.767052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.767256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.767419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.767447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.767604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.767697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.767724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.767856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.768142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.768412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.768672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.768785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.768876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.769040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.769068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.921 [2024-07-12 12:41:07.769200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.769320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.921 [2024-07-12 12:41:07.769347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.921 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.769481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.769572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.769600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.769713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.769833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.769859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.770007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.770260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.770540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.770809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.770920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.771038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.771298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.771532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.771851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.771997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.772106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.772267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.772296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.772419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.772581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.772609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.772742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.772899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.772926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.773019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.773272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.773534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.773840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.773979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.774138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.774255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.774280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.774400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.774540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.774566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.774690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.774793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.774822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.774924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.775081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.775110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.775255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.775398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.775424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.775577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.775720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.775752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.775933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.776079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.776106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.776255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.776475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.776528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.776671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.776781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.922 [2024-07-12 12:41:07.776807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.922 qpair failed and we were unable to recover it. 00:27:13.922 [2024-07-12 12:41:07.776979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.777108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.777138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.777315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.777464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.777498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.777665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.777809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.777838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.778022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.778172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.778217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.778369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.778531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.778559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.778662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.778816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.778844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.778989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.779266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.779560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:13.923 [2024-07-12 12:41:07.779883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.779990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:13.923 [2024-07-12 12:41:07.780036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:13.923 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.780192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.780384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.780438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.780544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.780629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.780655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.780776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.780900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.780927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.781017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.781149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.781184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.781368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.781512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.781562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.781715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.781849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.781902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.782074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.782199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.782236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.782425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.782539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.782573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.782733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.782882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.782921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.783035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.783193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.783230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.783398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.783567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.783609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.783752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.783849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.783888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.783991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.784266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.784601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.784851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.784977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.785078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.785213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.785241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.785354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.785471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.785497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.785603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.785711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.785736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.205 qpair failed and we were unable to recover it. 00:27:14.205 [2024-07-12 12:41:07.785856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.205 [2024-07-12 12:41:07.786030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.786221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.786540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.786751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.786944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.787097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.787385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.787644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.787850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.787979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.788096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.788256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.788285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.788409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.788538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.788566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.788702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.788786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.788812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.788909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.789153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.789452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.789730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.789892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.790030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.790290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.790517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.790771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.790886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.790979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.791266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.791575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.791872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.791999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.792167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.792414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.792724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.792892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.793043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.793332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.793581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.793855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.793996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.794022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.206 qpair failed and we were unable to recover it. 00:27:14.206 [2024-07-12 12:41:07.794141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.206 [2024-07-12 12:41:07.794283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.794309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.794478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.794613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.794642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.794736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.794826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.794856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.795004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.795157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.795186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.795349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.795477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.795503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.795615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.795755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.795780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.795954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.796281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.796565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.796792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.796969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.797106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.797373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.797668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.797857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.797990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.798155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.798284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.798313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.798439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.798564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.798592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.798740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.798848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.798880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.799032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.799126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.799155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.799277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.799428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.799457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.799618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.799783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.799808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.799960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.800120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.800149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.800305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.800488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.800549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.800675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.800829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.800858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.801024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.801152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.801180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.801322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.801436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.801461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.801599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.801740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.801766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.801926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.802064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.802092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.802231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.802467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.802526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.802688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.802810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.802852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.803000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.803108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.803139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.207 qpair failed and we were unable to recover it. 00:27:14.207 [2024-07-12 12:41:07.803269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.803374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.207 [2024-07-12 12:41:07.803402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.803561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.803660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.803688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.803824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.803950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.803976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.804103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.804278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.804304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.804423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.804539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.804583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.804722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.804816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.804844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.805015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.805281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.805562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.805795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.805923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.806038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.806356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.806582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.806833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.806964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.807088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.807211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.807237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.807356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.807470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.807513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.807643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.807762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.807791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.807924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.808221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.808496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.808814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.808977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.809087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.809235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.809261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.809375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.809484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.809510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.809647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.809777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.809805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.809928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.810023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.810051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.810280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.810488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.810540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.810713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.810808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.810834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.810983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.811205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.811503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.811789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.811902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.208 qpair failed and we were unable to recover it. 00:27:14.208 [2024-07-12 12:41:07.812012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.208 [2024-07-12 12:41:07.812140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.812170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.812334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.812476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.812502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.812640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.812727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.812756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.812888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.813176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.813471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.813794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.813947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.814075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.814189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.814214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.814350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.814478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.814507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.814662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.814778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.814806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.814932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.815197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.815445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.815701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.815845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.815979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.816237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.816524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.816754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.816909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.817031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.817157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.817186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.817348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.817489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.817515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.817691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.817769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.817795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.817940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.818182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.818471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.209 qpair failed and we were unable to recover it. 00:27:14.209 [2024-07-12 12:41:07.818661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.209 [2024-07-12 12:41:07.818819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.818953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.819180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.819428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.819661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.819852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.819990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.820296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.820553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.820824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.820989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.821143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.821255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.821283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.821407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.821504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.821532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.821664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.821778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.821804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.821925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.822225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.822517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.822733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.822903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.822996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.823286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.823572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.823857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.823986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.824142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.824456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.824756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.824938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.825056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.825176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.825202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.825304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.825429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.825471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.825610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.825716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.825761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.825878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.826193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.826417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.826727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.826873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.826985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.827101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.210 [2024-07-12 12:41:07.827128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.210 qpair failed and we were unable to recover it. 00:27:14.210 [2024-07-12 12:41:07.827247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.827361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.827391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.827472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.827586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.827612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.827730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.827845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.827879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.827986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.828215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.828436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.828687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.828850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.828987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.829138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.829166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.829327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.829471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.829512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.829668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.829821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.829849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.829997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.830227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.830484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.830705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.830839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.830950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.831137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.831389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.831661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.831782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.831908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.832149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.832385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.832616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.832837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.832955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.833040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.833169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.833211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.833330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.833416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.833442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.833577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.833749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.833775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.833919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.834200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.834489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.834701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.834914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.211 qpair failed and we were unable to recover it. 00:27:14.211 [2024-07-12 12:41:07.835005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.835099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.211 [2024-07-12 12:41:07.835125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.835209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.835318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.835347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.835460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.835606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.835632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.835720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.835872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.835902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.836045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.836267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.836513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.836818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.836993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.837103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.837229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.837273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.837395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.837504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.837530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.837627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.837740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.837765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.837897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.838232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.838488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.838744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.838893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.839003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.839155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.839183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.839317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.839464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.839493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.839654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.839779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.839808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.839931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.840157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.840435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.840745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.840858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.840985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.841180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.841437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.841677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.841815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.841922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.842229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.842512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.842841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.842987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.843015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.843154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.843237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.212 [2024-07-12 12:41:07.843263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.212 qpair failed and we were unable to recover it. 00:27:14.212 [2024-07-12 12:41:07.843419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.843512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.843540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.843633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.843760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.843788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.843914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.844145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.844441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.844697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.844803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.844900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.845177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.845478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.845729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.845850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.845950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.846243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.846473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.846724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.846905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.847039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.847269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.847537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.847750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.847885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.848012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.848272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.848567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.848843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.848995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.849098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.849222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.849248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.849410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.849499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.849522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.849658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.849784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.849810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.849943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.850174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.850401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.213 qpair failed and we were unable to recover it. 00:27:14.213 [2024-07-12 12:41:07.850630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.213 [2024-07-12 12:41:07.850753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.850852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.851189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.851473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.851685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.851839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.851960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.852215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.852441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.852693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.852831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.852948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.853185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.853432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.853650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.853820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.853914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.854138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.854365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.854646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.854900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.854980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.855095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.855347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.855575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.855805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.855917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.856015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.856223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.856474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.856669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.856836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.856948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.857070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.857099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.857209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.857353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.857379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.214 [2024-07-12 12:41:07.857461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.857545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.214 [2024-07-12 12:41:07.857571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.214 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.857686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.857797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.857822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.857953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.858206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.858484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.858702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.858851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.858985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.859209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.859451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.859743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.859931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.860070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.860335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.860582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.860804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.860959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.861098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.861231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.861261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.861367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.861476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.861509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.861615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.861760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.861791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.861935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.862180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.862479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.862774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.862931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.863065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.863199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.863236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.863337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.863473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.863504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.863647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.863740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.863770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.863861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.864176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.864466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.864716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.864862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.864993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.865244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.865514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.215 qpair failed and we were unable to recover it. 00:27:14.215 [2024-07-12 12:41:07.865721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.215 [2024-07-12 12:41:07.865835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.865874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.865970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.866215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.866512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.866783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.866958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.867064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.867311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.867553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.867801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.867995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.868158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.868389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.868673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.868830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.868982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.869207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.869493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.869718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.869907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.870035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.870296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.870511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.870769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.870934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.871093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.871335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.871560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.871819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.871998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.872170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.872413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.872664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.872832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.872983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.873274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.873501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.873803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.216 [2024-07-12 12:41:07.873964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.216 qpair failed and we were unable to recover it. 00:27:14.216 [2024-07-12 12:41:07.874070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.874193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.874222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.874374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.874497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.874530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.874660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.874777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.874814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.874995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.875091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.875121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.875282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.875427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.875461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.875619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.875768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.875800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.875924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.876165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.876437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.876704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.876821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.876928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.877208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.877485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.877775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.877962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.878064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.878327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.878568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.878815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.878969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.879122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.879370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.879620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.879778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.879880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.880129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.880405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.880643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.880839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.880967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.881245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.881513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.881783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.881952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.882069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.882197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.882226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.217 qpair failed and we were unable to recover it. 00:27:14.217 [2024-07-12 12:41:07.882331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.882427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.217 [2024-07-12 12:41:07.882458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.882559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.882679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.882710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.882834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.882981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.883136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.883394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.883673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.883822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.883980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.884235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.884486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.884732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.884895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.885027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.885280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.885531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.885813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.885951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.886087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.886355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.886576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.886822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.886982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.887080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.887178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.887209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.887319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.887475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.887505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.887660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.887800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.887830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.888011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.888271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.888556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.888805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.888959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.889059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.889147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.889174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.218 qpair failed and we were unable to recover it. 00:27:14.218 [2024-07-12 12:41:07.889336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.218 [2024-07-12 12:41:07.889439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.889470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.889555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.889677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.889705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.889802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.889955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.889990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.890093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.890215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.890253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.890363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.890505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.890535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.890662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.890756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.890787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.890917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.891174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.891428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.891676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.891818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.891959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.892203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.892495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.892734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.892922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.893019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.893115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.893146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.893250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.893363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.893391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.893526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.893688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.893718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.893949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.894059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.894091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.894245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.894411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.894456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.894656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.894802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.894829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.894953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.895349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.895637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.895882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.895974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.896116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.896392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.896655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.896799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.896960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.897222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.897480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.219 [2024-07-12 12:41:07.897716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.219 [2024-07-12 12:41:07.897895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.219 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.898005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.898139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.898168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.898372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.898493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.898521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.898718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.898839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.898875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.899018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.899363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.899622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.899861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.899991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.900111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.900416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.900764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.900891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.901013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.901226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.901474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.901745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.901861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.901974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.902276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.902508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.902799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.902995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.903162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.903371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.903620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.903776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.903924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.904129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.904420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.904693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.904924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.905022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.905282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.905511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.220 [2024-07-12 12:41:07.905763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.220 [2024-07-12 12:41:07.905893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.220 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.905985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.906205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.906471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.906789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.906961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.907080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.907317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.907574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.907805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.907938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.908049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.908136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.908162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.908318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.908452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.908481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.908603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.908727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.908756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.908894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.909177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.909430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.909705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.909876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.909957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.910250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.910587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.910847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.910972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.911066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.911322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.911566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.911800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.911948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.912040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.912176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.912201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.912313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.912505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.912530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.912651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.912792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.912817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.912934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.913050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.913077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.913201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.913342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.913368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.913459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.913584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.221 [2024-07-12 12:41:07.913610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.221 qpair failed and we were unable to recover it. 00:27:14.221 [2024-07-12 12:41:07.913762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.913846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.913877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.913991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.914245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.914440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.914620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.914840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.914984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.915072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.915270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.915471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.915707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.915830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.915966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.916228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.916452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.916669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.916805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.916925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.917146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.917372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.917572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.917783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.917951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.918060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.918306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.918538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.918832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.918969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.919084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.919165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.919191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.919268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.919353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.919378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.222 qpair failed and we were unable to recover it. 00:27:14.222 [2024-07-12 12:41:07.919521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.222 [2024-07-12 12:41:07.919662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.919687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.919829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.919972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.919998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.920116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.920363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.920610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.920886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.920981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.921090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.921308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.921537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.921734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.921878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.922003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.922199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.922429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.922677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.922811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.922936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.923144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.923344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.923587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.923811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.923923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.924011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.924256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.924478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.924688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.924852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.925011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.925239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.925474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.925674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.925863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.925994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.926080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.926281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.223 qpair failed and we were unable to recover it. 00:27:14.223 [2024-07-12 12:41:07.926775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.223 [2024-07-12 12:41:07.926915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.926941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.927059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.927272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.927502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.927732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.927875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.928012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.928300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.928540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.928795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.928905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.929016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.929241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.929484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.929709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.929882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.929979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.930212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.930471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.930663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.930887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.930990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.931100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.931290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.931554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.931835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.931967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.932079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.932275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.932509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.932751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.932924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.933018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.933245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.933456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.933674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.224 [2024-07-12 12:41:07.933883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.933990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.224 [2024-07-12 12:41:07.934015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.224 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.934111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.934365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.934599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.934883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.934993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.935137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.935364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.935565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.935784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.935923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.936010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.936236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.936438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.936645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.936812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.936924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.937195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.937441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.937700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.937809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.937928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.938137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.938360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.938572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.938797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.938903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.938995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.939248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.939509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.939762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.939903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.940008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.940241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.940448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.940696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.940828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.940949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.941066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.941091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.225 qpair failed and we were unable to recover it. 00:27:14.225 [2024-07-12 12:41:07.941181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.941259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.225 [2024-07-12 12:41:07.941284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.941399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.941485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.941510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.941603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.941707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.941732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.941882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.941998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.942122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.942390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.942594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.942811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.942957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.943050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.943176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.943201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.943313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.943422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.943448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.943591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.943737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.943762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.943905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.944106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.944335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.944623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.944847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.944982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.945110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.945420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.945652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.945884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.945976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.946093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.946326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.946515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.946710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.946841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.946947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.947192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.947390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.947618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.947841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.947958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.948042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.948120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.948146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.948226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.948317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.948344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.226 qpair failed and we were unable to recover it. 00:27:14.226 [2024-07-12 12:41:07.948428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.226 [2024-07-12 12:41:07.948505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.948530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.948609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.948711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.948737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.948817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.948934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.948959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.949060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.949345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.949608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.949915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.949999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.950147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.950349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.950579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.950780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.950964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.951060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.951283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.951548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.951805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.951935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.952045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.952316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.952568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.952827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.952976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.953130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.953386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.953660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.953784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.953880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.954147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.954385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.227 qpair failed and we were unable to recover it. 00:27:14.227 [2024-07-12 12:41:07.954648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.227 [2024-07-12 12:41:07.954761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.954850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.954951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.954977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.955090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.955345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.955572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.955819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.955950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.956032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.956309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.956553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.956812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.956945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.957092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.957326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.957612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.957830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.957981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.958128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.958363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.958603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.958883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.958988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.959081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.959229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.959254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.959373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.959506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.959532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.959629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.959744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.959770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.959923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.960151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.960385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.960627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.960741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.960852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.961125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.961350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.961572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.961793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.961927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.228 [2024-07-12 12:41:07.962040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.962138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.228 [2024-07-12 12:41:07.962163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.228 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.962251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.962373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.962398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.962489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.962577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.962604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.962740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.962863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.962918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.963011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.963244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.963514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.963765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.963892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.964014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.964264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.964523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.964826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.964977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.965072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.965306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.965567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.965801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.965940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.966057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.966289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.966484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.966766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.966943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.967033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.967277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.967472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.967748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.967937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.968026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.968257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.968511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.968713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.968853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.969107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.969145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.969231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.969308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.969338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.229 qpair failed and we were unable to recover it. 00:27:14.229 [2024-07-12 12:41:07.969455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.229 [2024-07-12 12:41:07.969591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.969617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.969705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.969823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.969849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.969958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.970175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.970451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.970721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.970954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.971038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.971280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.971528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.971815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.971958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.972108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.972213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.972240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.972365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.972522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.972550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.972654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.972778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.972806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.972942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.973171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.973434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.973705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.973840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.973995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.974282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.974530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.974782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.974910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.975043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.975133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.975159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.975358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.975472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.975498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.975629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.975782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.975809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.975947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.976223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.976470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.976764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.976923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.977058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.977179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.977205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.977291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.977431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.977457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.977598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.977726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.230 [2024-07-12 12:41:07.977754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.230 qpair failed and we were unable to recover it. 00:27:14.230 [2024-07-12 12:41:07.977891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.978217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.978503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.978735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.978901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.979015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.979233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.979487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.979732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.979847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.980030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.980297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.980563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.980799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.980949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.981071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.981231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.981258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.981377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.981472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.981499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.981654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.981803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.981827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.982000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.982233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.982457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.982755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.982897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.983004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.983297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.983545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.983790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.983927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.984015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.984153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.984180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.984279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.984432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.984459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.231 qpair failed and we were unable to recover it. 00:27:14.231 [2024-07-12 12:41:07.984591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.231 [2024-07-12 12:41:07.984675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.984701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.984820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.984922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.984948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.985049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.985328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.985585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.985823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.985979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.986128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.986380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.986590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.986788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.986928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.987012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.987247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.987508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.987752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.987897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.988033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x111c4b0 is same with the state(5) to be set 00:27:14.232 [2024-07-12 12:41:07.988234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.988381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.988424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.988591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.988691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.988720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.988840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.988977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.989152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.989478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.989717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.989885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.990020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.990285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.990509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.990819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.990930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.991038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.991292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.991520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.991741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.991930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.992012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.992103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.992127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.232 [2024-07-12 12:41:07.992266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.992379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.232 [2024-07-12 12:41:07.992404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.232 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.992545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.992668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.992694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.992814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.992905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.992948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.993035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.993234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.993534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.993789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.993939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.994084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.994390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.994625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.994880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.994983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.995098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.995326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.995595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.995808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.995936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.996032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.996242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.996544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.996811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.996947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.997043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.997331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.997599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.997844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.997961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.998121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.998219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.998246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.998379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.998492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.998516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.998666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.998818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.998848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.998937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.999174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.999432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.999707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:07.999878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:07.999972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:08.000061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:08.000086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.233 qpair failed and we were unable to recover it. 00:27:14.233 [2024-07-12 12:41:08.000231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:08.000336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.233 [2024-07-12 12:41:08.000362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.000528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.000615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.000640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.000781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.000880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.000906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.000999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.001247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.001473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.001766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.001934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.002011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.002239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.002495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.002817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.002994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.003158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.003299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.003324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.003489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.003609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.003636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.003731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.003837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.003862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.004013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.004249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.004476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.004728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.004873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.004991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.005266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.005506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.005733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.005885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.005968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.006195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.006480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.006741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.006916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.006997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.007286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.007531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.007842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.007958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.008078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.008216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.008242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.234 qpair failed and we were unable to recover it. 00:27:14.234 [2024-07-12 12:41:08.008369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.234 [2024-07-12 12:41:08.008489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.008515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.008672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.008792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.008817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.008941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.009155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.009470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.009758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.009907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.010032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.010287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.010560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.010802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.010981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.011072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.011273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.011524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.011820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.011983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.012120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.012264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.012290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.012408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.012548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.012572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.012693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.012833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.012857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.012993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.013286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.013562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.013888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.013997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.014116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.014385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.014604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.014822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.014978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.235 [2024-07-12 12:41:08.015101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.015185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.235 [2024-07-12 12:41:08.015210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.235 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.015297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.015406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.015430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.015523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.015609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.015633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.015760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.015836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.015860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.016018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.016242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.016500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.016816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.016985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.017122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.017250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.017276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.017405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.017494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.017518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.017639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.017720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.017744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.017829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.018135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.018362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.018611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.018735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.018870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.019120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.019398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.019655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.019789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.019880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.020179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.020434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.020741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.020877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.021010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.021245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.021469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.021656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.021796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.021920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.022140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.022432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.022770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.022942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.236 [2024-07-12 12:41:08.023060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.023144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.236 [2024-07-12 12:41:08.023168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.236 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.023296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.023400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.023426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.023561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.023660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.023685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.023801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.023914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.023956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.024048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.024318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.024581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.024845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.024997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.025106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.025224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.025248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.025377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.025534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.025560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.025681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.025811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.025836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.025974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.026240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.026491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.026727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.026910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.027055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.027185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.027211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.027332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.027478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.027504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.027638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.027737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.027761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.027853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.028182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.028446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.028746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.028915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.029024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.029318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.029529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.029787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.029971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.030092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.030339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.030555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.030825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.030976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.031060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.031143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.031168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.237 qpair failed and we were unable to recover it. 00:27:14.237 [2024-07-12 12:41:08.031303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.237 [2024-07-12 12:41:08.031377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.031401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.031525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.031642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.031666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.031758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.031848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.031879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.032003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.032262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.032557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.032833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.032999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.033140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.033259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.033283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.033425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.033539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.033565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.033692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.033854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.033896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.034009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.034267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.034499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.034775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.034955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.035123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.035220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.035246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.035357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.035484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.035510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.035689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.035776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.035801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.035887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.036134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.036400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.036677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.036857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.036992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.037229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.037509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.037807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.037963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.038074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.038196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.038221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.038390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.038507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.038534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.038681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.038841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.038873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.039011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.039260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.039540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.238 qpair failed and we were unable to recover it. 00:27:14.238 [2024-07-12 12:41:08.039774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.238 [2024-07-12 12:41:08.039945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.039970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.040098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.040263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.040289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.040379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.040500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.040526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.040665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.040782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.040816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.040959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.041183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.041471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.041752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.041910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.042002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.042150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.042180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.042352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.042473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.042524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.042650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.042808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.042835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.042982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.043271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.043579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.043827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.043991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.044107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.044205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.044229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.044371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.044488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.044514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.044632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.044751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.044777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.044926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.045188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.045490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.045769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.045908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.046066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.046300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.046574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.046768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.046967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.047055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.047301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.047574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.047880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.047981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.048005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.048094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.048208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.239 [2024-07-12 12:41:08.048231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.239 qpair failed and we were unable to recover it. 00:27:14.239 [2024-07-12 12:41:08.048344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.048527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.048551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.048665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.048782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.048806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.048901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.049153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.049471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.049776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.049918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.050064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.050199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.050225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.050348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.050481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.050507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.050664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.050748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.050771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.050869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.051117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.051324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.051574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.051808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.051952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.052031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.052261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.052496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.052734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.052911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.053056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.053150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.053201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.053322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.053490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.053515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.053653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.053734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.053758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.053905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.054236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.054453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.054639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.054842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.054962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.055051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.055075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.240 qpair failed and we were unable to recover it. 00:27:14.240 [2024-07-12 12:41:08.055189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.240 [2024-07-12 12:41:08.055305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.055328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.055446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.055584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.055609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.055741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.055873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.055900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.056056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.056268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.056502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.056737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.056853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.056994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.057215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.057511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.057712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.057825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.057952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.058202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.058504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.058793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.058978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.059061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.059338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.059643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.059902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.059993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.060104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.060343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.060650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.060813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.060969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.061192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.061432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.061617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.061812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.061951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.062092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.062214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.062238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.062419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.062534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.062557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.062696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.062839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.062862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.063015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.063154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.063203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.241 qpair failed and we were unable to recover it. 00:27:14.241 [2024-07-12 12:41:08.063371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.241 [2024-07-12 12:41:08.063491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.063516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.063639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.063769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.063794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.063938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.064215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.064516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.064786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.064939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.065060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.065330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.065564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.065870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.065996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.066124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.066367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.066596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.066742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.066882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.067179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.067499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.067799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.067995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.068126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.068271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.068296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.068439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.068561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.068587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.068681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.068799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.068825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.068999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.069089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.069113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.069240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.069403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.069429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.069562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.069709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.069732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.069850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.070192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.070446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.070679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.070818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.070941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.071125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.071395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.071697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.242 [2024-07-12 12:41:08.071918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.242 qpair failed and we were unable to recover it. 00:27:14.242 [2024-07-12 12:41:08.072004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.072241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.072530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.072774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.072929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.073086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.073212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.073247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.073360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.073535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.073570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.073677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.073785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.073809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.073896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.074110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.074332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.074642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.074777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.074883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.075219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.075531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.075842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.075983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.076166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.076443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.076677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.076863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.076987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.077120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.077382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.077652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.077828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.077994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.078301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.078576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.078826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.078968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.079089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.079218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.079243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.079362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.079480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.079505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.079660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.079775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.079799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.079933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.080029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.080072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.243 [2024-07-12 12:41:08.080159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.080253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.243 [2024-07-12 12:41:08.080278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.243 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.080395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.080509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.080534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.080616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.080727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.080751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.080840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.080959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.080983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.081072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.081298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.081612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.081872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.081999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.082158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.082455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.082679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.082776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.082913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.083204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.083495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.083716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.083847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.083942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.084153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.084349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.084573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.084800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.084939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.085058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.085168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.085192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.085272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.085417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.085442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.085581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.085667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.085695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.085829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.086124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.086453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.086717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.244 [2024-07-12 12:41:08.086842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.244 qpair failed and we were unable to recover it. 00:27:14.244 [2024-07-12 12:41:08.086984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.087273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.087549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.087813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.087933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.088076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.088318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.088560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.088818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.088927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.089074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.089297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.089580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.089837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.089977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.090067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.090260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.090513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.090779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.090943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.091068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.091283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.091550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.091845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.091967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.092086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.092212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.092238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.092393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.092531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.092555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.092672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.092749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.092773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.092882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.093207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.093454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.093669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.093818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.093954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.094203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.094466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.245 [2024-07-12 12:41:08.094761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.245 [2024-07-12 12:41:08.094918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.245 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.095037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.095304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.095610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.095901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.095991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.096097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.096300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.096595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.096829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.096982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.097110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.097222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.097254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.097369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.097480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.097504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.097586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.097731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.097756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.097914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.098189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.098418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.098667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.098811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.098957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.099166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.099453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.099689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.099832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.099959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.100069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.100094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.100261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.100404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.100445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.100562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.100679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.100704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.100847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.101039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.101064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.101155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.101281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.101306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.101457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.101566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.246 [2024-07-12 12:41:08.101590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.246 qpair failed and we were unable to recover it. 00:27:14.246 [2024-07-12 12:41:08.101685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.101819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.101851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.101991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.102289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.102540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.102724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.102894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.103004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.103247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.103550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.103820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.103977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.104096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.104354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.104611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.104857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.104987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.105108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.105333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.105564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.105787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.105901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.106040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.106255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.106486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.106741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.106847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.106958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.107165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.107390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.107641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.107894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.107995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.108131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.108339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.108594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.539 qpair failed and we were unable to recover it. 00:27:14.539 [2024-07-12 12:41:08.108795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.539 [2024-07-12 12:41:08.108877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.108903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.109022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.109278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.109512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.109737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.109887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.110013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.110298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.110560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.110771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.110914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.111000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.111234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.111429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.111683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.111792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.111879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.112120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.112377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.112580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.112784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.112928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.113017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.113240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.113491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.113717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.113834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.113932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.114157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.114358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.114553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.114806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.114916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.115006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.115231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.115429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.540 qpair failed and we were unable to recover it. 00:27:14.540 [2024-07-12 12:41:08.115661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.540 [2024-07-12 12:41:08.115805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.115950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.116109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.116136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.116335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.116473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.116514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.116669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.116802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.116827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.116969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.117227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.117423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.117643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.117837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.117986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.118101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.118345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.118553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.118744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.118891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.119042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.119239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.119502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.119703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.119847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.119962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.120216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.120478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.120696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.120858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.120964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.121163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.121390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.121596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.121840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.121957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.122038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.122141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.122165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.122269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.122408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.122432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.122528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.122670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.541 [2024-07-12 12:41:08.122695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.541 qpair failed and we were unable to recover it. 00:27:14.541 [2024-07-12 12:41:08.122788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.122909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.122935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.123030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.123282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.123533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.123778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.123936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.124047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.124253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.124449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.124669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.124884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.124997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.125086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.125295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.125548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.125765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.125902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.126015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.126210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.126430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.126687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.126861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.126969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.127202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.127468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.127676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.127907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.127991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.128100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.128343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.128565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.128816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.128966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.129057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.129285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.129480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.542 qpair failed and we were unable to recover it. 00:27:14.542 [2024-07-12 12:41:08.129683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.542 [2024-07-12 12:41:08.129823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.129909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.129995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.130117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.130348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.130626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.130824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.130939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.131026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.131212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.131445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.131670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.131901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.131987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.132116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.132371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.132592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.132802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.132932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.133023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.133228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.133450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.133663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.133893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.133979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.134093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.134353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.134596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.134814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.134962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.135048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.135162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.135186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.543 qpair failed and we were unable to recover it. 00:27:14.543 [2024-07-12 12:41:08.135267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.135357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.543 [2024-07-12 12:41:08.135380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.135500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.135580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.135604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.135689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.135777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.135801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.135889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.135981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.136098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.136352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.136567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.136800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.136935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.137033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.137262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.137458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.137757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.137901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.138000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.138202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.138457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.138686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.138824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.138919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.139124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.139319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.139577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.139796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.139906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.140010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.140236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.140439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.140653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.140859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.140987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.141102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.141245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.141269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.141366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.141507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.141531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.141655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.141767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.141790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.141915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.142012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.142035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.142155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.142243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.142266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.544 qpair failed and we were unable to recover it. 00:27:14.544 [2024-07-12 12:41:08.142360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.544 [2024-07-12 12:41:08.142436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.142460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.142549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.142668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.142693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.142804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.142892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.142917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.143006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.143237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.143465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.143692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.143796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.143881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.144169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.144432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.144636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.144819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.144968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.145054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.145257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.145490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.145713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.145824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.145933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.146142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.146371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.146652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.146795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.146886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.147176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.147378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.147624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.147877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.147996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.148110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.148308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.148530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.148740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.148889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.148981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.149063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.149087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.149179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.149297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.149321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.545 qpair failed and we were unable to recover it. 00:27:14.545 [2024-07-12 12:41:08.149440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.545 [2024-07-12 12:41:08.149557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.149581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.149671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.149759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.149783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.149897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.150136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.150325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.150542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.150771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.150908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.151008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.151269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.151501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.151734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.151845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.151950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.152186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.152397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.152682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.152894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.152991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.153110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.153365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.153588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.153794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.153905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.154006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.154242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.154459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.154692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.154826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.154923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.155153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.155376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.155600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.155830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.155982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.156075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.156164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.156188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.156288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.156378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.546 [2024-07-12 12:41:08.156402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.546 qpair failed and we were unable to recover it. 00:27:14.546 [2024-07-12 12:41:08.156515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.156659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.156684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.156791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.156886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.156912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.157010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.157262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.157510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.157761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.157901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.158020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.158267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.158489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.158754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.158859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.159008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.159245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.159503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.159726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.159862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.159991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.160193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.160420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.160670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.160887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.160996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.161098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.161359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.161598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.161736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.161850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.162127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.162330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.547 [2024-07-12 12:41:08.162546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.547 [2024-07-12 12:41:08.162666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.547 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.162780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.162896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.162922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.163015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.163240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.163503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.163741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.163905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.163998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.164258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.164499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.164688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.164894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.164990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.165130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.165331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.165569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.165794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.165934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.166027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.166246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.166447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.166651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.166822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.166939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.167162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.167382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.167598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.167791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.167911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.167998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.168273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.168543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.168763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.168885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.168982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.169225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.169462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.548 qpair failed and we were unable to recover it. 00:27:14.548 [2024-07-12 12:41:08.169698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.548 [2024-07-12 12:41:08.169801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.169895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.169989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.170129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.170355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.170557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.170796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.170939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.171024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.171249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.171435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.171687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.171828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.171925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.172213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.172451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.172699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.172860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.172954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.173195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.173448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.173677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.173838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.173936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.174167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.174361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.174652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.174787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.174903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.175115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.175337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.175534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.175803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.175946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.176066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.176321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.176575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.176802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.176925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.549 qpair failed and we were unable to recover it. 00:27:14.549 [2024-07-12 12:41:08.177045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.549 [2024-07-12 12:41:08.177139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.177277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.177502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.177739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.177898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.178026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.178285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.178505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.178705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.178834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.179004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.179222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.179476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.179688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.179826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.179923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.180178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.180417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.180676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.180791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.180907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.181173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.181407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.181636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.181857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.181974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.182069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.182327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.182606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.182861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.182968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.183056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.183340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.183565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.183844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.183953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.184043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.184159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.184183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.550 [2024-07-12 12:41:08.184293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.184384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.550 [2024-07-12 12:41:08.184407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.550 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.184546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.184659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.184683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.184800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.184889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.184914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.185007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.185280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.185552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.185834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.185948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.186034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.186269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.186475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.186712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.186860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.186993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.187274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.187496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.187724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.187862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.187965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.188191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.188471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.188719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.188821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.188965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.189215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.189463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.189748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.189922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.190048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.190252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.190452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.190721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.190904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.191046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.191243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.191512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.191820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.191985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.551 qpair failed and we were unable to recover it. 00:27:14.551 [2024-07-12 12:41:08.192102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.551 [2024-07-12 12:41:08.192176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.192200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.192294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.192439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.192466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.192555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.192675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.192702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.192936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.193190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.193436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.193687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.193850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.194025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.194286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.194560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.194827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.194986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.195106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.195370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.195601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.195821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.195979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.196119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.196326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.196607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.196882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.196996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.197111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.197252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.197276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.197367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.197511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.197538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.197652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.197737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.197763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.197903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.198213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.198454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.198650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.552 qpair failed and we were unable to recover it. 00:27:14.552 [2024-07-12 12:41:08.198848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.552 [2024-07-12 12:41:08.198932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.198956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.199076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.199219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.199243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.199404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.199529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.199555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.199689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.199779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.199806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.199935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.200146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.200422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.200696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.200874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.200989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.201229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.201424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.201739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.201849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.201976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.202304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.202560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.202844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.202999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.203172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.203403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.203645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.203827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.204000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.204115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.204140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.204256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.204378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.204405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.204525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.204690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.204714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.204871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.205155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.205375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.205608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.205836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.205988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.206076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.206322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.206552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.206781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.553 [2024-07-12 12:41:08.206925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.553 qpair failed and we were unable to recover it. 00:27:14.553 [2024-07-12 12:41:08.207070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.207186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.207211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.207393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.207529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.207555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.207659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.207779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.207805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.207916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.208155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.208369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.208642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.208878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.208986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.209131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.209458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.209786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.209968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.210077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.210321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.210568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.210851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.210987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.211124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.211394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.211665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.211773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.211887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.212114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.212431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.212785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.212926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.213093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.213215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.213242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.213364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.213458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.213485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.213628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.213748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.213772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.213940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.214224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.214489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.214741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.214884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.215001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.215127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.215167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.215314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.215429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.554 [2024-07-12 12:41:08.215453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.554 qpair failed and we were unable to recover it. 00:27:14.554 [2024-07-12 12:41:08.215536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.215620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.215662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.215815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.215952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.215976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.216070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.216182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.216206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.216317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.216480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.216506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.216636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.216807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.216831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.216955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.217209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.217487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.217766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.217892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.218019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.218163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.218187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.218324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.218465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.218489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.218604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.218717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.218741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.218890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.219190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.219428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.219757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.219933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.220061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.220343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.220551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.220818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.220978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.221096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.221293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.221597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.221882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.221978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.222162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.222425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.222685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.222820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.222940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.223159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.223405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.555 [2024-07-12 12:41:08.223603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.555 [2024-07-12 12:41:08.223713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.555 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.223828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.223951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.223977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.224058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.224320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.224599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.224821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.224960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.225094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.225301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.225592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.225839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.225982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.226125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.226399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.226685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.226843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.226960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.227247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.227546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.227802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.227929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.228029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.228293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.228566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.228849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.228976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.229133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.229368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.229650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.229860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.229980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.230062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.230149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.230173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.230317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.230401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.556 [2024-07-12 12:41:08.230425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.556 qpair failed and we were unable to recover it. 00:27:14.556 [2024-07-12 12:41:08.230539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.230646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.230670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.230759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.230882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.230908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.231016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.231304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.231527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.231805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.231965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.232147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.232460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.232654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.232823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.232974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.233316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.233577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.233843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.233970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.234088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.234286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.234560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.234776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.234898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.235007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.235219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.235444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.235669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.235813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.235930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.236185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.236423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.236707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.236845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.236951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.237159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.237352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.237603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.237808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.237950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.557 qpair failed and we were unable to recover it. 00:27:14.557 [2024-07-12 12:41:08.238065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.238192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.557 [2024-07-12 12:41:08.238218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.238375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.238463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.238496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.238620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.238722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.238750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.238855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.239155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.239460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.239697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.239855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.240004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.240150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.240196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.240328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.240544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.240585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.240710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.240853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.240894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.241038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.241212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.241255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.241385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.241537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.241580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.241710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.241830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.241855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.241995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.242279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.242601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.242862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.242976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.243114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.243249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.243276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.243420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.243584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.243611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.243740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.243883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.243909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.244014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.244123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.244147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.244270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.244439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.244466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.244661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.244778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.244805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.244921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.245143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.245413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.245729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.245889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.246005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.246297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.246534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.246774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.246919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.558 qpair failed and we were unable to recover it. 00:27:14.558 [2024-07-12 12:41:08.247058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.558 [2024-07-12 12:41:08.247196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.247223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.247359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.247443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.247471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.247606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.247731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.247758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.247913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.248157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.248396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.248667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.248824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.248969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.249208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.249492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.249743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.249915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.250030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.250274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.250561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.250844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.250984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.251067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.251213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.251237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.251393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.251526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.251553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.251676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.251765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.251792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.251918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.252183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.252473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.252735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.252918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.253034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.253317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.253600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.253822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.253988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.254108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.254214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.254242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.254396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.254516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.254543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.254632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.254780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.254807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.254952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.255090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.255115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.255208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.255318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.255343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.559 qpair failed and we were unable to recover it. 00:27:14.559 [2024-07-12 12:41:08.255455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.559 [2024-07-12 12:41:08.255563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.255595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.255698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.255826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.255873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.255961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.256202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.256512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.256804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.256946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.257028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.257111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.257155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.257278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.257427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.257454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.257647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.257767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.257794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.257883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.258187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.258450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.258709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.258834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.258971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.259158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.259420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.259686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.259840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.259998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.260265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.260470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.260746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.260926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.261047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.261182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.261222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.261362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.261481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.261505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.261596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.261726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.261753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.261869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.262011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.262035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.262116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.262253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.262278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.262421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.262550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.560 [2024-07-12 12:41:08.262577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.560 qpair failed and we were unable to recover it. 00:27:14.560 [2024-07-12 12:41:08.262700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.262821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.262848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.263022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.263135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.263159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.263284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.263402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.263426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.263564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.263715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.263740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.263836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.264170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.264422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.264643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.264913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.264997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.265160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.265446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.265691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.265807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.265957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.266244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.266557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.266814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.266974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.267059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.267186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.267211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.267325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.267442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.267468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.267609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.267710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.267737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.267909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.268192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.268470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.268709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.268916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.269013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.269216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.269516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.269836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.269994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.270119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.270353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.270573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.561 [2024-07-12 12:41:08.270763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.561 [2024-07-12 12:41:08.270913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.561 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.270988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.271243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.271484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.271722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.271826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.271925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.272142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.272398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.272652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.272872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.272973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.273059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.273315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.273537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.273811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.273962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.274038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.274155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.274180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.274346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.274434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.274461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.274599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.274714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.274739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.274883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.275129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.275387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.275660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.275891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.275974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.276112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.276418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.276723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.276870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.277017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.277301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.277536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.277816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.277953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.278039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.278177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.278202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.278311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.278420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.278445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.562 qpair failed and we were unable to recover it. 00:27:14.562 [2024-07-12 12:41:08.278559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.562 [2024-07-12 12:41:08.278699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.278723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.278813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.278934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.278959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.279099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.279289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.279567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.279821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.279970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.280090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.280193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.280220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.280352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.280478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.280505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.280694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.280843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.280878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.281012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.281154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.281179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.281314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.281468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.281495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.281625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.281762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.281789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.281956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.282178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.282476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.282798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.282962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.283075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.283333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.283644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.283872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.283999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.284077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.284321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.284540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.284844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.284959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.285069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.285359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.285640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.285879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.285985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.286151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.286396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.286679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.563 qpair failed and we were unable to recover it. 00:27:14.563 [2024-07-12 12:41:08.286900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.563 [2024-07-12 12:41:08.286998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.287128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.287361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.287566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.287820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.287986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.288133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.288394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.288684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.288835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.288989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.289235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.289478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.289743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.289884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.289976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.290095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.290119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.290302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.290406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.290430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.290586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.290725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.290754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.290886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.291137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.291427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.291676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.291827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.291993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.292188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.292452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.292662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.292808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.292946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.293177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.293467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.293702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.293819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.293961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.294215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.294457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.564 qpair failed and we were unable to recover it. 00:27:14.564 [2024-07-12 12:41:08.294751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.564 [2024-07-12 12:41:08.294901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.295014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.295126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.295150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.295226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.298162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.298428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.298684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.298796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.298970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.299178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.299428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.299740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.299876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.299964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.300222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.300465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.300737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.300892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.301037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.301153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.301199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.301332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.301459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.301485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.301616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.301728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.301752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.301857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.302178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.302427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.302607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.302872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.302996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.303128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.303372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.303630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.303734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.303888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.304005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.304030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.304141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.304215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.565 [2024-07-12 12:41:08.304240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.565 qpair failed and we were unable to recover it. 00:27:14.565 [2024-07-12 12:41:08.304356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.304466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.304490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.304609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.304715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.304739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.304871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.305181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.305460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.305770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.305941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.306095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.306345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.306570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.306799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.306995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.307114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.307222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.307246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.307362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.307479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.307503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.307670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.307763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.307790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.307909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.308148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.308395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.308657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.308797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.308906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.309119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.309454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.309706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.309858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.309987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.310268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.310463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.310807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.310948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.311062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.311300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.311603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.311830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.311985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.312010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.312098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.312211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.312235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.312368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.312469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.566 [2024-07-12 12:41:08.312496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.566 qpair failed and we were unable to recover it. 00:27:14.566 [2024-07-12 12:41:08.312662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.312776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.312800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.312956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.313169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.313398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.313694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.313822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.313928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.314206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.314455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.314695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.314895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.315027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.315313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.315548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.315799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.315969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.316061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.316304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.316559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.316743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.316926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.317073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.317313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.317517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.317812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.317964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.318074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.318324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.318550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.318797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.318931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.319021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.319248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.319505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.319757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.319901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.320020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.320134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.320158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.320265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.320372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.567 [2024-07-12 12:41:08.320397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.567 qpair failed and we were unable to recover it. 00:27:14.567 [2024-07-12 12:41:08.320546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.320636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.320660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.320777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.320924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.320949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.321041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.321345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.321655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.321902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.321982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.322116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.322415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.322709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.322860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.322985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.323211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.323425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.323662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.323782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.323878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.324134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.324358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.324597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.324761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.324886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.325184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.325464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.325685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.325820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.325927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.326196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.326467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.326687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.326800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.326959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.327270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.327550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.327810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.327978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.328086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.328185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.328209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.568 [2024-07-12 12:41:08.328348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.328471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.568 [2024-07-12 12:41:08.328498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.568 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.328650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.328740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.328769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.328891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.329139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.329364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.329616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.329780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.329911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.330141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.330460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.330705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.330861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.330990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.331306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.331536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.331759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.331910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.332002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.332243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.332538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.332779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.332924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.333006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.333317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.333653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.333909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.333993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.334103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.334349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.334577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.334766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.334899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.335008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.335032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.335118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.335264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.335288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.569 qpair failed and we were unable to recover it. 00:27:14.569 [2024-07-12 12:41:08.335451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.569 [2024-07-12 12:41:08.335553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.335580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.335748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.335863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.335896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.336004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.336284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.336529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.336835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.336992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.337104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.337196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.337220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.337377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.337516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.337540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.337686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.337827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.337877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.338016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.338232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.338548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.338818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.338992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.339112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.339329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.339554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.339737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.339845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.339946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.340201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.340438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.340706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.340857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.340975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.341206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.341519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.341786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.341947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.342066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.342295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.342549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.342793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.342928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.343060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.343176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.343201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.343303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.343394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.570 [2024-07-12 12:41:08.343422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.570 qpair failed and we were unable to recover it. 00:27:14.570 [2024-07-12 12:41:08.343560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.343651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.343679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.343796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.343916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.343942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.344035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.344153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.344206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.344336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.344500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.344525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.344641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.344759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.344784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.344940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.345167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.345426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.345640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.345819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.345982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.346237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.346483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.346738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.346901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.347041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.347292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.347495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.347775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.347887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.347993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.348289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.348519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.348751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.348929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.349092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.349249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.349273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.349413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.349492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.349516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.349613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.349751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.349776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.349927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.350168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.350438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.350644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.350796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.350939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.351086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.351110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.351278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.351389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.351414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.351516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.351669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.571 [2024-07-12 12:41:08.351696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.571 qpair failed and we were unable to recover it. 00:27:14.571 [2024-07-12 12:41:08.351848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.352111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.352436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.352690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.352800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.352919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.353160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.353491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.353727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.353911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.354036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.354333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.354562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.354815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.354961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.355076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.355305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.355544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.355768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.355905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.355993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.356223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.356477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.356699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.356804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.356900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.357140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.357373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.357608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.357853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.357985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.358096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.358304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.358526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.358738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.358849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.358975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.359063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.359087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.572 [2024-07-12 12:41:08.359209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.359325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.572 [2024-07-12 12:41:08.359348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.572 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.359436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.359520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.359544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.359688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.359805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.359831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.359930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.360159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.360389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.360675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.360793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.360938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.361188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.361413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.361612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.361843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.361982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.362096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.362317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.362515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.362735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.362842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.362964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.363144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.363362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.363581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.363768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.363904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.364018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.364182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.364216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.364399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.364511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.364540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.364690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.364794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.364823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.364982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.365100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.365137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.365314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.365433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.365468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.365603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.365733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.365762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.573 qpair failed and we were unable to recover it. 00:27:14.573 [2024-07-12 12:41:08.365902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.573 [2024-07-12 12:41:08.366038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.366166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.366463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.366689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.366827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.366946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.367183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.367415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.367700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.367811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.367918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.368203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.368477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.368707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.368852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.368968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.369218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.369461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.369703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.369835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.369942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.370146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.370418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.370693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.370837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.370957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.371179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.371453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.371675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.371792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.371919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.372149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.372392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.372628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.372772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.372881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.373017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.373041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.373145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.373250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.373275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.373443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.373539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.574 [2024-07-12 12:41:08.373566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.574 qpair failed and we were unable to recover it. 00:27:14.574 [2024-07-12 12:41:08.373654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.373772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.373799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.373945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.374204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.374418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.374698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.374871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.374966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.375174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.375392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.375622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.375876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.375985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.376125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.376329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.376607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.376905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.376990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.377161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.377432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.377633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.377797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.377942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.378202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.378451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.378656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.378822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.378907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.379219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.379495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.379768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.379915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.380035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.380301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.380544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.380743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.380886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.381015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.381105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.381129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.381238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.381311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.575 [2024-07-12 12:41:08.381335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.575 qpair failed and we were unable to recover it. 00:27:14.575 [2024-07-12 12:41:08.381456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.381591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.381616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.381724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.381811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.381837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.381951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.382218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.382478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.382719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.382842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.382936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.383173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.383362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.383664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.383918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.383994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.384127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.384333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.384554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.384803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.384954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.385148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.385404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.385628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.385826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.385973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.386056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.386265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.386488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.386839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.386952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.387054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.387330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.387517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.387845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.387968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.388059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.388305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.388630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.576 qpair failed and we were unable to recover it. 00:27:14.576 [2024-07-12 12:41:08.388837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.576 [2024-07-12 12:41:08.388932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.388957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.389037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.389268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.389490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.389720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.389835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.389943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.390203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.390385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.390607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.390819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.390968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.391113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.391341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.391567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.391789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.391934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.392049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.392285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.392539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.392742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.392896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.392980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.393224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.393437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.393666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.393771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.393886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.394122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.394353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.394628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.394878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.394981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.395068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.395152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.395176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.577 [2024-07-12 12:41:08.395256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.395371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.577 [2024-07-12 12:41:08.395396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.577 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.395491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.395580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.395612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.395726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.395848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.395881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.395963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.396221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.396408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.396698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.396915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.397032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.397257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.397492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.397689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.397819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.397936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.398161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.398391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.398675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.398781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.398861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.399154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.399391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.399605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.399832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.399948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.400049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.400328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.400541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.400744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.400916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.401039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.401275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.401502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.401841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.401983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.402008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.402104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.402192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.402216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.578 qpair failed and we were unable to recover it. 00:27:14.578 [2024-07-12 12:41:08.402407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.402550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.578 [2024-07-12 12:41:08.402574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.402692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.402797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.402821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.402915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.403161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.403443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.403645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.403848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.403957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.404152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.404342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.404594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.404831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.404947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.405038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.405282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.405510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.405724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.405939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.406021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.406332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.406587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.406846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.406961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.407082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.407348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.407580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.407828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.407970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.408063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.408307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.408571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.408814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.408957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.409040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.409295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.409575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.409797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.409918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.579 qpair failed and we were unable to recover it. 00:27:14.579 [2024-07-12 12:41:08.410007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.410116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.579 [2024-07-12 12:41:08.410140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.410332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.410507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.410534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.410682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.410833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.410860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.411002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.411113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.411137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.411316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.411461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.411488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.411699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.411815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.411840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.412005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.412310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.412548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.412769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.412901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.413011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.413238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.413463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.413683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.413811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.413936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.414184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.414383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.414574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.414836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.414953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.415071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.415297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.415556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.415777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.415924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.416027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.416263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.416529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.416784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.416914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.417005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.417210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.417415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.417702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.417816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.580 qpair failed and we were unable to recover it. 00:27:14.580 [2024-07-12 12:41:08.417911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.580 [2024-07-12 12:41:08.418024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.418136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.418332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.418590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.418835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.418964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.419059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.419283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.419562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.419817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.419924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.420022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.420217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.420442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.420668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.420786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.420909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.421118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.421369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.421576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.421802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.421926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.422048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.422373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.422643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.422894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.422994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.423132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.423324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.423536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.423766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.423906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.424020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.424129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.424153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.424238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.424325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.424354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.424478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.424598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.581 [2024-07-12 12:41:08.424624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.581 qpair failed and we were unable to recover it. 00:27:14.581 [2024-07-12 12:41:08.424713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.424901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.424926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.864 qpair failed and we were unable to recover it. 00:27:14.864 [2024-07-12 12:41:08.425010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.864 qpair failed and we were unable to recover it. 00:27:14.864 [2024-07-12 12:41:08.425259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.864 qpair failed and we were unable to recover it. 00:27:14.864 [2024-07-12 12:41:08.425482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.864 qpair failed and we were unable to recover it. 00:27:14.864 [2024-07-12 12:41:08.425705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.864 [2024-07-12 12:41:08.425788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.425812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.425911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.425990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.426141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.426338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.426597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.426831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.426984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.427077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.427275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.427487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.427694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.427835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.427971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.428239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.428440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.428651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.428850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.428975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.429068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.429193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.429219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.429340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.429432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.429477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.429615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.429780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.429807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.429908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.430034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.430062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.430248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.430404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.430432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.430610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.430766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.430792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.430999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.431291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.431571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.431879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.431991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.432071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.432324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.432522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.432742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.432846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.865 qpair failed and we were unable to recover it. 00:27:14.865 [2024-07-12 12:41:08.432971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.865 [2024-07-12 12:41:08.433062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.433178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.433400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.433726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.433834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.433947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.434235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.434462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.434685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.434891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.434982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.435134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.435389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.435579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.435859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.435978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.436118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.436419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.436675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.436841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.436954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.437149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.437379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.437641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.437847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.437957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.438087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.438326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.438554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.438806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.438943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.439084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.439289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.439563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.439813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.439973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.440067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.440154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.440178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.440302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.440415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.866 [2024-07-12 12:41:08.440439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.866 qpair failed and we were unable to recover it. 00:27:14.866 [2024-07-12 12:41:08.440525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.440613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.440637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.440718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.440807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.440831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.440923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.441152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.441377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.441591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.441823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.441941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.442030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.442256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.442482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.442771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.442912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.443032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.443181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.443206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.443286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.443422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.443449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.443599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.443709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.443751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.443921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.444145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.444409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.444691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.444808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.444917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.445154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.445444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.445684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:14.867 qpair failed and we were unable to recover it. 00:27:14.867 [2024-07-12 12:41:08.445914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.867 [2024-07-12 12:41:08.445997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.446107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.446339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.446566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.446790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.446936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.447022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.447238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.447460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.447719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.447857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.447947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.448156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.448418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.448631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.448775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.448897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.449181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.449513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.449766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.449923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.450007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.450116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.450140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.450231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.450348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.450372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.868 [2024-07-12 12:41:08.450518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.450601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.868 [2024-07-12 12:41:08.450626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.868 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.450714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.450825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.450849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.451003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.451146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.451170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.451266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.451433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.451460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.451588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.451725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.451749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.451878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.452167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.452504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.452779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.452965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.453062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.453338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.453599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.453850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.453960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.454043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.454278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.454496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.454693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.454804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.454926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.455131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.455382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.869 qpair failed and we were unable to recover it. 00:27:14.869 [2024-07-12 12:41:08.455621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.869 [2024-07-12 12:41:08.455773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.455923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.456181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.456437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.456734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.456923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.457063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.457282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.457516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.457816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.457975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.458093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.458234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.458258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.458366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.458473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.458497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.458623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.458754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.458781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.458897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.459009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.459033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.459117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.459233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.459257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.870 [2024-07-12 12:41:08.459339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.459446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.870 [2024-07-12 12:41:08.459470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.870 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.459614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.459781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.459806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.459955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.460190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.460478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.460794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.460979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.461106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.461280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.461307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.461433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.461559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.461586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.461734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.461859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.461892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.461991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.462259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.462506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.462783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.462906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.463083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.463227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.463254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.463385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.463507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.463532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.463681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.463793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.463819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.463974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.464191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.464450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.464669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.871 qpair failed and we were unable to recover it. 00:27:14.871 [2024-07-12 12:41:08.464905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.871 [2024-07-12 12:41:08.464997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.465096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.465414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.465723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.465841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.465959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.466100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.466125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.466316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.466467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.466494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.466654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.466750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.466792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.466932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.467144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.467443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.467737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.467933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.468075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.468334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.468519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.468756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.468924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.469041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.469257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.469491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.469766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.469911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.469996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.470114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.470154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.872 qpair failed and we were unable to recover it. 00:27:14.872 [2024-07-12 12:41:08.470328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.872 [2024-07-12 12:41:08.470454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.470481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.470570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.470660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.470686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.470819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.470962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.470986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.471083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.471216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.471242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.471383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.471479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.471503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.471616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.471774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.471801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.471932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.472204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.472453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.472695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.472801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.472962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.473284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.473526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.473815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.473985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.474132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.474238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.474264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.474389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.474514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.474540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.474668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.474781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.474804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.474909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.475112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.475403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.873 qpair failed and we were unable to recover it. 00:27:14.873 [2024-07-12 12:41:08.475683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.873 [2024-07-12 12:41:08.475808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.475834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.475988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.476214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.476408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.476684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.476807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.476955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.477179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.477501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.477792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.477974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.478061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.478258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.478528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.478777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.478936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.479050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.479180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.479218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.479319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.479444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.479471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.479599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.479705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.479732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.479829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.480138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.480385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.480678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.480806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.480960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.481107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.874 [2024-07-12 12:41:08.481131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.874 qpair failed and we were unable to recover it. 00:27:14.874 [2024-07-12 12:41:08.481265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.481361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.481401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.481523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.481682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.481709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.481852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.481991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.482113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.482435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.482734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.482852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.482965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.483228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.483511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.483740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.483878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.484013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.484231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.484516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.484795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.484956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.485034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.485328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.485545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.485790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.485934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.486053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.486147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.486171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.486343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.486461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.486486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.486574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.486716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.875 [2024-07-12 12:41:08.486740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.875 qpair failed and we were unable to recover it. 00:27:14.875 [2024-07-12 12:41:08.486851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.487170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.487476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.487724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.487880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.488009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.488232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.488521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.488767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.488917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.489007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.489286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.489520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.489852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.489991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.490131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.490278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.490305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.490457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.490581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.490607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.490732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.490882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.490924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.491014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.491126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.876 [2024-07-12 12:41:08.491167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.876 qpair failed and we were unable to recover it. 00:27:14.876 [2024-07-12 12:41:08.491268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.491424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.491447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.491538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.491651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.491675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.491807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.491897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.491937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.492086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.492318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.492585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.492891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.492992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.493153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.493433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.493699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.493883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.494013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.494099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.494123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.494235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.494361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.494387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.494545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.494716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.494742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.494875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.495124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.495447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.495771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.495913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.496015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.496242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.496459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.496676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.496840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.496977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.497218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.497473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.877 qpair failed and we were unable to recover it. 00:27:14.877 [2024-07-12 12:41:08.497765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.877 [2024-07-12 12:41:08.497860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.497909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.498004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.498261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.498516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.498833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.498993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.499115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.499211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.499237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.499395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.499517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.499544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.499729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.499878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.499903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.500042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.500243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.500557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.500795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.500913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.501069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.501295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.501542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.501841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.501999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.502109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.502225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.502250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.502358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.502494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.502518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.502649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.502803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.502833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.503001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.503305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.503540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.503806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.503914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.503996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.504247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.504472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.504709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.504817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.505063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.505176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.505216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.505353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.505491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.878 [2024-07-12 12:41:08.505516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.878 qpair failed and we were unable to recover it. 00:27:14.878 [2024-07-12 12:41:08.505650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.505782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.505809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.505973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.506194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.506407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.506666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.506820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.506971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.507249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.507558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.507774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.507890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.508007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.508235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.508492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.508764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.508959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.509073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.509317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.509510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.509774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.509934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.510043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.510154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.510178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.510314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.510445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.510469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.510586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.510745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.510772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.510893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.511225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.511472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.511745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.511916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.512055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.512347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.512634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.512814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.512958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.513101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.513272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.513298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.513441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.513530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.513554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.879 qpair failed and we were unable to recover it. 00:27:14.879 [2024-07-12 12:41:08.513691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.513838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.879 [2024-07-12 12:41:08.513871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.513981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.514233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.514472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.514721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.514862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.514984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.515245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.515479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.515822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.515990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.516081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.516312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.516568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.516783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.516971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.517091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.517376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.517649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.517859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.517982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.518086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.518350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.518580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.518877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.518988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.519146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.519236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.519262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.519386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.519540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.519567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.519725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.519874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.519899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.520015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.520243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.520554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.520784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.520915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.521021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.521127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.521151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.521293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.521387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.521411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.521492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.521585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.880 [2024-07-12 12:41:08.521610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.880 qpair failed and we were unable to recover it. 00:27:14.880 [2024-07-12 12:41:08.521764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.521879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.521904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.522018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.522323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.522587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.522860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.522972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.523093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.523320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.523595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.523888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.523986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.524122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.524428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.524766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.524968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.525063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.525166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.525192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.525331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.525477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.525501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.525592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.525758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.525784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.525935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.526138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.526414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.526658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.526777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.526910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.527162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.527455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.527767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.527943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.528025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.528156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.528183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.528282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.528415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.528439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.881 qpair failed and we were unable to recover it. 00:27:14.881 [2024-07-12 12:41:08.528559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.881 [2024-07-12 12:41:08.528666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.528690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.528802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.528956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.528981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.529102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.529237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.529263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.529428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.529532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.529556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.529694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.529800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.529823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.529985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.530176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.530415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.530697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.530814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.530950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.531180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.531441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.531667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.531814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.531911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.532158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.532468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.532698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.532890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.533044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.533203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.533229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.533374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.533484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.533507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.533599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.533708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.533734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.533889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.534194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.534440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.534684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.534859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.535001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.535214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.535472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.535815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.535930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.536074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.536154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.536194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.536363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.536505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.536528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.536736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.536869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.882 [2024-07-12 12:41:08.536900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.882 qpair failed and we were unable to recover it. 00:27:14.882 [2024-07-12 12:41:08.537115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.537254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.537293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.537457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.537564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.537588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.537758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.537891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.537935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.538080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.538339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.538572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.538831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.538970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.539115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.539247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.539273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.539400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.539531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.539558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.539685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.539833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.539864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.540005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.540288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.540534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.540831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.540995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.541131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.541358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.541646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.541795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.541927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.542156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.542426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.542685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.542860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.542999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.543289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.543542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.543803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.543970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.544066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.544269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.544564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.544805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.544938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.545050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.545128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.545152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.883 qpair failed and we were unable to recover it. 00:27:14.883 [2024-07-12 12:41:08.545287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.883 [2024-07-12 12:41:08.545404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.545430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.545583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.545728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.545754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.545902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.545993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.546100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.546291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.546637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.546788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.546923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.547124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.547340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.547644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.547805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.547925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.548141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.548369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.548656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.548777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.548941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.549170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.549387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.549597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.549841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.549986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.550131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.550420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.550685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.550831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.550981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.551267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.551540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.551832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.551978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.552085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.552337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.552585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.552873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.552984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.553072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.553178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.884 [2024-07-12 12:41:08.553205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.884 qpair failed and we were unable to recover it. 00:27:14.884 [2024-07-12 12:41:08.553309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.553435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.553461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.553568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.553657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.553680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.553764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.553920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.553945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.554059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.554251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.554469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.554695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.554853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.554970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.555225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.555432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.555696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.555892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.556061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.556150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.556174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.556296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.556411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.556453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.556579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.556824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.556850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.557016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.557326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.557612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.557799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.557966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.558053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.558276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.558528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.558843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.558996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.559112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.559221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.559246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.559382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.559470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.559496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.559648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.559799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.559826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.559963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.560078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.885 [2024-07-12 12:41:08.560102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.885 qpair failed and we were unable to recover it. 00:27:14.885 [2024-07-12 12:41:08.560231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.560355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.560382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.560468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.560595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.560622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.560729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.560876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.560904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.561062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.561153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.561177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.561323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.561457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.561499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.561620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.561763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.561787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.561917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.562227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.562474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.562729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.562920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.563048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.563203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.563229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.563394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.563532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.563575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.563722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.563839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.563871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.564007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.564297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.564542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.564799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.564988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.565062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.565306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.565540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.565829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.565993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.566112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.566387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.566629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.566850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.566982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.567081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.567318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.567587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.567809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.567967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.568054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.568169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.568192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.886 qpair failed and we were unable to recover it. 00:27:14.886 [2024-07-12 12:41:08.568303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.886 [2024-07-12 12:41:08.568391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.568418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.568544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.568664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.568690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.568807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.568907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.568931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.569045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.569306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.569603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.569863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.569997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.570134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.570222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.570245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.570361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.570469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.570492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.570607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.570707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.570734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.570907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.571163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.571366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.571642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.571783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.571907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.572134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.572440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.572758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.572887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.573008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.573122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.573160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.573266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.573416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.573443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.573574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.573682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.573706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.573844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.574141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.574372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.574620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.574743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.574881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.575157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.575431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.575741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.575928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.576044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.576191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.576214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.576376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.576470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.887 [2024-07-12 12:41:08.576495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.887 qpair failed and we were unable to recover it. 00:27:14.887 [2024-07-12 12:41:08.576646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.576781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.576805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.576958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.577215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.577514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.577795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.577916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.578008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.578284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.578545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.578828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.578998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.579115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.579247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.579273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.579384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.579479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.579503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.579614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.579720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.579759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.579895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.580193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.580457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.580786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.580924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.581011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.581296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.581606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.581828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.581993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.582097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.582324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.582567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.582791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.582947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.583069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.583176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.583208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.583344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.583489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.583514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.583640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.583771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.583797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.583929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.584171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.584483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.888 [2024-07-12 12:41:08.584723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.888 [2024-07-12 12:41:08.584879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.888 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.585039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.585153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.585178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.585324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.585439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.585462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.585621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.585745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.585771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.585920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.586232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.586486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.586786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.586987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.587078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.587231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.587258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.587411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.587496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.587522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.587653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.587825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.587851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.587994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.588242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.588499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.588734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.588862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.589001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.589227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.589464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.589717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.589858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.589987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.590260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.590525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.590820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.590989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.591110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.591196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.591237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.591389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.591522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.591546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.591713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.591874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.591917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.592033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.592256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.592471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.592766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.592902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.592988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.593129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.593169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.889 qpair failed and we were unable to recover it. 00:27:14.889 [2024-07-12 12:41:08.593309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.889 [2024-07-12 12:41:08.593421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.593444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.593543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.593634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.593661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.593799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.593913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.593938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.594077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.594185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.594209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.594339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.594439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.594468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.594628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.594773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.594799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.594929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.595230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.595485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.595752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.595931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.596048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.596173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.596199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.596296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.596457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.596484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.596616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.596738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.596765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.596852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.597178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.597441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.597695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.597842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.598037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.598354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.598582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.598826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.598993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.599101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.599213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.599236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.599356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.599455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.599497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.599613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.599754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.599780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.599911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.600002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.600026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.600147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.600276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.600303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.890 qpair failed and we were unable to recover it. 00:27:14.890 [2024-07-12 12:41:08.600435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.890 [2024-07-12 12:41:08.600531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.600557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.600751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.600875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.600916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.601055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.601135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.601159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.601324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.601413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.601440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.601576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.601720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.601744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.601897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.602208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.602469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.602757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.602926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.603060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.603191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.603232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.603342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.603479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.603503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.603660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.603782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.603809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.603964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.604241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.604467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.604722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.604885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.604996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.605244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.605476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.605683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.605838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.605949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.606152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.606388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.606589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.606842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.606973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.607057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.607251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.607504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.607746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.607863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.607974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.608070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.608095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.891 [2024-07-12 12:41:08.608212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.608330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.891 [2024-07-12 12:41:08.608354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.891 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.608496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.608578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.608602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.608711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.608795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.608836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.608961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.609210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.609443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.609667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.609898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.609986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.610118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.610334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.610573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.610807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.610925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.611072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.611301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.611502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.611728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.611930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.612016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.612240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.612475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.612741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.612913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.613001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.613228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.613478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.613708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.613846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.613961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.614209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.614424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.614671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.614789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.614924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.615126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.615325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.892 qpair failed and we were unable to recover it. 00:27:14.892 [2024-07-12 12:41:08.615554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.892 [2024-07-12 12:41:08.615637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.615661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.615750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.615839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.615862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.615959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.616163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.616363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.616597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.616795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.616957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.617048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.617274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.617540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.617834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.617961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.618050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.618338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.618559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.618761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.618913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.619006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.619254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.619459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.619701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.619805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.619923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.620167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.620415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.620677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.620842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.620953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.621182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.621425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.621654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.621764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.621884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.622146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.622452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.622781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.893 [2024-07-12 12:41:08.622941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.893 qpair failed and we were unable to recover it. 00:27:14.893 [2024-07-12 12:41:08.623031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.623230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.623473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.623792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.623963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.624104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.624292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.624330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.624508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.624637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.624664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.624821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.624944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.624977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.625124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.625274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.625311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.625454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.625636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.625681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.625839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.625999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.626127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.626395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.626607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.626835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.626976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.627064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.627150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.627173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.627259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.627388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.627422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.627567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.627672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.627706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.627815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.628189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.628526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.628845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.628987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.629020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.629160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.629341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.629371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.629528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.629695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.629721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.629880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.629997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.630022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.630154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.630306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.630350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.630457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.630550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.894 [2024-07-12 12:41:08.630577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.894 qpair failed and we were unable to recover it. 00:27:14.894 [2024-07-12 12:41:08.630691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.630810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.630838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.630948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.631179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.631467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.631713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.631858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.631978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.632115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.632144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.632300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.632434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.632464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.632610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.632722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.632749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.632955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.633263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.633529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.633733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.633880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.633972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.634114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.634140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.634267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.634390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.634416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.634616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.634735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.634760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.634957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.635251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.635529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.635764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.635918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.636063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.636202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.636246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.636372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.636498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.636529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.636649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.636794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.636821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.636955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.637228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.637471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.637738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.637888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.638093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.638358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.638566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.638851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.638975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.639004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.895 qpair failed and we were unable to recover it. 00:27:14.895 [2024-07-12 12:41:08.639094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.895 [2024-07-12 12:41:08.639294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.639323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.639417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.639560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.639586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.639706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.639836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.639862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.639995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.640273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.640500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.640736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.640851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.640947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.641261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.641509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.641718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.641833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.641960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.642194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.642519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.642782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.642912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.643022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.643250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.643538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.643835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.643982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.644094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.644184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.644208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.644341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.644433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.644459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.644585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.644740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.644766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.644877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.645124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.645401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.645678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.645812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.645936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.646180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.646382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.646583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.646835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.896 [2024-07-12 12:41:08.646945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.896 qpair failed and we were unable to recover it. 00:27:14.896 [2024-07-12 12:41:08.647060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.647374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.647633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.647889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.647993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.648140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.648396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.648628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.648808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.648931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.649161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.649392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.649631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.649809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.649911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.650189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.650392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.650681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.650808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.650929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.651133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.651413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.651692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.651892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.651996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.652128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.652392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.652645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.652904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.652986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.653123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.653372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.653614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.653780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.653933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.654135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.654392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.897 [2024-07-12 12:41:08.654627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.897 [2024-07-12 12:41:08.654764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.897 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.654882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.654970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.654994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.655091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.655314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.655548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.655840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.655956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.656069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.656266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.656519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.656737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.656884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.656998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.657216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.657477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.657756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.657937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.658031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.658253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.658501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.658789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.658933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.659024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.659264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.659484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.659713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.659819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.659953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.660176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.660435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.660651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.660898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.660990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.661014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.898 [2024-07-12 12:41:08.661111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.661194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.898 [2024-07-12 12:41:08.661218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.898 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.661339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.661440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.661464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.661550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.661632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.661656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.661740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.661831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.661855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.661971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.662217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.662443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.662671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.662811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.662926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.663121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.663338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.663581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.663775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.663962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.664079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.664330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.664554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.664788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.664904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.664989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.665189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.665427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.665645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.665808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.665896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.666128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.666344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.666564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.666782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.666961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.667083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.667326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.667541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.667826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.667940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.899 [2024-07-12 12:41:08.668020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.668102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.899 [2024-07-12 12:41:08.668127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.899 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.668246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.668327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.668352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.668459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.668572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.668596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.668712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.668819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.668843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.668962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.669157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.669390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.669627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.669819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.669923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.670005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.670199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.670420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.670648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.670904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.670996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.671132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.671357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.671579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.671769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.671879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.671994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.672220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.672505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.672749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.672879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.673005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.673221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.673417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.673615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.673830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.673940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.674050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.674245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.674464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.674686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.900 qpair failed and we were unable to recover it. 00:27:14.900 [2024-07-12 12:41:08.674896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.900 [2024-07-12 12:41:08.674992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.675109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.675387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.675579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.675803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.675940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.676063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.676249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.676462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.676711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.676912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.676995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.677099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.677346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.677576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.677850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.677994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.678099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.678293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.678548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.678737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.678910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.679042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.679322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.679520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.679842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.679952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.680096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.680328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.680556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.680815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.680982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.681097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.681289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.681489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.681673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.681780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.681906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.682004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.901 [2024-07-12 12:41:08.682028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.901 qpair failed and we were unable to recover it. 00:27:14.901 [2024-07-12 12:41:08.682123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.682361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.682612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.682853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.682994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.683080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.683279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.683466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.683713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.683915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.683998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.684107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.684305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.684530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.684771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.684884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.684978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.685229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.685449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.685640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.685881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.685992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.686080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.686291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.686587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.686831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.686994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.687082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.687308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.687518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.687746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.687853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.687974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.688232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.688453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.688686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.902 [2024-07-12 12:41:08.688889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.902 [2024-07-12 12:41:08.688991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.902 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.689074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.689310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.689538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.689739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.689872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.689989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.690212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.690429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.690646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.690861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.690981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.691062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.691287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.691517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.691775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.691913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.692063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.692294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.692487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.692707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.692852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.692966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.693241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.693434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.693654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.693766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.693892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.694169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.694417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.694619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.903 qpair failed and we were unable to recover it. 00:27:14.903 [2024-07-12 12:41:08.694845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.903 [2024-07-12 12:41:08.694954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.695064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.695316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.695569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.695807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.695941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.696054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.696231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.696451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.696693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.696830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.696953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.697169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.697360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.697583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.697802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.697945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.698063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.698262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.698495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.698746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.698849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.698938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.699149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.699373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.699563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.699728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.700042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.700247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.700494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.700787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.700925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.701064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.701326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.701580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.701819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.701984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.702101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.702226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.702253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.904 qpair failed and we were unable to recover it. 00:27:14.904 [2024-07-12 12:41:08.702359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.904 [2024-07-12 12:41:08.702476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.702500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.702610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.702767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.702791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.702912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.702995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.703139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.703355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.703651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.703798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.703942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.704277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.704541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.704845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.704984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.705099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.705269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.705310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.705429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.705560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.705587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.705695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.705851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.705900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.706009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.706155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.706196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.706295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.706457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.706484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.706630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.706782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.706805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.706990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.707257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.707542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.707767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.707909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.708023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.708279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.708540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.708789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.708920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.709071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.709189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.709213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.709349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.709504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.709531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.709657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.709782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.709809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.709944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.710202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.710435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.905 qpair failed and we were unable to recover it. 00:27:14.905 [2024-07-12 12:41:08.710731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.905 [2024-07-12 12:41:08.710841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.710871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.710985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.711307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.711549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.711811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.711928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.712008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.712213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.712462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.712677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.712817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.712915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.713185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.713386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.713611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.713858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.713966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.714059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.714309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.714538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.714798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.714926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.715021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.715237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.715451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.715638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.715847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.715999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.716086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.716196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.716221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.716381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.716467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.716494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.716630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.716734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.716774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.716892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.717118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.717446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.717744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.717892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.717983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.718087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.906 [2024-07-12 12:41:08.718111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.906 qpair failed and we were unable to recover it. 00:27:14.906 [2024-07-12 12:41:08.718299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.718414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.718441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.718634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.718756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.718797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.718926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.719205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.719492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.719771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.719932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.720033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.720149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.720173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.720378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.720489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.720513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.720657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.720784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.720810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.720958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.721174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.721410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.721633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.721762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.721901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.722134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.722422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.722759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.722905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.722998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.723253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.723520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.723766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.723952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.724067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.724372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.724645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.724861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.724982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.725006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.725148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.725230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.725254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.907 qpair failed and we were unable to recover it. 00:27:14.907 [2024-07-12 12:41:08.725409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.907 [2024-07-12 12:41:08.725526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.725552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.725673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.725766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.725793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.725905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.726130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.726419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.726761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.726955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.727038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.727352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.727630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.727882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.727989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.728078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.728338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.728573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.728802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.728935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.729025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.729264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.729512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.729817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.729937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.730058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.730275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.730525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.730766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.730887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.731006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.731245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.731471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.731706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.731826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.731945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.732256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.732526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.732753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.732850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.732937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.733203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.733457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.908 [2024-07-12 12:41:08.733740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.908 [2024-07-12 12:41:08.733861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.908 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.733979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.734303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.734504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.734799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.734973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.735056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.735316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.735518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.735754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.735884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.735993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.736319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.736573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.736822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.736971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.737059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.737251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.737474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.737783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.737948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.738025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.738211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.738236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.738374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.738481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.738508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.738647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.738797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.738824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.738939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.739207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.739419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.739730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.739928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.740047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.740205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.740232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.740385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.740519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.740543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.740659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.740742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.740767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.740907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.741152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.741410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.741646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.741822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.741937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.742055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.742081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.742182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.742294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.742318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.909 qpair failed and we were unable to recover it. 00:27:14.909 [2024-07-12 12:41:08.742412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.909 [2024-07-12 12:41:08.742487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.742511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.742630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.742770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.742797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.742932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.743168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.743436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.743726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.743891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.744047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.744396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.744614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.744848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.744983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.745163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.745420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.745699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.745857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.746017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.746320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.746564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.746795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.746988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.747082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.747183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.747207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.747322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.747469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.747496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.747660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.747782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.747806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.747946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.748162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.748461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.748762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.748923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.749072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.749207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.749234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.910 [2024-07-12 12:41:08.749353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.749482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.910 [2024-07-12 12:41:08.749506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.910 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.749614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.749717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.749741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.749898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.750194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.750450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.750740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.750872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.751023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.751298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.751492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.751736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.751903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.752008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.752306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.752555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.752815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.752954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.753068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.753320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.753599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.753808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.753995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.754107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.754348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.754563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.754782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.754918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.755025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.755139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.755163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.755290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.755427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.911 [2024-07-12 12:41:08.755452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.911 qpair failed and we were unable to recover it. 00:27:14.911 [2024-07-12 12:41:08.755561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.755662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.755688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.755796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.755939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.755966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.756113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.756239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.756270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.756431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.756549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.756576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.756689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.756773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.756799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.756950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.757275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.757550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.757740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.757861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.757998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.758238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.758434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.758747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.758878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.759020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.759217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.759484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.759738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.759859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.759991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.760102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.760126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:14.912 qpair failed and we were unable to recover it. 00:27:14.912 [2024-07-12 12:41:08.760237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:14.912 [2024-07-12 12:41:08.760358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.760384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.760508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.760651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.760676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.760758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.760846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.760877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.760959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.761168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.761368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.761591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.761857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.761980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.762005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.762092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.762179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.762207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.190 [2024-07-12 12:41:08.762389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.762515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.190 [2024-07-12 12:41:08.762544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.190 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.762688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.762799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.762823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.762971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.763210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.763437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.763663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.763807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.763949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.764331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.764527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.764753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.764939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.765049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.765324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.765571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.765844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.765987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.766079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.766296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.766582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.766836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.766971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.767058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.767318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.767499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.767818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.767988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.768104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.768215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.768239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.768327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.768434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.768458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.768599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.768755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.768782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.768919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.769165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.769405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.769683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.769826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.769925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.770010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.770034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.770127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.770204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.191 [2024-07-12 12:41:08.770228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.191 qpair failed and we were unable to recover it. 00:27:15.191 [2024-07-12 12:41:08.770346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.770424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.770448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.770574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.770673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.770700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.770824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.770959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.770984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.771070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.771310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.771539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.771848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.771981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.772070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.772282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.772505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.772758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.772875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.772987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.773263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.773535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.773750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.773895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.774027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.774265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.774542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.774815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.774966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.775053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.775129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.775153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.775272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.775405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.775431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.775601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.775744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.775783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.775929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.776201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.776467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.776754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.776920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.777080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.777215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.777239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.777396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.777474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.777498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.777672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.777779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.777802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.777949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.778072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.778097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.192 [2024-07-12 12:41:08.778238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.778375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.192 [2024-07-12 12:41:08.778416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.192 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.778540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.778668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.778695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.778824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.778936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.778961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.779043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.779301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.779608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.779839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.779973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.780091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.780400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.780644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.780878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.780996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.781143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.781361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.781606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.781806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.781988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.782131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.782211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.782235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.782357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.782466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.782512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.782672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.782843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.782871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.783017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.783286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.783531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.783755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.783864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.784025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.784281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.784500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.784771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.784940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.785056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.785149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.785174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.785302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.785416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.785440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.785581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.785736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.785762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.785856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.786021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.786047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.786187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.786294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.786318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.193 qpair failed and we were unable to recover it. 00:27:15.193 [2024-07-12 12:41:08.786435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.193 [2024-07-12 12:41:08.786547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.786571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.786715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.786853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.786886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.787029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.787174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.787198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.787325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.787482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.787509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.787612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.787765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.787792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.787911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.788192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.788483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.788778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.788919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.789036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.789299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.789571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.789842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.789951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.790064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.790360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.790646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.790895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.790999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.791119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.791315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.791590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.791819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.791919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.792034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.792235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.792461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.792721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.792848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.792969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.793052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.793076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.793193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.793311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.793335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.793471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.793598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.194 [2024-07-12 12:41:08.793625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.194 qpair failed and we were unable to recover it. 00:27:15.194 [2024-07-12 12:41:08.793722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.793846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.793879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.793979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.794279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.794558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.794768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.794899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.795004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.795282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.795583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.795814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.795959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.796052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.796350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.796606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.796840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.796977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.797091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.797329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.797602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.797883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.797998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.798145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.798401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.798613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.798800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.798935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.799053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.799215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.799242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.799383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.799497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.799523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.799638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.799803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.799828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.799920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.800201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.800434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.195 [2024-07-12 12:41:08.800654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.195 [2024-07-12 12:41:08.800819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.195 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.800936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.801235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.801571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.801800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.801940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.802108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.802385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.802629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.802863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.802995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.803134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.803442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.803714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.803831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.803996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.804222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.804450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.804731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.804891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.805023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.805146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.805170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.805320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.805434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.805458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.805594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.805759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.805783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.805903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.806204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.806454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.806683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.806820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.806940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.807176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.807425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.807695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.807837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.807975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.808175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.808381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.808691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.808798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.196 [2024-07-12 12:41:08.808940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.809049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.196 [2024-07-12 12:41:08.809074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.196 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.809183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.809268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.809296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.809435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.809522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.809549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.809712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.809822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.809847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.809980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.810287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.810563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.810804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.810948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.811048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.811304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.811527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.811808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.811946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.812051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.812299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.812547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.812818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.812991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.813105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.813211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.813251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.813395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.813555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.813581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.813710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.813877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.813920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.814013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.814295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.814562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.814794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.814962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.815079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.815212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.815239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.815343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.815456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.815481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.815557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.815721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.815761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.815911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.816175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.816428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.816677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.816900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.816985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.817009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.197 qpair failed and we were unable to recover it. 00:27:15.197 [2024-07-12 12:41:08.817115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.197 [2024-07-12 12:41:08.817255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.817282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.817427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.817574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.817598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.817737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.817824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.817849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.817970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.818200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.818470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.818761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.818892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.818990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.819273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.819523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.819823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.819986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.820130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.820411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.820672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.820839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.820977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.821257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.821510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.821726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.821859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.822012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.822303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.822516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.822774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.822946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.823076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.823312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.823524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.823830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.823989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.824078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.824277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.824503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.824750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.824920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.825064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.825195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.825222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.198 qpair failed and we were unable to recover it. 00:27:15.198 [2024-07-12 12:41:08.825384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.198 [2024-07-12 12:41:08.825505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.825536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.825704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.825829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.825854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.825975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.826260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.826485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.826776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.826939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.827029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.827277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.827523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.827795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.827929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.828073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.828309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.828578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.828876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.828985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.829066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.829333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.829573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.829813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.829949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.830064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.830176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.830217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.830362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.830487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.830511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.830626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.830702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.830742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.830908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.831164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.831382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.831693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.831812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.831958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.832054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.199 [2024-07-12 12:41:08.832078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.199 qpair failed and we were unable to recover it. 00:27:15.199 [2024-07-12 12:41:08.832170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.832303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.832330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.832415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.832564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.832591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.832705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.832786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.832810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.832931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.833246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.833528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.833785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.833925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.834044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.834309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.834555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.834850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.834985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.835102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.835338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.835598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.835874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.835981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.836126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.836256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.836283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.836387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.836468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.836495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.836655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.836789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.836816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.836960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.837184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.837438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.837694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.837802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.837930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.838210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.838503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.838739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.838859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.839024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.839270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.839501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.839740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.839887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.200 [2024-07-12 12:41:08.840006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.840111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.200 [2024-07-12 12:41:08.840136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.200 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.840295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.840410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.840435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.840522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.840638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.840662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.840797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.840894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.840922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.841047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.841185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.841209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.841328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.841404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.841428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.841559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.841691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.841718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.841878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.842175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.842465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.842698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.842807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.842953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.843221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.843545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.843780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.843970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.844112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.844266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.844290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.844407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.844544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.844571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.844705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.844829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.844854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.844973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.845212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.845516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.845725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.845897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.846014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.846273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.846502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.846741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.846905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.846987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.847244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.847587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.847856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.847997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.848091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.848188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.848215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.201 qpair failed and we were unable to recover it. 00:27:15.201 [2024-07-12 12:41:08.848377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.848536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.201 [2024-07-12 12:41:08.848563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.848712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.848832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.848856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.848977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.849293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.849559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.849752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.849949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.850068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.850351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.850604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.850851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.850967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.851108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.851324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.851531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.851778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.851905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.852039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.852344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.852651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.852890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.852991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.853118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.853384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.853626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.853870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.853992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.854158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.854389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.854683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.854863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.855007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.855245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.855546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.855796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.855963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.856053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.856143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.856167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.856253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.856370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.856394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.202 qpair failed and we were unable to recover it. 00:27:15.202 [2024-07-12 12:41:08.856483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.202 [2024-07-12 12:41:08.856610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.856636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.856753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.856832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.856857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.856992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.857241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.857453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.857685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.857824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.857971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.858155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.858386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.858647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.858836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.858952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.859064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.859255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.859473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.859701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.859831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.859931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.860235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.860434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.860676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.860795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.860966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.861239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.861464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.861661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.861913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.861999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.862107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.862335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.203 qpair failed and we were unable to recover it. 00:27:15.203 [2024-07-12 12:41:08.862617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.203 [2024-07-12 12:41:08.862750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.862845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.862966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.862990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.863108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.863311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.863528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.863759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.863897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.864015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.864256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.864457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.864709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.864846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.864960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.865230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.865508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.865741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.865860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.865964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.866237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.866467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.866686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.866791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.866904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.867154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.867454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.867688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.867818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.867927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.868145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.868370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.868634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.868812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.868953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.869245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.869529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.869776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.869913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.870037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.870187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.870211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.204 qpair failed and we were unable to recover it. 00:27:15.204 [2024-07-12 12:41:08.870325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.204 [2024-07-12 12:41:08.870422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.870449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.870542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.870639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.870666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.870768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.870853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.870885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.870986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.871207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.871451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.871681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.871799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.871923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.872131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.872339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.872640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.872877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.872986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.873123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.873346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.873587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.873829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.873947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.874059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.874258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.874514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.874776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.874935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.875056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.875293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.875568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.875841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.875976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.876097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.876316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.876604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.876833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.876973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.877083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.877193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.877217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.877301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.877454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.877482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.877579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.877666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.205 [2024-07-12 12:41:08.877693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.205 qpair failed and we were unable to recover it. 00:27:15.205 [2024-07-12 12:41:08.877776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.877917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.877942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.878034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.878247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.878490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.878765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.878885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.878969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.879222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.879478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.879721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.879842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.879957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.880148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.880444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.880694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.880819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.880946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.881175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.881402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.881616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.881878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.881993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.882131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.882396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.882671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.882889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.882991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.883104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.883351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.883567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.883815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.883969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.884058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.884262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.884515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.884722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.884844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.884958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.885045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.206 [2024-07-12 12:41:08.885069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.206 qpair failed and we were unable to recover it. 00:27:15.206 [2024-07-12 12:41:08.885164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.885293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.885320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.885417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.885542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.885569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.885658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.885746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.885773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.885864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.886111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.886317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.886502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.886756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.886873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.886982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.887202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.887465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.887696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.887864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.887995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.888186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.888418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.888689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.888839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.888978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.889219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.889488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.889757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.889875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.889962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.890185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.890446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.890676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.890820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.890974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.891167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.891442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.891684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.891815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.207 qpair failed and we were unable to recover it. 00:27:15.207 [2024-07-12 12:41:08.891931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.207 [2024-07-12 12:41:08.892025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.892141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.892387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.892624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.892827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.892963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.893075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.893272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.893528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.893763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.893892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.894011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.894260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.894480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.894741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.894908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.894986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.895213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.895433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.895658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.895772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.895860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.896157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.896414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.896659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.896802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.896913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.897144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.897341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.897538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.897747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.897856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.897972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.898218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.898468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.208 qpair failed and we were unable to recover it. 00:27:15.208 [2024-07-12 12:41:08.898668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.208 [2024-07-12 12:41:08.898764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.898790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.898942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.899139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.899379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.899628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.899781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.899926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.900123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.900373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.900576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.900797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.900910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.901021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.901239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.901480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.901775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.901914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.901997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.902248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.902464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.902671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.902782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.902902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.903216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.903484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.903758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.903886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.903972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.904200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.904399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.904662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.904894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.904983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.905117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.905322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.905572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.209 qpair failed and we were unable to recover it. 00:27:15.209 [2024-07-12 12:41:08.905789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.209 [2024-07-12 12:41:08.905917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.906003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.906204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.906445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.906684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.906838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.906947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.907178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.907409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.907625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.907848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.907992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.908108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.908324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.908632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.908783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.908891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.909105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.909347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.909568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.909786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.909899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.909989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.910242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.910471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.910691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.910875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.910980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.911213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.911400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.911646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.911788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.911880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.912131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.912356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.912671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.912818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.912937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.913012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.913037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.210 qpair failed and we were unable to recover it. 00:27:15.210 [2024-07-12 12:41:08.913143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.210 [2024-07-12 12:41:08.913251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.913357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.913594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.913882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.913992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.914078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.914312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.914547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.914749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.914854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.914984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.915213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.915410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.915630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.915786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.915928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.916139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.916353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.916556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.916804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.916902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.916981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.917223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.917516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.917792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.917976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.918060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.918331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.918557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.918799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.918941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.919030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.919264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.919486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.919734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.919845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.919932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.920044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.920068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.920157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.920267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.211 [2024-07-12 12:41:08.920291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.211 qpair failed and we were unable to recover it. 00:27:15.211 [2024-07-12 12:41:08.920372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.920483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.920507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.920618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.920701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.920725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.920878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.920977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.921082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.921339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.921619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.921858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.921998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.922085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.922303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.922534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.922755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.922863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.923015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.923260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.923473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.923715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.923834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.923998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.924184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.924405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.924618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.924753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.924877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.925159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.925375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.925623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.925779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.925889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.926150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.926401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.212 qpair failed and we were unable to recover it. 00:27:15.212 [2024-07-12 12:41:08.926654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.212 [2024-07-12 12:41:08.926786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.926813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.926956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.927144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.927362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.927583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.927786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.927965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.928081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.928299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.928528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.928788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.928955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.929042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.929288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.929516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.929797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.929912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.930023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.930205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.930470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.930678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.930843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.931006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.931123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.931176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.931286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.931454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.931502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.931626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.931823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.931849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.932003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.932160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.932204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.932330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.932446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.932472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.932588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.932734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.932762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.932859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.933170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.933387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.933609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.933895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.933983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.934008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.934170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.934296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.934325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.213 [2024-07-12 12:41:08.934414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.934528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.213 [2024-07-12 12:41:08.934555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.213 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.934644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.934736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.934764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.934903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.934995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.935111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.935349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.935611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.935814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.935955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.936049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.936298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.936596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.936844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.936997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.937092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.937342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.937622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.937829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.937958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.938070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.938342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.938599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.938891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.938996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.939133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.939359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.939658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.939896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.939988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.940101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.940344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.940575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.940820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.940956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.941049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.941261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.941503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.941847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.941994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.942018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.214 qpair failed and we were unable to recover it. 00:27:15.214 [2024-07-12 12:41:08.942114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.214 [2024-07-12 12:41:08.942246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.942372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.942634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.942861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.942991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.943088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.943319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.943550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.943785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.943899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.944013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.944274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.944496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.944722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.944881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.945017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.945288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.945498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.945746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.945877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.945960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.946181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.946377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.946626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.946906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.946998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.947106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.947360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.947560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.947764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.947908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.948024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.948208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.948446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.948645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.948886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.948993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.949017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.949100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.949181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.949205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.215 qpair failed and we were unable to recover it. 00:27:15.215 [2024-07-12 12:41:08.949295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.215 [2024-07-12 12:41:08.949380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.949404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.949481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.949615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.949641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.949748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.949863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.949910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.950032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.950253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.950475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.950792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.950953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.951030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.951256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.951463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.951697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.951838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.951954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.952156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.952358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.952619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.952746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.952889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.953140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.953393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.953611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.953842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.953977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.954123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.954371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.954643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.954789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.954925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.955127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.955367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.216 qpair failed and we were unable to recover it. 00:27:15.216 [2024-07-12 12:41:08.955556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.216 [2024-07-12 12:41:08.955638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.955661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.955745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.955821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.955845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.955967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.956193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.956478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.956719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.956857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.956981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.957210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.957483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.957715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.957837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.957988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.958241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.958487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.958764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.958891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.959016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.959227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.959481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.959755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.959910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.960025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.960254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.960498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.960805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.960943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.961023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.961269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.961511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.961817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.961973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.962087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.962282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.962479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.962784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.962924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.963001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.963087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.217 [2024-07-12 12:41:08.963112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.217 qpair failed and we were unable to recover it. 00:27:15.217 [2024-07-12 12:41:08.963235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.963326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.963366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.963492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.963566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.963590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.963673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.963809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.963836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.963984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.964243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.964492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.964718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.964833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.964949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.965169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.965405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.965668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.965813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.965953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.966244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.966481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.966725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.966843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.966990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.967248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.967497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.967725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.967856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.968006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.968234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.968448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.968739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.968907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.968988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.969217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.969433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.969686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.969818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.969964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.970293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.970630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.218 [2024-07-12 12:41:08.970842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.970994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.218 [2024-07-12 12:41:08.971019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.218 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.971113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.971224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.971248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.971414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.971553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.971577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.971719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.971858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.971935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.972015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.972267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.972480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.972758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.972920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.973011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.973281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.973538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.973824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.973952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.974099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.974224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.974251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.974352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.974482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.974509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.974612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.974750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.974777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.974944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.975172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.975444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.975771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.975975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.976086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.976272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.976500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.976728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.976835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.976972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.977182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.977421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.977627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.977768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.977895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.978140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.978440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.978760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.978936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.219 qpair failed and we were unable to recover it. 00:27:15.219 [2024-07-12 12:41:08.979030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.979138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.219 [2024-07-12 12:41:08.979162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.979278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.979382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.979406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.979541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.979663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.979690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.979844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.979960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.979984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.980094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.980335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.980556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.980827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.980998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.981167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.981458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.981715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.981932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.982075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.982236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.982263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.982390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.982556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.982583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.982684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.982775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.982802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.982924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.983181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.983414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.983715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.983893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.984038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.984284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.984595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.984870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.984976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.985093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.985205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.985246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.985374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.985465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.985489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.985638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.985723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.985764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.985896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.986037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.986061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.986144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.986313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.986339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.986450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.986584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.220 [2024-07-12 12:41:08.986611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.220 qpair failed and we were unable to recover it. 00:27:15.220 [2024-07-12 12:41:08.986737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.986904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.986929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.987052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.987206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.987233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.987366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.987511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.987535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.987708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.987789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.987813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.987932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.988210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.988449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.988707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.988859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.989006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.989316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.989551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.989794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.989951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.990039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.990146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.990174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.990334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.990431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.990457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.990555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.990705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.990731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.990863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.991116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.991359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.991587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.991710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.991833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.992141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.992329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.992620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.992736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.992887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.993138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.993386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.993635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.993776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.993881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.994014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.994039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.994143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.994236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.994260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.221 [2024-07-12 12:41:08.994362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.994487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.221 [2024-07-12 12:41:08.994514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.221 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.994633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.994757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.994784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.994948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.995229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.995498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.995722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.995857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.996022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.996357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.996565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.996817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.996992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.997112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.997269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.997295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.997407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.997517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.997541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.997671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.997770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.997797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.997925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.998122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.998399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.998693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.998837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.998944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.999198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.999495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.999693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:08.999822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:08.999936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.000199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.000450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.000659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.000817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.000988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.001201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.001442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.001689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.001915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.001994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.002018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.002112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.002254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.002281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.222 [2024-07-12 12:41:09.002434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.002521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.222 [2024-07-12 12:41:09.002548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.222 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.002672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.002794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.002821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.002968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.003210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.003534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.003722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.003860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.003982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.004094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.004119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.004253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.004383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.004410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.004566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.004711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.004754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.004877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.005112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.005379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.005643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.005811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.005931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.006209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.006520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.006770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.006873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.006966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.007188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.007501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.007723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.007832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.007940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.008184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.008424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.008697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.008918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.009000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.009199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.009496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.009754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.009936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.010057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.010147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.010174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.010276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.010424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.010452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.223 qpair failed and we were unable to recover it. 00:27:15.223 [2024-07-12 12:41:09.010548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.010671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.223 [2024-07-12 12:41:09.010698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.010836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.010948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.010974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.011061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.011307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.011565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.011897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.011996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.012154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.012450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.012716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.012858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.012976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.013224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.013502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.013785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.013951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.014076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.014352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.014552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.014843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.014991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.015128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.015353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.015600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.015758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.015897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.016202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.016436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.016682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.016864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.017040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.017231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.017449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.017742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.017914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.018029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.018323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.018616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.224 qpair failed and we were unable to recover it. 00:27:15.224 [2024-07-12 12:41:09.018854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.224 [2024-07-12 12:41:09.018997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.019138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.019487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.019762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.019919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.020063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.020200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.020228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.020382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.020551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.020575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.020706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.020870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.020912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.020995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.021249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.021475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.021826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.021965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.022108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.022351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.022589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.022876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.022984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.023102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.023355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.023558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.023803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.023988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.024099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.024322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.024567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.024773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.024914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.025019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.025295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.025559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.025807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.225 [2024-07-12 12:41:09.025939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.225 qpair failed and we were unable to recover it. 00:27:15.225 [2024-07-12 12:41:09.026058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.026301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.026535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.026780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.026915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.027030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.027240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.027487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.027752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.027908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.027991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.028259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.028501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.028738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.028907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.028989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.029207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.029495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.029717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.029922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.030006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.030282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.030531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.030854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.030988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.031101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.031225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.031252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.031382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.031525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.031549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.031693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.031791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.031818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.031931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.032157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.032381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.032668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.032818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.032932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.033128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.033380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.226 [2024-07-12 12:41:09.033593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.226 [2024-07-12 12:41:09.033719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.226 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.033892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.034177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.034485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.034823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.034987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.035105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.035220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.035244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.035351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.035474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.035500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.035595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.035694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.035721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.035857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.036180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.036451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.036704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.036826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.036978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.037200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.037420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.037657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.037804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.037945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.038226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.038478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.038671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.038789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.038887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.039134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.039464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.039749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.039872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.040034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.040296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.040572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.040797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.040940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.041034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.041117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.041143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.041308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.041448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.041489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.227 qpair failed and we were unable to recover it. 00:27:15.227 [2024-07-12 12:41:09.041615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.041764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.227 [2024-07-12 12:41:09.041791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.041949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.042171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.042422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.042720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.042860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.042998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.043204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.043496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.043771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.043960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.044048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.044304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.044526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.044778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.044940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.045091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.045339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.045589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.045797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.045970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.046066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.046343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.046607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.046877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.046983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.047114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.047380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.047632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.047762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.047911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.048148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.048405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.048796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.048989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.049083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.049331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.049628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.228 qpair failed and we were unable to recover it. 00:27:15.228 [2024-07-12 12:41:09.049877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.228 [2024-07-12 12:41:09.049970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.049994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.050102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.050207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.050234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.050328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.050455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.050481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.050583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.050742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.050769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.050880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.051160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.051489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.051765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.051939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.052029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.052274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.052548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.052775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.052896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.052982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.053223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.053564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.053766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.053919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.054032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.054248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.054560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.054878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.054997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.055095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.055244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.055268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.055379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.055528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.055554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.055706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.055794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.055821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.055966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.056201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.056454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.229 qpair failed and we were unable to recover it. 00:27:15.229 [2024-07-12 12:41:09.056749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.229 [2024-07-12 12:41:09.056942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.057061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.057314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.057577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.057861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.057978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.058097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.058310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.058567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.058748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.058854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.059122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.059369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.059621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.059752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.059878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.060176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.060412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.060663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.060828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.060957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.061149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.061429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.061714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.061830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.061947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.062205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.062490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.062750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.062860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.062981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.063227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.063485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.063692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.063833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.063924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.064212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.064510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.230 qpair failed and we were unable to recover it. 00:27:15.230 [2024-07-12 12:41:09.064798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.230 [2024-07-12 12:41:09.064914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.064940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.065064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.065286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.065517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.065715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.065844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.065938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.066164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.066395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.066648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.066901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.066977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.067116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.067338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.067610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.067820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.067928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.068036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.068257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.068474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.068691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.068825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.068918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.069176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.069498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.069713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.069857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.069974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.070201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.070479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.070712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.070846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.071017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.071271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.071497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.071725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.071927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.072043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.072132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.231 [2024-07-12 12:41:09.072156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.231 qpair failed and we were unable to recover it. 00:27:15.231 [2024-07-12 12:41:09.072272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.072380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.072410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.072528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.072641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.072665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.072779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.072862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.072892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.072983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.073224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.073419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.073667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.073804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.073918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.074160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.074359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.074571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.074831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.074978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.075064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.075328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.075609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.075877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.075979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.076118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.076408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.076681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.076800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.076905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.077186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.077429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.077652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.077884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.077999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.078106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.078387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.078676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.078808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.078928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.079159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.079418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.232 [2024-07-12 12:41:09.079676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.232 [2024-07-12 12:41:09.079815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.232 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.079920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.080208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.080449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.080645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.080808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.080927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.081153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.081364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.081614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.081875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.081986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.082134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.082362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.082615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.082841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.082985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.083100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.083361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.083609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.083886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.083992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.084135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.084388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.084642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.084773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.084884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.085151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.085414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.085659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.085852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.085972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.086116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.086201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.086226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.233 [2024-07-12 12:41:09.086312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.086423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.233 [2024-07-12 12:41:09.086447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.233 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.086557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.086673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.086697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.086812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.086902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.086930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.087060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.087263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.087516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.087724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.087843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.087940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.088172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.088427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.088615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.088852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.088979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.089119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.089351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.089599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.089835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.089981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.090066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.090208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.090233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.090327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.090407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.090435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.090535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.090644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.234 [2024-07-12 12:41:09.090672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.234 qpair failed and we were unable to recover it. 00:27:15.234 [2024-07-12 12:41:09.090806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.513 [2024-07-12 12:41:09.090920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.513 [2024-07-12 12:41:09.090945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.513 qpair failed and we were unable to recover it. 00:27:15.513 [2024-07-12 12:41:09.091030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.513 [2024-07-12 12:41:09.091134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.513 [2024-07-12 12:41:09.091159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.513 qpair failed and we were unable to recover it. 00:27:15.513 [2024-07-12 12:41:09.091249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.091327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.091352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.091441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.091521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.091545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.091638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.091726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.091750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.091849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.092124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.092388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.092658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.092853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.092969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.093095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.093344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.093545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.093792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.093949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.094037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.094238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.094512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.094703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.094842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.094953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.095203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.095401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.095614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.095841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.095985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.096103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.096233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.096257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.096350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.096456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.096481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.096556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.096650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.514 [2024-07-12 12:41:09.096676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.514 qpair failed and we were unable to recover it. 00:27:15.514 [2024-07-12 12:41:09.096755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.096841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.096874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1389225 Killed "${NVMF_APP[@]}" "$@" 00:27:15.515 [2024-07-12 12:41:09.096985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.097093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.097117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.097243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 12:41:09 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:15.515 [2024-07-12 12:41:09.097327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.097352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.097446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 12:41:09 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:15.515 [2024-07-12 12:41:09.097535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.097561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 12:41:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:15.515 [2024-07-12 12:41:09.097653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 12:41:09 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:15.515 [2024-07-12 12:41:09.097744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.097769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 12:41:09 -- common/autotest_common.sh@10 -- # set +x 00:27:15.515 [2024-07-12 12:41:09.097878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.097981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.098117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.098374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.098596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.098832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.098951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.099075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.099315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.099531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.099753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.099864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.099978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.100234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.100439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.100689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.100821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.100968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.101125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.101152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.101313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.101448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 [2024-07-12 12:41:09.101477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.515 qpair failed and we were unable to recover it. 00:27:15.515 [2024-07-12 12:41:09.101627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.515 12:41:09 -- nvmf/common.sh@469 -- # nvmfpid=1389819 00:27:15.515 12:41:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:15.516 [2024-07-12 12:41:09.101770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.101796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 12:41:09 -- nvmf/common.sh@470 -- # waitforlisten 1389819 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.101957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 12:41:09 -- common/autotest_common.sh@819 -- # '[' -z 1389819 ']' 00:27:15.516 [2024-07-12 12:41:09.102074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.102099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.102185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 12:41:09 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:15.516 [2024-07-12 12:41:09.102325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.102350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.102439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 12:41:09 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:15.516 [2024-07-12 12:41:09.102550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.102576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 12:41:09 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:15.516 [2024-07-12 12:41:09.102661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:15.516 12:41:09 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:15.516 [2024-07-12 12:41:09.102818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.102845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 12:41:09 -- common/autotest_common.sh@10 -- # set +x 00:27:15.516 [2024-07-12 12:41:09.102995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.103220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.103519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.103792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.103948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.104053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.104301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.104544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.104825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.104990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.105077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.105299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.105543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.105778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.105926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.106011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.106220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.106468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.106717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.106838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.106965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.107073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.107097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.107188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.107296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.516 [2024-07-12 12:41:09.107321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.516 qpair failed and we were unable to recover it. 00:27:15.516 [2024-07-12 12:41:09.107455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.107608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.107636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.107732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.107861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.107932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.108016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.108244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.108447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.108655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.108818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.108974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.109209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.109392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.109661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.109824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.109960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.110209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.110429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.110670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.110850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.110996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.111233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.111466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.111667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.111910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.111999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.112107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.112327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.517 [2024-07-12 12:41:09.112582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.517 [2024-07-12 12:41:09.112694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.517 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.112785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.112910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.112935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.113037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.113225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.113454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.113691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.113876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.113986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.114081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.114310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.114537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.114760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.114883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.115000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.115230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.115424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.115712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.115834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.115941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.116129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.116337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.116564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.116835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.116995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.117118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.117258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.117285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.117408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.117511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.117537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.117658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.117740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.117765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.117915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.118000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.518 [2024-07-12 12:41:09.118025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.518 qpair failed and we were unable to recover it. 00:27:15.518 [2024-07-12 12:41:09.118123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.118382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.118632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.118885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.118999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.119131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.119346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.119589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.119871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.119976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.120090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.120311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.120526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.120824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.120974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.121059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.121291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.121575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.121800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.121956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.122052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.122133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.519 [2024-07-12 12:41:09.122174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.519 qpair failed and we were unable to recover it. 00:27:15.519 [2024-07-12 12:41:09.122288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.122394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.122418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.122496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.122584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.122609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.122697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.123458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.123488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.123638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.123782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.123807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.123917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.124181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.124421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.124743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.124846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.124937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.125154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.125427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.125662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.125803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.125904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.126143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.126398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.126629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.126765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.126892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.127106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.127305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.127562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.127760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.127873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.127963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.128083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.128108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.128231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.128369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.128393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.520 qpair failed and we were unable to recover it. 00:27:15.520 [2024-07-12 12:41:09.128523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.520 [2024-07-12 12:41:09.128613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.128637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.128726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.128876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.128905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.129000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.129246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.129507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.129738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.129877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.129966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.130202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.130418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.130622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.130848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.130974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.131071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.131324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.131556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.131815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.131955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.132048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.132242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.132465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.132687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.132818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.132902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.133147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.133350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.133573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.133800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.133955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.521 qpair failed and we were unable to recover it. 00:27:15.521 [2024-07-12 12:41:09.134041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.521 [2024-07-12 12:41:09.134120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.134242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.134457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.134722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.134830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.134930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.135146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.135333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.135537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.135774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.135886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.135965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.136177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.136378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.136589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.136825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.136970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.137053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.137254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.137479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.137708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.137820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.137979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.138181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.138447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.138726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.138910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.139048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.139191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.139227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.139369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.139469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.139494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.522 [2024-07-12 12:41:09.139616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.139702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.522 [2024-07-12 12:41:09.139727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.522 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.139820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.139949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.139975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.140066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.140182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.140206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.140662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.140786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.140821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.140989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.141266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.141592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.141883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.141977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.142120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.142365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.142711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.142890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.143029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.143311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.143549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.143748] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:15.523 [2024-07-12 12:41:09.143779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143821] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:15.523 [2024-07-12 12:41:09.143892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.143927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.144061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.144214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.144274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.144405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.144529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.144555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.144675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.144771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.144796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.144908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.145153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.145404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.145680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.145834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.145937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.146021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.146047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.146131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.146250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.146284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.523 qpair failed and we were unable to recover it. 00:27:15.523 [2024-07-12 12:41:09.146390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.523 [2024-07-12 12:41:09.146503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.146532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.146626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.146742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.146770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.146876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.146991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.147147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.147390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.147637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.147897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.147998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.148144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.148407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.148668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.148815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.148957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.149261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.149510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.149769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.149897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.150014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.150130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.150156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.150247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.150391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.150420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.151167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.151330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.151357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.151486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.151602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.151630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.151750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.151912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.151939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.152061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.152299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.152583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.152833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.152964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.524 [2024-07-12 12:41:09.153086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.153185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.524 [2024-07-12 12:41:09.153211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.524 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.153330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.153425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.153451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.153549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.153649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.153674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.153794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.153918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.153949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.154047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.154265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.154520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.154783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.154902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.155028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.155265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.155476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.155773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.155899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.156000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.156254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.156469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.156699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.156820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.156918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.157159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.157408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.525 [2024-07-12 12:41:09.157753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.525 [2024-07-12 12:41:09.157875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.525 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.157991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.158074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.158102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.158231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.158424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.158450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.158571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.158688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.158721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.158817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.159191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.159510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.159790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.159958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.160063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.160189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.160215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.160418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.160536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.160566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.160665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.160808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.160835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.160949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.161211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.161417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.161756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.161863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.161983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.162127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.162152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.162257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.162377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.162405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.162525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.162667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.162698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.162909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.163240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.163507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.163756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.163907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.164100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.164249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.164276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.164407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.164488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.526 [2024-07-12 12:41:09.164514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.526 qpair failed and we were unable to recover it. 00:27:15.526 [2024-07-12 12:41:09.164659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.164775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.164801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.164902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.165143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.165363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.165589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.165834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.165997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.166090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.166345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.166582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.166813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.166944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.167038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.167291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.167520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.167774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.167953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.168053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.168325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.168529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.168812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.168948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.169048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.169309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.169541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.169772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.169941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.527 qpair failed and we were unable to recover it. 00:27:15.527 [2024-07-12 12:41:09.170138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.170286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.527 [2024-07-12 12:41:09.170316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.170420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.170540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.170567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.170690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.170788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.170818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.171021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.171161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.171211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.171381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.171515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.171541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.171694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.171790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.171820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.172008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.172276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.172570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.172857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.172988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.173129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.173342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.173589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.173791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.173938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.174031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.174282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.174525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.174773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.174941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.175068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.175273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.175513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.175771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.175900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.175998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.176139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.176169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.176275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.176389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.176418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.528 qpair failed and we were unable to recover it. 00:27:15.528 [2024-07-12 12:41:09.176515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.528 [2024-07-12 12:41:09.176633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.176658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.176779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.176877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.176903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.176988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.177105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.177133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.177246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.177336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.177363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.177455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.178176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.178207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.178371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.178529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.178556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.178642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.178762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.178788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.178902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.179128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.179385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.179649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.179821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.179922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.180241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.180543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.180800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.180950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.181042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.181137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.181164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.181290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.181396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.181423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.529 qpair failed and we were unable to recover it. 00:27:15.529 [2024-07-12 12:41:09.181542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.181686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.529 [2024-07-12 12:41:09.181716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.181812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.181912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.181938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.182062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 EAL: No free 2048 kB hugepages reported on node 1 00:27:15.530 [2024-07-12 12:41:09.182178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.182335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.182574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.182788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.182917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.183032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.183268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.183470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.183686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.183824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.183925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.184150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.184391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.184643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.184764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.184893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.185146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.185375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.185595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.185820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.185958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.186069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.186260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.186459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.186661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.186885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.186992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.187016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.530 qpair failed and we were unable to recover it. 00:27:15.530 [2024-07-12 12:41:09.187124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.187210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.530 [2024-07-12 12:41:09.187234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.187323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.187413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.187437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.187542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.187634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.187658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.187744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.187832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.187856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.187944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.188226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.188412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.188665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.188873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.188985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.189123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.189390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.189617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.189834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.189974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.190062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.190264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.190483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.190695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.190905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.190997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.191022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.191163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.191262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.191289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.191382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.191463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.191488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.531 qpair failed and we were unable to recover it. 00:27:15.531 [2024-07-12 12:41:09.191605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.531 [2024-07-12 12:41:09.191683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.191707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.191791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.191939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.191964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.192047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.192271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.192477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.192721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.192855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.192944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.193140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.193340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.193539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.193778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.193908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.194006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.194243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.194456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.194692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.194892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.194987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.195100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.195330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.195534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.195807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.195931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.196011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.196245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.196443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.196675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.532 qpair failed and we were unable to recover it. 00:27:15.532 [2024-07-12 12:41:09.196852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.532 [2024-07-12 12:41:09.196948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.196973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.197064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.197299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.197521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.197781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.197914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.198004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.198261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.198462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.198682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.198816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.198943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.199235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.199452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.199639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.199881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.199990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.200070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.200281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.200487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.200690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.200831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.200955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.201189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.201408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.201668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.201814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.533 [2024-07-12 12:41:09.201899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.202013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.533 [2024-07-12 12:41:09.202038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.533 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.202131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.202324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.202585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.202779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.202895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.202976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.203235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.203512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.203735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.203926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.204009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.204242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.204453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.204705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.204824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.204927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.205187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.205413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.205731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.205881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.205969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.206258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.206515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.206708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.206857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.206984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.207072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.207097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.207225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.207350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.207374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.534 [2024-07-12 12:41:09.207533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.207649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.534 [2024-07-12 12:41:09.207677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.534 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.207792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.207906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.207931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.208022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.208259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.208480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.208733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.208870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.208997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.209218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.209483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.209742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.209856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.209941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.210194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.210470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.210700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.210840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.210938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.211124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.211373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.211627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.211840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.211958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.212043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.212256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.212514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.212746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.212846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.212968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.213077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.213101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.213203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.213292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.535 [2024-07-12 12:41:09.213317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.535 qpair failed and we were unable to recover it. 00:27:15.535 [2024-07-12 12:41:09.213456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.213539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.213563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.213683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.213762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.213786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.213872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.213966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.213990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.214113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.214314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.214506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.214734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.214889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.214971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.215217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.215405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.215642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.215806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.215945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.216136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.216356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.216578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.216807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.216947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.217030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.217151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.217175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.536 qpair failed and we were unable to recover it. 00:27:15.536 [2024-07-12 12:41:09.217298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.536 [2024-07-12 12:41:09.217379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.217403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.217546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.217621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.217645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.217755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.217883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.217908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.218000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.218221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.218436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.218684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.218915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.218992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.219097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.219354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.219547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219592] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:15.537 [2024-07-12 12:41:09.219663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.219824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.219980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.220079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.220280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.220524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.220768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.220915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.221001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.221189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.221420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.221645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.221901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.221993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.222103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.222321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.537 [2024-07-12 12:41:09.222562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.537 [2024-07-12 12:41:09.222698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.537 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.222819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.222911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.222936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.223046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.223312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.223530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.223752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.223904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.224001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.224241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.224459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.224643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.224826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.224990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.225108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.225247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.225271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.225381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.225505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.225529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.225645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.225727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.225751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.225898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.226168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.226398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.226648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.226856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.226979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.227123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.227400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.227594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.227798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.227910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.228042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.228137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.538 [2024-07-12 12:41:09.228161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.538 qpair failed and we were unable to recover it. 00:27:15.538 [2024-07-12 12:41:09.228250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.228376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.228400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.228494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.228607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.228631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.228759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.228914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.228940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.229056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.229317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.229560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.229824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.229950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.230038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.230297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.230553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.230750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.230859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.230960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.231218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.231467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.231707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.231828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.231970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.232273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.232518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.232762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.232911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.233023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.233230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.233492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.233718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.233890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.539 qpair failed and we were unable to recover it. 00:27:15.539 [2024-07-12 12:41:09.234020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.234167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.539 [2024-07-12 12:41:09.234197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.234311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.234405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.234429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.234522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.234609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.234633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.234761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.234875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.234900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.235021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.235244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.235464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.235667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.235770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.235881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.236110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.236311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.236592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.236725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.236912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.237173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.237408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.237625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.237808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.237932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.238042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.238305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.238504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.238721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.238891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.239015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.239129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.239153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.239233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.239373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.239397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.239503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.239618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.540 [2024-07-12 12:41:09.239642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.540 qpair failed and we were unable to recover it. 00:27:15.540 [2024-07-12 12:41:09.239723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.239816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.239842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.239934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.240197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.240395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.240644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.240854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.240971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.241067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.241296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.241488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.241756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.241893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.241979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.242175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.242377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.242604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.242784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.242891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.242977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.243209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.243433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.243630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.243804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.243898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.244161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.244389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.244611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.541 qpair failed and we were unable to recover it. 00:27:15.541 [2024-07-12 12:41:09.244844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.541 [2024-07-12 12:41:09.244965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.244991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.245079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.245394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.245616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.245878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.245989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.246134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.246251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.246276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.246397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.246516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.246540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.246656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.246769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.246794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.246947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.247187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.247409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.247635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.247861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.247976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.248088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.248297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.248535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.248787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.248904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.542 qpair failed and we were unable to recover it. 00:27:15.542 [2024-07-12 12:41:09.249096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.249215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.542 [2024-07-12 12:41:09.249239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.249348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.249463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.249488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.249610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.249751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.249776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.249864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.249976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.250080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.250309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.250540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.250734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.250881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.250976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.251239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.251456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.251681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.251799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.251893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.252159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.252389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.252621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.252804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.252929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.253013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.253243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.253492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.253719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.253826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.253939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.254185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.254462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.254698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.254830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.543 qpair failed and we were unable to recover it. 00:27:15.543 [2024-07-12 12:41:09.254916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.255036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.543 [2024-07-12 12:41:09.255061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.255174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.255290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.255315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.255396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.255514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.255538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.255651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.255768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.255793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.255934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.256155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.256343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.256563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.256834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.256975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.257055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.257270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.257496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.257684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.257853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.257977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.258226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.258504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.258724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.258836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.258961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.259200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.259393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.259637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.259830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.259971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.260082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.260170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.260195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.544 [2024-07-12 12:41:09.260281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.260397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.544 [2024-07-12 12:41:09.260424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.544 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.260521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.260605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.260630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.260749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.260857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.260909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.260999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.261234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.261441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.261676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.261840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.261965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.262192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.262472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.262717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.262837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.262969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.263197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.263418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.263633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.263877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.263995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.264140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.264371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.264617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.264859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.264985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.265077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.265306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.265547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.545 qpair failed and we were unable to recover it. 00:27:15.545 [2024-07-12 12:41:09.265822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.545 [2024-07-12 12:41:09.265938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.266030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.266259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.266457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.266669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.266901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.266985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.267117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.267392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.267673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.267809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.267898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.268181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.268391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.268669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.268856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.268970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.269087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.269309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.269588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.269871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.269980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.270060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.270303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.270531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.270774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.270887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.270994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.271069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.271094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.271205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.271285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.546 [2024-07-12 12:41:09.271309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.546 qpair failed and we were unable to recover it. 00:27:15.546 [2024-07-12 12:41:09.271388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.271503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.271527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.271648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.271738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.271763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.271841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.271927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.271952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.272071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.272301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.272589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.272839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.272999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.273085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.273332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.273555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.273828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.273994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.274071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.274350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.274541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.274750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.274856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.274974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.275223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.275480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.275700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.275830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.275958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.276159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.276387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.276620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.547 [2024-07-12 12:41:09.276758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.547 qpair failed and we were unable to recover it. 00:27:15.547 [2024-07-12 12:41:09.276902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.276994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.277135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.277357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.277581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.277854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.277958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.278050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.278293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.278550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.278799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.278912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.279009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.279272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.279535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.279762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.279879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.279960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.280236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.280470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.548 [2024-07-12 12:41:09.280742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.548 [2024-07-12 12:41:09.280860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.548 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.280976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.281215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.281503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.281686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.281821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.281950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.282149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.282439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.282662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.282894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.282999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.283092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.283373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.283560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.283808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.283925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.284018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.284293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.284487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.284796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.284912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.285031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.285232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.285485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.285749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.285850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.285953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.286093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.286117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.286195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.286339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.286364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.549 qpair failed and we were unable to recover it. 00:27:15.549 [2024-07-12 12:41:09.286480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.549 [2024-07-12 12:41:09.286598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.286622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.286726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.286843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.286874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.286975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.287231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.287464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.287705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.287846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.287936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.288121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.288299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.288560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.288732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.288856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.289147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.289396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.289662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.289915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.289998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.290113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.290316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.290542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.290721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.290871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.291015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.291298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.291516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.291751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.291899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.550 [2024-07-12 12:41:09.291995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.292083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.550 [2024-07-12 12:41:09.292108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.550 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.292234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.292458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.292656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.292842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.292985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.293098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.293313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.293572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.293829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.293998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.294076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.294327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.294527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.294812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.294921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.295059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.295320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.295515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.295768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.295932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.296010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.296262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.296480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.296752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.296859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.296952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.297045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.297069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.297150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.297261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.297285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.551 [2024-07-12 12:41:09.297432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.297513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.551 [2024-07-12 12:41:09.297538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.551 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.297624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.297747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.297773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.297923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.298151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.298405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.298661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.298825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.298949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.299175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.299413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.299692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.299830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.299930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.300149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.300351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.300576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.300808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.300981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.301101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.301396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.301643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.301858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.301975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.302084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.302332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.302523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.302747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.302847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.302932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.303040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.303064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.552 qpair failed and we were unable to recover it. 00:27:15.552 [2024-07-12 12:41:09.303153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.552 [2024-07-12 12:41:09.303269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.303381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.303662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.303889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.303996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.304122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.304347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.304597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.304785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.304929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.305021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.305304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.305515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.305721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.305862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.305954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.306229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.306445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.306714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.306827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.306928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.307157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.307386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.307633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.307864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.553 [2024-07-12 12:41:09.307973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.553 qpair failed and we were unable to recover it. 00:27:15.553 [2024-07-12 12:41:09.308055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.308287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.308537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.308818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.308933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.309015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.309266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.309518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.309740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.309888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.310009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.310288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.310547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.310761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.310931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.311023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.311274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.311477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.311698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.311879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.311988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.312098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.312213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.312237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.312323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.312441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.312466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.554 qpair failed and we were unable to recover it. 00:27:15.554 [2024-07-12 12:41:09.312577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.312686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.554 [2024-07-12 12:41:09.312710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.312827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.312926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.312952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.313069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.313294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.313520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.313755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.313899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.313985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.314225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.314444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.314713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.314850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.314935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.315212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.315435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.315654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.315835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.315924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.316121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.316328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.316576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.316814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.316916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.317024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.317281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.317540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.317791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.317928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.318020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.318129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.318153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.555 [2024-07-12 12:41:09.318282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.318429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.555 [2024-07-12 12:41:09.318453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.555 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.318573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.318648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.318672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.318756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.318849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.318878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.318994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.319222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.319468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.319730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.319846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.319941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.320141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.320386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.320578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.320800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.320975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.321071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.321303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.321515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.321803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.321968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.322079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.322296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.322564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.322775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.322895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.322983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.323202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.323441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.556 qpair failed and we were unable to recover it. 00:27:15.556 [2024-07-12 12:41:09.323744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.556 [2024-07-12 12:41:09.323863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.323893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.324098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.324314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.324532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.324748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.324855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.324992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.325239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.325454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.325686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.325884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.325979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.326090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.326289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.326507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.326720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.326875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.326971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.327205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.327416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.327642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.327892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.327982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.328099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.328347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.328570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.328852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.557 [2024-07-12 12:41:09.328985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.557 qpair failed and we were unable to recover it. 00:27:15.557 [2024-07-12 12:41:09.329077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.329297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.329519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.329733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.329882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.329976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.330178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.330466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.330689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.330819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.330963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.331144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.331391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.331641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.331892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.331997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.332084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.332280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.332487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.332675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.332861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.332985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.333061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.333092] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:15.558 [2024-07-12 12:41:09.333141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.333164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.333242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.333253] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:15.558 [2024-07-12 12:41:09.333274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:15.558 [2024-07-12 12:41:09.333286] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:15.558 [2024-07-12 12:41:09.333318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.333342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.558 [2024-07-12 12:41:09.333347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:15.558 [2024-07-12 12:41:09.333429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.333376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:15.558 [2024-07-12 12:41:09.333513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.558 [2024-07-12 12:41:09.333401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:15.558 [2024-07-12 12:41:09.333412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:15.558 [2024-07-12 12:41:09.333537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.558 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.333633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.333747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.333771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.333888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.333975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.333999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.334107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.334296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.334547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.334787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.334928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.335042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.335293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.335478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.335702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.335896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.335976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.336099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.336288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.336541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.336769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.336889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.337035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.337218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.337437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.559 qpair failed and we were unable to recover it. 00:27:15.559 [2024-07-12 12:41:09.337700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.559 [2024-07-12 12:41:09.337844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.337930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.338126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.338333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.338573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.338771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.338993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.339084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.339343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.339634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.339826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.339971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.340048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.340175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.340200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.340277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.340470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.340495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.340604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.340721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.340747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.340938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.341186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.341404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.341631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.341876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.341998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.342104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.342383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.342613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.342725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.342928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.343184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.343413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.343636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.560 qpair failed and we were unable to recover it. 00:27:15.560 [2024-07-12 12:41:09.343896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.560 [2024-07-12 12:41:09.343974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.343999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.344082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.344174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.344200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.344309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.344449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.344474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.344666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.344811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.344835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.344956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.345190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.345517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.345747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.345888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.346014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.346302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.346515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.346739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.346881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.347005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.347247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.347499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.347692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.347895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.347979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.348090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.348391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.348630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.348831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.348999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.349084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.349309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.349492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.349683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.349822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.561 qpair failed and we were unable to recover it. 00:27:15.561 [2024-07-12 12:41:09.350019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.350134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.561 [2024-07-12 12:41:09.350172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.350362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.350450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.350475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.350568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.350647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.350673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.350766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.350876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.350902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.350990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.351270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.351533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.351745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.351846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.351957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.352147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.352363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.352589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.352787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.352908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.353010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.353286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.353479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.353750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.353857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.353956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.354184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.354382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.354590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.354812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.354965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.355051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.355262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.355448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.562 qpair failed and we were unable to recover it. 00:27:15.562 [2024-07-12 12:41:09.355656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.562 [2024-07-12 12:41:09.355740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.355766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.355892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.355986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.356105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.356339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.356535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.356765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.356886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.356986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.357247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.357473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.357692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.357798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.357893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.358122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.358420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.358610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.358806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.358921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.359003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.359220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.359444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.359678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.359783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.359901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.360125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.360321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.360561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.360794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.360906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.360988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.361112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.361137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.361252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.361332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.361358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.361445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.361526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.563 [2024-07-12 12:41:09.361552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.563 qpair failed and we were unable to recover it. 00:27:15.563 [2024-07-12 12:41:09.361639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.361724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.361749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.361830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.361946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.361971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.362055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.362282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.362513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.362713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.362827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.362951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.363178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.363400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.363616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.363847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.363969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.364057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.364289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.364543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.364757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.364874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.364966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.365227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.365435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.365664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.365862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.365979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.366067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.366281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.366500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.366712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.564 [2024-07-12 12:41:09.366837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.564 qpair failed and we were unable to recover it. 00:27:15.564 [2024-07-12 12:41:09.366956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.367208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.367401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.367619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.367847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.367967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.368053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.368340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.368535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.368774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.368914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.369033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.369223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.369442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.369683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.369795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.369907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.370128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.370331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.370522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.370745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.370900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.370981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.371262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.371489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.371734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.371843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.371936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.372013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.372039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.565 qpair failed and we were unable to recover it. 00:27:15.565 [2024-07-12 12:41:09.372123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.372249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.565 [2024-07-12 12:41:09.372274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.372363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.372450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.372475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.372602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.372712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.372737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.372880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.372961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.372987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.373072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.373380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.373616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.373838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.373948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.374031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.374258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.374470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.374706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.374820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.374914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.375150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.375337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.375537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.375766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.375902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.375981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.376201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.376466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.376806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.376954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.377074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.377271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.377482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.377737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.377848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.377982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.378078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.378103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.378215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.378303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.566 [2024-07-12 12:41:09.378328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.566 qpair failed and we were unable to recover it. 00:27:15.566 [2024-07-12 12:41:09.378411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.378498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.378525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.378612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.378704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.378729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.378813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.378898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.378924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.379004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.379203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.379437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.379633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.379825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.379944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.380037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.380237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.380435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.380693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.380918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.380992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.381100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.381290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.381513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.381731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.381852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.381948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.382142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.382366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.382567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.382774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.382893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.383006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.383203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.383404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.383600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.383799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.383945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.384029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.384135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.384161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.567 qpair failed and we were unable to recover it. 00:27:15.567 [2024-07-12 12:41:09.384248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.567 [2024-07-12 12:41:09.384338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.384461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.384645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.384845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.384965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.385095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.385347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.385539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.385743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.385858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.385957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.386186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.386405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.386640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.386770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.386963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.387193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.387397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.387701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.387814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.388006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.388228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.388419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.388749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.388897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.389013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.389205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.389404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.389653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.389888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.389998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.390116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.390223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.390248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.568 qpair failed and we were unable to recover it. 00:27:15.568 [2024-07-12 12:41:09.390341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.568 [2024-07-12 12:41:09.390429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.390455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.390568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.390645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.390671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.390751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.390942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.390968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.391058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.391296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.391488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.391684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.391917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.391996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.392110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.392335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.392665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.392896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.392979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.393114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.393317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.393558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.393777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.393994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.394116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.394326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.394636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.394875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.394983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.395074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.395304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.395606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.569 qpair failed and we were unable to recover it. 00:27:15.569 [2024-07-12 12:41:09.395833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.569 [2024-07-12 12:41:09.395948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.396036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.396230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.396480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.396683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.396818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.396950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.397205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.397477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.397673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.397897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.398017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.398218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.398487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.398790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.398916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.399005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.399256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.399482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.399708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.399831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.399931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.400049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.400074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.400187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.400269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.400293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.570 qpair failed and we were unable to recover it. 00:27:15.570 [2024-07-12 12:41:09.400382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.570 [2024-07-12 12:41:09.400472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.400499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.400589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.400709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.400734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.400852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.400939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.400967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.401050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.401259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.401454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.401675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.401894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.401981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.402094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.402291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.402510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.402732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.402841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.402929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.403121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.403348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.403622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.403818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.403965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.404076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.404305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.404509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.404703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.404843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.404917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x111c4b0 (9): Bad file descriptor 00:27:15.571 [2024-07-12 12:41:09.405055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.405340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.405569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.405832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.405985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.406076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.406336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.406552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.406831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.406980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.407073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.407373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.407603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.407829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.407962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.408080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.408178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.571 [2024-07-12 12:41:09.408209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.571 qpair failed and we were unable to recover it. 00:27:15.571 [2024-07-12 12:41:09.408339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.408462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.408496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.408589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.408688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.408716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.408853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.408965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.408993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.409129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.409351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.409589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.409793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.409936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.410032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.410272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.410522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.410782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.410942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.411069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.411323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.411552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.411804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.411964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.412069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.412166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.412196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.412331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.412455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.412482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.572 qpair failed and we were unable to recover it. 00:27:15.572 [2024-07-12 12:41:09.412567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.572 [2024-07-12 12:41:09.412646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.412670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.412783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.412884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.412921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.413039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.413239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.413465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.413691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.413838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.414031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.414311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.414529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.414756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.414912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.415016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.415114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.415146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.856 qpair failed and we were unable to recover it. 00:27:15.856 [2024-07-12 12:41:09.415267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.856 [2024-07-12 12:41:09.415366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.415395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.415496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.415660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.415690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.415787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.415880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.415909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.416007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.416291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.416497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.416699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.416826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.416931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.417144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.417384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.417653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.417790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.417878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.418231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.418457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.418717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.418878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.418976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.419195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.419396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.419690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.419823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.419967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.420181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.420387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.420593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.420821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.420980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.421105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.421352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.421563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.421788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.421924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.422015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.422245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.422442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.422677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.422819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.422934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.423128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.423330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.423562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.423879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.423997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.424118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.424342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.424578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.424788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.424934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.425022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.425246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.425445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.425660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.425884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.425992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.426107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.426302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.426501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.426741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.426887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.426974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.427208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.427400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.427632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.427781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.427905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.428000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.428026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.428113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.428199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.428225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.428373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.428462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.857 [2024-07-12 12:41:09.428488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.857 qpair failed and we were unable to recover it. 00:27:15.857 [2024-07-12 12:41:09.428580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.428666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.428692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.428774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.428858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.428889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.429008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.429203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.429441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.429667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.429859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.429984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.430118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.430318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.430539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.430735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.430843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.430931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.431126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.431406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.431603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.431835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.431962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.432079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.432272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.432490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.432721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.432902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.433014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.433272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.433499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.433687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.433884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.433997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.434081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.434318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.434517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.434708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.434847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.434983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.435204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.435423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.435618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.435850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.435971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.436057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.436301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.436541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.436756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.436914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.437027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.437248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.437478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.437663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.437858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.437980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.438116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.438388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.438584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.438835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.438970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.439090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.439342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.439566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.439790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.439898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.439982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.440181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.440398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.440613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.440876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.440987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.858 qpair failed and we were unable to recover it. 00:27:15.858 [2024-07-12 12:41:09.441104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.858 [2024-07-12 12:41:09.441250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.441390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.441586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.441818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.441939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.442018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.442233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.442446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.442661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.442883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.442976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.443114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.443337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.443557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.443783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.443898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.443978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.444197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.444391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.444620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.444878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.444990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.445079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.445341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.445583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.445784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.445928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.446042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.446291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.446510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.446702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.446909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.446993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.447098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.447309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.447559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.447785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.447936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.448016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.448211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.448437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.448626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.448849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.448974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.449063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.449296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.449549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.449781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.449899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.449993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.450240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.450505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.450734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.450841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.450968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.451230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.451416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.859 [2024-07-12 12:41:09.451635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.859 [2024-07-12 12:41:09.451743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.859 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.451820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.451896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.451933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.452020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.452251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.452449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.452673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.452876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.452988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.453107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.453337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.453521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.453750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.453861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.453982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.454189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.454437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.454633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.454780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.454888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.455128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.455346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.455615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.455815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.455937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.456029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.456241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.456466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.456694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.456834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.456935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.457134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.457359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.457596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.457824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.457949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.458067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.458294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.458538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.458787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.458924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.459023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.459278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.459498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.459736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.459851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.459985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.460225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.460484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.460755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.460879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.460969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.461192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.461388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.461638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.461846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.461966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.462056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.462307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.462533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.462753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.462875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.462960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.463178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.463390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.463613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.463862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.463999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.464083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.464189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.464215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.464330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.464416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.464442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.464561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.464679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.860 [2024-07-12 12:41:09.464705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.860 qpair failed and we were unable to recover it. 00:27:15.860 [2024-07-12 12:41:09.464788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.464876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.464902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.464979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.465211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.465428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.465631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.465832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.465981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.466066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.466323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.466528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.466766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.466897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.466990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.467243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.467447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.467631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.467851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.467966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.468055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.468277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.468471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.468689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.468841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.468931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.469178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.469372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.469586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.469882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.469984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.470074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.470357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.470550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.470816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.470956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.471032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.471232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.471462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.471691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.471825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.471918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.472156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.472374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.472623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.472808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.472916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.472999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.473219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.473454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.473682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.473791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.473891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.474162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.474363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.474596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.474788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.474904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.475044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.475245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.475483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.475680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.475813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.475931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.476039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.476064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.476150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.476224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.476249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.861 qpair failed and we were unable to recover it. 00:27:15.861 [2024-07-12 12:41:09.476339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.476458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.861 [2024-07-12 12:41:09.476484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.476564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.476667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.476693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.476839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.476931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.476957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.477076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.477293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.477496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.477698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.477812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.477925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.478175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.478415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.478636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.478854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.478970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.479086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.479292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.479481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.479680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.479821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.479914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.480132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.480333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.480554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.480756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.480863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.480965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.481159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.481473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.481683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.481880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.481994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.482110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.482305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.482552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.482811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.482933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.483050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.483246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.483428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.483611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.483831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.483972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.484053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.484280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.484475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.484702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.484847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.484948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.485138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.485371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.485571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.485771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.485917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.486031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.486260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.486530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.486723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.486839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.486938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.487123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.487348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.487570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.487801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.487922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.488031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.488239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.488441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.488666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.488804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.488887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.489012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.489038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.489125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.489219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.862 [2024-07-12 12:41:09.489244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.862 qpair failed and we were unable to recover it. 00:27:15.862 [2024-07-12 12:41:09.489333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.489410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.489436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.489552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.489631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.489656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.489737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.489825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.489850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.489948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.490138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.490373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.490621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.490839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.490994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.491226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.491487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.491763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.491943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.492145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.492373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.492640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.492838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.492968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.493059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.493293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.493520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.493768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.493878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.494006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.494316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.494560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.494790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.494913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.495030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.495225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.495446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.495696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.495806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.495918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.496158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.496389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.496611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.496834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.496986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.497063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.497271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.497494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.497707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.497910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.497996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.498160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.498353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.498608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.498805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.498935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.499011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.499202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.499426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.499611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.499829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.499949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.500059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.500276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.500502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.500726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.500829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.500959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.501040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.501065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.501149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.501231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.501258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.863 [2024-07-12 12:41:09.501337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.501530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.863 [2024-07-12 12:41:09.501556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.863 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.501676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.501759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.501785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.501875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.501964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.501989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.502069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.502321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.502509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.502712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.502844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.502949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.503215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.503456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.503676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.503821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.503931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.504149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.504398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.504619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.504880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.504993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.505069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.505286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.505526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.505746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.505852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.505944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.506176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.506366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.506554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.506786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.506927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.507017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.507246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.507434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.507661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.507880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.507986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.508079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.508268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.508455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.508648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.508873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.508978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.509065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.509336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.509558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.509783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.509896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.510021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.510220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.510419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.510641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.510870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.510982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.511093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.511285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.511556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.511818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.511937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.512049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.512268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.512484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.512681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.512817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.512966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.513155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.513404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.513596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.513809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.864 [2024-07-12 12:41:09.513949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.864 qpair failed and we were unable to recover it. 00:27:15.864 [2024-07-12 12:41:09.514036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.514223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.514437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.514660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.514861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.514983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.515091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.515339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.515559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.515807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.515924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.516021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.516252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.516479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.516668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.516862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.516978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.517059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.517271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.517527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.517710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.517848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.517947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.518173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.518367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.518592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.518778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.518895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.518984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.519195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.519387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.519605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.519805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.519938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.520021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.520271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.520497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.520749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.520861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.520980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.521171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.521401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.521677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.521904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.521986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.522097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.522322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.522552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.522770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.522921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.523002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.523221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.523446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.523689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.523904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.523982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.524152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.524336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.524564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.524816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.524932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.525018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.525224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.525438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.525686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.525912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.525997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.526023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.526135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.526214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.526239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.526314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.526432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.865 [2024-07-12 12:41:09.526457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.865 qpair failed and we were unable to recover it. 00:27:15.865 [2024-07-12 12:41:09.526537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.526618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.526643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.526737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.526845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.526876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.526980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.527186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.527431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.527646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.527907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.527996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.528131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.528358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.528548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.528796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.528939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.529048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.529271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.529464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.529652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.529875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.529983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.530081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.530316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.530588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.530832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.530942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.531055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.531302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.531530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.531786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.531916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.531998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.532254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.532449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.532668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.532853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.532973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.533057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.533263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.533473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.533702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.533814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.533922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.534119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.534317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.534507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.534749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.534857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.534987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.535215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.535426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.535700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.535810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.535937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.536155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.536381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.536599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.536770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.536848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.537103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.537338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.537564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.537787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.537928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.538038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.538118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.538144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.538227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.538301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.866 [2024-07-12 12:41:09.538330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.866 qpair failed and we were unable to recover it. 00:27:15.866 [2024-07-12 12:41:09.538492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.538570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.538596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.538711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.538795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.538820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.538905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.538983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.539091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.539339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.539596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.539817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.539931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.540025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.540261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.540519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.540706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.540880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.541002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.541190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.541398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.541645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.541876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.541983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.542077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.542298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.542478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.542672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.542891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.542999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.543149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.543349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.543556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.543811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.543951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.544071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.544298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.544488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.544697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.544831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.544952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.545139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.545326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.545519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.545749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.545898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.545997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.546225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.546430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.546624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.546846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.546990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.547068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.547300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.547493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.547683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.547826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.547920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.548135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.548350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.548550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.548735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.548842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.548944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.549176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.549422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.549618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.549831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.549943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.550058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.550141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.550167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.550246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.550336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.550363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.550454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.550540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.867 [2024-07-12 12:41:09.550567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.867 qpair failed and we were unable to recover it. 00:27:15.867 [2024-07-12 12:41:09.550675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.550763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.550788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.550879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.550994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.551108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.551337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.551558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.551778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.551895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.551977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.552208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.552486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.552679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.552861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.552986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.553090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.553313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.553545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.553765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.553887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.553970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.554211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.554407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.554634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.554859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.554970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.555047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.555261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.555515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.555767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.555888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.555973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.556160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.556353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.556533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.556722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.556884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.556981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.557189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.557414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.557633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.557872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.557989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.558098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.558318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.558537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.558763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.558909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.558996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.559237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.559491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.559686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.559908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.559982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.560098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.560320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.560619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.560802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.560911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.561017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.561229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.561443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.561655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.561831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.561920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.562001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.562027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.868 [2024-07-12 12:41:09.562108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.562183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.868 [2024-07-12 12:41:09.562208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.868 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.562347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.562426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.562452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.562546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.562662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.562688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.562781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.562899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.562926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.563044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.563250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.563432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.563650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.563863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.563981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.564091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.564309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.564526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.564743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.564893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.564974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.565219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.565411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.565659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.565878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.565991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.566107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.566319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.566542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.566732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.566880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.567004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.567262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.567483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.567667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.567889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.567999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.568113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.568332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.568513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.568723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.568862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.568958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.569169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.569386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.569603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.569852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.569994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.570073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.570281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.570468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.570658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.570847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.570973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.571170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.571379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.571668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.571857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.571995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.572109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.572335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.572541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.572794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.572905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.572980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.573226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.573481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.573679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.573883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.573993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.574079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.574189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.574214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.574304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.574385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.574411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.869 qpair failed and we were unable to recover it. 00:27:15.869 [2024-07-12 12:41:09.574495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.574573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.869 [2024-07-12 12:41:09.574598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.574686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.574795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.574821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.574935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.575114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.575352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.575550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.575768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.575911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.575995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.576255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.576478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.576684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.576876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.576995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.577104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.577331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.577519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.577719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.577821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.577903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.578162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.578381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.578593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.578794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.578921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.579000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.579215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.579403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.579664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.579906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.579992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.580137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.580358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.580551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.580790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.580897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.580987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.581203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.581422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.581645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.581853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.581965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.582076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.582295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.582547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.582740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.582910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.583027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.583243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.583434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.583663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.583882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.583990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.584101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.584351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.584551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.584798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.584933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.585016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.585228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.585441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.585692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.870 [2024-07-12 12:41:09.585880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.585989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.870 [2024-07-12 12:41:09.586014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.870 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.586100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.586351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.586534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.586785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.586894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.586980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.587200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.587400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.587617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.587835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.587970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.588083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.588270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.588496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.588765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.588874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.588962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.589196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.589419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.589656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.589840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.589992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.590103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.590297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.590489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.590740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.590846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.590943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.591163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.591424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.591616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.591878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.591983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.592097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.592344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.592591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.592834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.592980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.593078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.593363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.593551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.593812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.593956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.594038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.594260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.594448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.594671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.594898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.594993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.595123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.595336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.595601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.595819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.595979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.596093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.596301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.596551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.596857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.596970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.597058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.597283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.597511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.597742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.597849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.597943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.598194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.598424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.598665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.871 [2024-07-12 12:41:09.598802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.871 qpair failed and we were unable to recover it. 00:27:15.871 [2024-07-12 12:41:09.598910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.599114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.599338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.599531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.599815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.599928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.600048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.600231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.600417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.600709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.600832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.600920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.601135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.601374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.601600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.601832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.601944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.602060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.602281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.602555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.602781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.602920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.602997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.603227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.603443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.603695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.603806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.603904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.604151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.604398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.604582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.604804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.604958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.605045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.605283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.605509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.605730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.605848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.605943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.606200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.606407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.606599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.606838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.606981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.607068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.607287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.607478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.607673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.607880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.607987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.608099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.608293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.608542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.608759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.608870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.608953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.609199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.609417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.609643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.609855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.609972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.610061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.610278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.610475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.610673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.610896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.610999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.872 [2024-07-12 12:41:09.611086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.611193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.872 [2024-07-12 12:41:09.611219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.872 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.611309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.611391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.611416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.611531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.611634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.611660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.611746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.611823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.611852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.611977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.612179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.612369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.612551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.612740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.612847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.612954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.613171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.613394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.613588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.613815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.613933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.614024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.614205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.614427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.614652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.614878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.614994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.615105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.615313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.615512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.615736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.615880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.615967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.616162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.616400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.616618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.616837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.616953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.617070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.617300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.617504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.617704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.617894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.617987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.618093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.618339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.618532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.618779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.618896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.618988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.619210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.619464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.619679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.619786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.619894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.620131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.620350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.620578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.620800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.620904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.621021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.621268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.621453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.621652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.621843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.621958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.622072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.622157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.622182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.873 qpair failed and we were unable to recover it. 00:27:15.873 [2024-07-12 12:41:09.622267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.622353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.873 [2024-07-12 12:41:09.622378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.622491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.622575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.622602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.622689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.622779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.622804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.622915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.623141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.623360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.623539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.623762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.623863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.623955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.624187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.624409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.624648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.624891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.624982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.625086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.625289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.625549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.625768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.625879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.625966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.626169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.626453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.626645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.626900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.626994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.627107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.627301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.627518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.627736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.627841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.627927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.628137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.628325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.628575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.628815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.628961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.629049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.629264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.629454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.629679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.629785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.629898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.630159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.630344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.630562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.630784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.630897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.631014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.631198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.631438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.631679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.631792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.631898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.632175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.632415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.632711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.632862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.632968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.633205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.633459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.633700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.633823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.633941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.634141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.634394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.634584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.634808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.634945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.874 qpair failed and we were unable to recover it. 00:27:15.874 [2024-07-12 12:41:09.635027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.874 [2024-07-12 12:41:09.635102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.635241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.635471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.635693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.635833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.635928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.636159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.636343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.636568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.636769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.636937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.637022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.637249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.637463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.637688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.637910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.637994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.638104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.638307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.638531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.638762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.638876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.638956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.639138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.639369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.639567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.639824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.639936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.640018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.640314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.640532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.640720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.640831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.640948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.641143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.641327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.641510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.641775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.641913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.642005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.642229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.642483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.642703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.642814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.642916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.643135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.643317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.643499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.643751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.643858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.644002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.644230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.644453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.644687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.644795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.644883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.645118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.645316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.645531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.645726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.645835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.875 qpair failed and we were unable to recover it. 00:27:15.875 [2024-07-12 12:41:09.645955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.646034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.875 [2024-07-12 12:41:09.646059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.646137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.646328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.646525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.646769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.646884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.646972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.647174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.647367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.647555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.647779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.647890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.648009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.648238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.648464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.648693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.648805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.648900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.649154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.649380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.649603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.649825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.649945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.650091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.650295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.650544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.650742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.650847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.650969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.651189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.651374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.651611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.651834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.651955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.652037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.652261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.652456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.652721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.652861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.652969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.653201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.653420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.653637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.653839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.653989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.654069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.654254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.654478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.654684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.654882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.654995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.655111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.655333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.655541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.655728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.655873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.655960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.656180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.656371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.656591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.656860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.656975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.657061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.657287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.657550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.657780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.657889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.657976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.658094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.658120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.658238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.658348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.876 [2024-07-12 12:41:09.658374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.876 qpair failed and we were unable to recover it. 00:27:15.876 [2024-07-12 12:41:09.658453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.658560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.658585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.658675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.658756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.658783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.658874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.658952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.658977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.659069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.659287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.659498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.659710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.659903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.659986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.660202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.660404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.660619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.660818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.660924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.661034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.661258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.661469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.661654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.661887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.661997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.662112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.662335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.662529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.662789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.662900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.662983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.663197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.663423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.663608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.663809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.663926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.664010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.664260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.664444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.664636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.664882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.664995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.665107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.665329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.665579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.665778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.665915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.666002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.666253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.666444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.666695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.666892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.666979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.667116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.667321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.667538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.667733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.667847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.667965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.668190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.668376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.668572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.668766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.668886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.668972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.669065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.669090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.669173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.669282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.877 [2024-07-12 12:41:09.669307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.877 qpair failed and we were unable to recover it. 00:27:15.877 [2024-07-12 12:41:09.669387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.669495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.669520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.669598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.669681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.669707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.669795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.669892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.669919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.670001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.670307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.670535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.670734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.670879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.670962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.671167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.671403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.671600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.671795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.671901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.672022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.672267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.672485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.672681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.672899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.672990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.673096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.673379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.673613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.673807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.673932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.674017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.674235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.674427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.674685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.674861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.674979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.675288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.675585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.675839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.675957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.676079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.676280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.676502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.676721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.676853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.676971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.677202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.677474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.677774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.677920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.678027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.678324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.678573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.678816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.678978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.679069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.679291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.679543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.679763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.679922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.680035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.680306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.680544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.680828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.680998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.681094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.681335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.681607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.681824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.681982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.682107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.682202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.682229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.682313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.682402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.682428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.682544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.682635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.878 [2024-07-12 12:41:09.682665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.878 qpair failed and we were unable to recover it. 00:27:15.878 [2024-07-12 12:41:09.682784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.682898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.682929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.683052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.683281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.683553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.683757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.683909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.684014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.684237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.684506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.684785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.684934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.685066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.685315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.685550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.685794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.685921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.686053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.686257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.686533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.686781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.686908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.686996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.687214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.687463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.687675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.687814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.687934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.688142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.688361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.688598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.688840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.688999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.689121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.689333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.689544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.689808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.689959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.690049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.690332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.690567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.690797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.690921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.691010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.691255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.691519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.691739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.691897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.692029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.692276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.692492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.692753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.692872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.692967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.693214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.693448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.693749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.693909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.693998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.694242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.694449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.694657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.694876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.694993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.695088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.695307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.695560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.695807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.695950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.696044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.696135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.696165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.696258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.696378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.696404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.879 qpair failed and we were unable to recover it. 00:27:15.879 [2024-07-12 12:41:09.696529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.879 [2024-07-12 12:41:09.696630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.696663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.696756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.696848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.696896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.697073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.697313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.697530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.697744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.697900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.698043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.698290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.698580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.698884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.698989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.699115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.699323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.699610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.699842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.699978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.700071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.700282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.700541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.700757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.700902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.701030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.701299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.701600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.701860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.701996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.702108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.702351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.702619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.702845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.702978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.703120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.703378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.703623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.703838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.703987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.704081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.704320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.704571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.704800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.704951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.705045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.705295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.705557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.705807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.880 [2024-07-12 12:41:09.705927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.880 qpair failed and we were unable to recover it. 00:27:15.880 [2024-07-12 12:41:09.706023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.706267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.706533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.706728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.706906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.707027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.707226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.707459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.707711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.707826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.707936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.708166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.708653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.708791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.708917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.709119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.709375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.709598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.709817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.709937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.710024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.710246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.710445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.710662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.710806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.710923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.711127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.711323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.711556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.711806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.711926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.712006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.712201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.712404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.712636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.712850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.712972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.713051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.713304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.713506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.713789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.713915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.713996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.714103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.714129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.714241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.714322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.714348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.881 qpair failed and we were unable to recover it. 00:27:15.881 [2024-07-12 12:41:09.714431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.714520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.881 [2024-07-12 12:41:09.714547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.714664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.714752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.714782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.714894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.715121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.715343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.715569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.715788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.715896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.715990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.716195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.716450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.716697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.716816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.716922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.717143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.717344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.717591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.717812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.717934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.718036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.718293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.718481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.718703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.718838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.718927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.719129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.719426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.719660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.719878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.719987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.720107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.720333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.720557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.720780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.720899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.720990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.721189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.721418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.721639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.721892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.721998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.722084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.722305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.722500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.722692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.722812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.882 qpair failed and we were unable to recover it. 00:27:15.882 [2024-07-12 12:41:09.722901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.882 [2024-07-12 12:41:09.723029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.723176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.723386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.723614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.723818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.723946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.724055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.724320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.724525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.724771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.724916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.725004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.725207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.725481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.725674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.725812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.725934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.726162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.726367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.726600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.726785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.726914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.726994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.727254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.727471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.727698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.727897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.727986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.728143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.728343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.728533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.728755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.728897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.728997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.729190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.729416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.729639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.883 [2024-07-12 12:41:09.729855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.883 [2024-07-12 12:41:09.729976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.883 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.730084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.730313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.730504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.730725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.730838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.730940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.731153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.731379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.731631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.731822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.731944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.732059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.732261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.732530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.732753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.732872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.732960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.733206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.733394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.733599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.733823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.733966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.734057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.734285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.734508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.734731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.734873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.735004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.735221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.735452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.735675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.735841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.735961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.736250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.736449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.736651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.736881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.736996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.737078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.737287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.737490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.737710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.737831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.737926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.738007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.738033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.884 [2024-07-12 12:41:09.738118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.738198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.884 [2024-07-12 12:41:09.738223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.884 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.738335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.738517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.738706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.738898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.738988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.739154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.739347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.739584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.739813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.739944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.740066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.740296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.740484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.740720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.740824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.740919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.741159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.741401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.741591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.741794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.741916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.742030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.742232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.742426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.742669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.742891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.742984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.743101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.743393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.743646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.743788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.743876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.744109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.744344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.744531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.744725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.744860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.744979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.745202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.745454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.745648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.745914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.745993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.746019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.746135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.746253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.746279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.746420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.746499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.885 [2024-07-12 12:41:09.746524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.885 qpair failed and we were unable to recover it. 00:27:15.885 [2024-07-12 12:41:09.746632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.746747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.746772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.746846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.746939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.746966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.747054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.747267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.747464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.747715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.747839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.747970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.748162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.748418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.748640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.748828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.748974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.749090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.749314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.749537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.749764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.749887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.749980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.750297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.750506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.750751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.750861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.750954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.751150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.751427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.751621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.751842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.751970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.752053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.752281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.752495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.752696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.752833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.752937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.753136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.753331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.753557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.753778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.753892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.754012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.754242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.754459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.754654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.754786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.754886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.755004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.886 [2024-07-12 12:41:09.755029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.886 qpair failed and we were unable to recover it. 00:27:15.886 [2024-07-12 12:41:09.755120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.755343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.755585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.755805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.755929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.756024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.756166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.756192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.756280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.756395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.756420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.756510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.756598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:15.887 [2024-07-12 12:41:09.756625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:15.887 qpair failed and we were unable to recover it. 00:27:15.887 [2024-07-12 12:41:09.756719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.756837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.756863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.756958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.757255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.757503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.757701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.757821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.757921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.758165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.758388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.758667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.758813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.758902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.759014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.759040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.759185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.759271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.759297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.190 qpair failed and we were unable to recover it. 00:27:16.190 [2024-07-12 12:41:09.759378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.759467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.190 [2024-07-12 12:41:09.759493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.759570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.759655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.759682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.759770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.759880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.759919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.760016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.760230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.760441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.760636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.760870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.760984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.761073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.761308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.761525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.761771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.761928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.762021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.762260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.762492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.762711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.762818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.762943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.763230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.763458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.763658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.763800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.763919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.764120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.764352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.764547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.764746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.764860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.764969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.765153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.765356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.765584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.765773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.765918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.766027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.766139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.191 [2024-07-12 12:41:09.766164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.191 qpair failed and we were unable to recover it. 00:27:16.191 [2024-07-12 12:41:09.766285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.766379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.766405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.766486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.766573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.766598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.766711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.766825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.766850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.766943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.767190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.767417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.767639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.767875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.767987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.768065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.768252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.768452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.768708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.768817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.768908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.769127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.769413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.769644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.769839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.769991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.770161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.770362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.770550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.770745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.770849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.770995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.771252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.771479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.771732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.771849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.771998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.772198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.772427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.772641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.772854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.772978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.192 qpair failed and we were unable to recover it. 00:27:16.192 [2024-07-12 12:41:09.773123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.192 [2024-07-12 12:41:09.773205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.773324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.773539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.773761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.773914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.773997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.774297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.774556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.774814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.774929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.775015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.775234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.775475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.775702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.775843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.775968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.776154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.776372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.776605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.776859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.776975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.777095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.777285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.777481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.777690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.777823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.777923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.778129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.778358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.778574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.778831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.778941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.779026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.779258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.779439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.779629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.193 [2024-07-12 12:41:09.779832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.779981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.193 [2024-07-12 12:41:09.780008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.193 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.780097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.780322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.780548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.780766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.780884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.781005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.781201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.781474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.781661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.781799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.781894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.782155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.782366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.782571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.782769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.782910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.783026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.783283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.783476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.783669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.783781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.783897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.784119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.784313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.784524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.784764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.784938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.785022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.785099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.785125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.785206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.785295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.785320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.785436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.785516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.194 [2024-07-12 12:41:09.785542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.194 qpair failed and we were unable to recover it. 00:27:16.194 [2024-07-12 12:41:09.785683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.785769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.785795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.785905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.786134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.786390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.786588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.786876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.786981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.787066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.787258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.787482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.787693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.787830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.787920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.788175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.788425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.788614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.788836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.788953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.789040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.789235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.789438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.789672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.789880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.789993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.790110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.790340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.790559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.790809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.790948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.791059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.791242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.791469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.791723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.791831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.791916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.792025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.792051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.792138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.792215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.792240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.195 [2024-07-12 12:41:09.792355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.792441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.195 [2024-07-12 12:41:09.792467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.195 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.792561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.792669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.792695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.792808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.792923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.792950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.793064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.793261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.793487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.793702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.793840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.793939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.794166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.794417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.794622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.794841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.794982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.795095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.795409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.795637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.795898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.795982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.796095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.796284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.796550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.796801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.796938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.797018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.797269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.797491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.797683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.797877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.797990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.798086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.798323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.798552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.798792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.798930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.799076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.799156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.799182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.799342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.799433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.799458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.196 qpair failed and we were unable to recover it. 00:27:16.196 [2024-07-12 12:41:09.799539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.799614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.196 [2024-07-12 12:41:09.799640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.799784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.799893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.799921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.800006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.800229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.800450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.800681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.800912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.800996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.801099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.801323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.801519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.801712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.801846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.801939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.802161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.802442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.802671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.802811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.802897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.803149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.803347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.803572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.803823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.803948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.804031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.804254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.804447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.804657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.804886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.804997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.805114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.805377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.805572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.805859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.805980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.806006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.806092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.806172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.806198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.806282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.806398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.806424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.197 qpair failed and we were unable to recover it. 00:27:16.197 [2024-07-12 12:41:09.806514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.197 [2024-07-12 12:41:09.806630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.806656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.806772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.806862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.806906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.806996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.807192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.807407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.807608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.807805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.807925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.808007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.808230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.808447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.808687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.808824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.808920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.809147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.809378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.809630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.809853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.809987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.810084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.810320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.810564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.810794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.810910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.810995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.811228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.811481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.811678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.811901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.811985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.812122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.812316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.812570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.812861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.812980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.813096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.813184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.813211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.813297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.813412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.813440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.198 qpair failed and we were unable to recover it. 00:27:16.198 [2024-07-12 12:41:09.813520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.198 [2024-07-12 12:41:09.813626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.813653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.813750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.813827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.813853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.813975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.814199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.814426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.814655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.814797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.814891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.815164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.815365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.815613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.815836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.815954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.816039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.816228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.816484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.816708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.816848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.816986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.817236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.817458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.817648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.817880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.817975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.818111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.818338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.818542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.818733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.818841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.818933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.819018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.819044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.819130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.819216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.819242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.199 [2024-07-12 12:41:09.819330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.819413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.199 [2024-07-12 12:41:09.819440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.199 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.819521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.819609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.819635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.819718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.819833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.819859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.819983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.820172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.820369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.820658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.820856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.820991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.821098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.821318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.821543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.821762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.821863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.821990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.822199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.822422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.822683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.822879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.822989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.823101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.823320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.823518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.823765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.823888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.823972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.824214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.824468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.824691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.824884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.824990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.825111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.825331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.825553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.825770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.825910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.826024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.826102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.826129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.200 qpair failed and we were unable to recover it. 00:27:16.200 [2024-07-12 12:41:09.826216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.826300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.200 [2024-07-12 12:41:09.826326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.826467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.826549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.826575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.826658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.826743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.826768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.826917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.827198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.827389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.827595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.827885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.827999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.828143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.828368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.828595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.828782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.828917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.829034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.829337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.829563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.829832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.829947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.830058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.830322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.830567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.830788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.830905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.831017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.831256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.831479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.831730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.831878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.832007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.832229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.832434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.832649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.832884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.832992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.833077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.833192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.833217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.833303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.833389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.201 [2024-07-12 12:41:09.833416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.201 qpair failed and we were unable to recover it. 00:27:16.201 [2024-07-12 12:41:09.833529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.833643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.833670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.833785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.833864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.833896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.833988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.834244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.834552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.834742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.834848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.834937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.835153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.835422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.835650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.835851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.835972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.836072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.836334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.836571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.836818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.836953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.837076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.837338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.837573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.837803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.837947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.838029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.838313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.838543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.838765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.838906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.838999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.839227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.839446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.839639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.839781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.839917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.840142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.840341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.840566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.202 [2024-07-12 12:41:09.840701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.202 qpair failed and we were unable to recover it. 00:27:16.202 [2024-07-12 12:41:09.840791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.840885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.840923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.841011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.841241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.841496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.841720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.841829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.841931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.842165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.842402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.842629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.842863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.842972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.843088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.843338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.843564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.843798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.843962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.844053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.844243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.844497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.844695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.844827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.844961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.845185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.845413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.845661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.845889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.845980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.846122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.846323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.846524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.203 qpair failed and we were unable to recover it. 00:27:16.203 [2024-07-12 12:41:09.846712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.203 [2024-07-12 12:41:09.846828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.846854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.846985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.847208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.847432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.847688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.847821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.847909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.848107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.848346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.848596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.848778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.848888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.848998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.849204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.849478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.849692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.849840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.849961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.850168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.850390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.850610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.850808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.850955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.851037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.851234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.851442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.851668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.851779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.851874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.852199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.852411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.852665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.852809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.852896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.853154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.853352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.853543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.204 [2024-07-12 12:41:09.853688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.204 qpair failed and we were unable to recover it. 00:27:16.204 [2024-07-12 12:41:09.853810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.853897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.853924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.854044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.854302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.854561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.854783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.854941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.855030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.855266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.855505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.855765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.855896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.855989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.856232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.856477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.856785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.856931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.857021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.857263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.857496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.857731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.857848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.857956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.858230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.858479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.858731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.858837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.858939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.859210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.859466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.859684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.859833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.859969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.860193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.860459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.860672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.860810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.860914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.861006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.861043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.205 [2024-07-12 12:41:09.861170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.861287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.205 [2024-07-12 12:41:09.861317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.205 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.861414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.861500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.861532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.861657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.861749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.861780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.861924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.862162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.862417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.862693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.862822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.862926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.863227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.863458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.863671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.863820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.863920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.864165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.864365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.864586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.864850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.864982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.865105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.865333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.865572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.865815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.865978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.866073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.866317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.866553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.866791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.866911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.867003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.867212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.867452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.867707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.867827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.867960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.868180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.868423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.206 [2024-07-12 12:41:09.868669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.206 [2024-07-12 12:41:09.868820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.206 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.868951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.869191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.869406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.869673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.869790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.869883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.870143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.870358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.870594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.870845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.870965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.871067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.871298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.871537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.871756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.871927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.872029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.872308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.872576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.872823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.872949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.873045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.873285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.873526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.873803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.873917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.874014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.874261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.874520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.874752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.874913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.875041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.875127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.875153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.207 [2024-07-12 12:41:09.875256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.875401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.207 [2024-07-12 12:41:09.875432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.207 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.875562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.875650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.875676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.875774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.875857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.875897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.876023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.876274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.876488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.876755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.876904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.877002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.877205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.877445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.877681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.877833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.877931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.878140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.878391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.878595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.878819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.878947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.879073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.879317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.879544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.879762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.879897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.880016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.880266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.880507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.880736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.880932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.881028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.881288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.881568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.881777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.881922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.882018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.882258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.882464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.208 qpair failed and we were unable to recover it. 00:27:16.208 [2024-07-12 12:41:09.882674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.208 [2024-07-12 12:41:09.882795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.882825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.882936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.883184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.883459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.883677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.883787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.883942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.884209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.884443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.884651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.884821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.884929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.885142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.885350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.885629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.885890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.885980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.886109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.886369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.886623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.886896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.886984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.887142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.887411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.887658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.887803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.887928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.888212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.888461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.888715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.888874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.889001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.889345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.889586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.889838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.889996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.890094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.890193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.890221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.890373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.890462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.890493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.209 qpair failed and we were unable to recover it. 00:27:16.209 [2024-07-12 12:41:09.890588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.209 [2024-07-12 12:41:09.890676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.890703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.890790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.890896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.890926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.891024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.891308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.891524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.891740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.891874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.892005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.892258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.892470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.892715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.892832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.892958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.893201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.893451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.893672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.893812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.893945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.894193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.894491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.894767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.894919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.895042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.895286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.895527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.895755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.895902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.895997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.896231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.896481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.896734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.896848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.896968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.897191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.897457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.897679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.897828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.897989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.898084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.210 [2024-07-12 12:41:09.898116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.210 qpair failed and we were unable to recover it. 00:27:16.210 [2024-07-12 12:41:09.898208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.898303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.898329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.898474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.898558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.898589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.898683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.898766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.898795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.898925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.899190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.899429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.899622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.899818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.899964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.900059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.900263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.900526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.900715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.900823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.900947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.901146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.901395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.901589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.901780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.901922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.902004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.902247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.902473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.902697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.902800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.902919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.903174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.903405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.903600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.903820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.903960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.904081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.904161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.904186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.211 qpair failed and we were unable to recover it. 00:27:16.211 [2024-07-12 12:41:09.904310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.904401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.211 [2024-07-12 12:41:09.904428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.904507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.904585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.904610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.904700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.904784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.904809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.904903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.904987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.905128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.905314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.905539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.905743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.905859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.905984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.906189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.906422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.906647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.906880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.906992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.907084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.907272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.907497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.907718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.907858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.907990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.908217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.908438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.908690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.908897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.908989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.909101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.909335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.909584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.909900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.909997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.910101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.910295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.910499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.910731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.910888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.212 [2024-07-12 12:41:09.911029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.911128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.212 [2024-07-12 12:41:09.911165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.212 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.911303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.911393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.911425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.911529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.911648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.911675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.911799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.911913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.911944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.912046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.912302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.912515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.912769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.912924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.913019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.913256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.913492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.913770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.913911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.914019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.914270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.914512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.914758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.914910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.915013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.915251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.915527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.915775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.915903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.916028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.916268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.916513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.916744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.916858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.916991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.917227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.917452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.917723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.917841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.917939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.918184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.918383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.213 qpair failed and we were unable to recover it. 00:27:16.213 [2024-07-12 12:41:09.918599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.213 [2024-07-12 12:41:09.918713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.918825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.918937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.918965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.919073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.919372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.919634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.919824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.919940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.920056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.920309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.920550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.920779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.920900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.920981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.921230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.921482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.921685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.921890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.921983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.922098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.922320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.922573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.922785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.922900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.923012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.923237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.923450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.923729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.923844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.923935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.924182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.924390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.924609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.924809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.924951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.925071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.925273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.925514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.214 qpair failed and we were unable to recover it. 00:27:16.214 [2024-07-12 12:41:09.925736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.214 [2024-07-12 12:41:09.925821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.925847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.925968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.926167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.926423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.926643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.926858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.926977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.927088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.927346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.927607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.927821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.927959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.928075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.928307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.928540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.928791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.928933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.929017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.929260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.929481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.929693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.929914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.929995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.930140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.930340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.930589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.930814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.930923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.931035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.931266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.931468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.931671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.931893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.931978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.932089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.932311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.932566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.215 [2024-07-12 12:41:09.932675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.215 qpair failed and we were unable to recover it. 00:27:16.215 [2024-07-12 12:41:09.932789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.932883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.932913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.933031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.933235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.933477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.933669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.933885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.933978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.934122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.934364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.934581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.934832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.934953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.935080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.935271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.935500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.935699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.935835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.935976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.936194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.936455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.936679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.936906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.936992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.937104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.937401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.937629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.937856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.937969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.938084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.938333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.938581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.216 [2024-07-12 12:41:09.938809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.216 [2024-07-12 12:41:09.938948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.216 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.939032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.939233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.939450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.939694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.939833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.939930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.940150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.940369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.940561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.940785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.940924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.941017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.941240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.941502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.941692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.941801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.941953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.942190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.942432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.942656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.942878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.942988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.943125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.943378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.943611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.943872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.943983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.944101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.944339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.944563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.944752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.944903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.945018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.945248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.945431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.945676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.217 [2024-07-12 12:41:09.945810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.217 qpair failed and we were unable to recover it. 00:27:16.217 [2024-07-12 12:41:09.945933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.946161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.946408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.946612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.946822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.946939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.947019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.947276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.947487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.947737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.947883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.947968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.948162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.948411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.948632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.948797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.948881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.949149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.949401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.949629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.949885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.949992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.950080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.950305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.950525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.950743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.950887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.950971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.951177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.951370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.951599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.951813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.951981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.952093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.952288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.952537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.218 [2024-07-12 12:41:09.952728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.218 [2024-07-12 12:41:09.952872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.218 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.952985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.953212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.953396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.953668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.953899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.953985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.954102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.954337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.954555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.954814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.954957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.955038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.955259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.955508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.955691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.955911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.955998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.956143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.956372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.956568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.956798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.956933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.957018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.957232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.957490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.957741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.957849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.957939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.958192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.958414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.958626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.958844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.958984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.959076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.959320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.959509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.219 [2024-07-12 12:41:09.959721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.219 [2024-07-12 12:41:09.959822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.219 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.959938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.960148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.960344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.960602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.960813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.960956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.961066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.961269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.961467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.961670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.961771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.961880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.962157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.962383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.962643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.962781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.962925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.963116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.963396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.963614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.963813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.963923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.964038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.964265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.964511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.964802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.964939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.965025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.965258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.965505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.965688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.220 [2024-07-12 12:41:09.965910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.965991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.220 [2024-07-12 12:41:09.966016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.220 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.966101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.966331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.966532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.966728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.966861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.966953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.967174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.967364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.967583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.967688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.967807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.968162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.968376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.968592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.968801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.968940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.969024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.969242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.969427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.969657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.969791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.969910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.970161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.970386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.970616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.970837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.970974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.971084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.971283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.971497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.971745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.971849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.971936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.972207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.972441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.972671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.221 qpair failed and we were unable to recover it. 00:27:16.221 [2024-07-12 12:41:09.972891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.972980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.221 [2024-07-12 12:41:09.973005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.973119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.973309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.973507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.973728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.973834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.973926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.974190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.974450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.974668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.974783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.974899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.975124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.975324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.975532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.975784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.975896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.976004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.976227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.976471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.976754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.976858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.976973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.977216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.977469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.977666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.977876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.977992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.978103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.978315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.978592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.978821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.978934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.979025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.979282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.979504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.979785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.979902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.222 qpair failed and we were unable to recover it. 00:27:16.222 [2024-07-12 12:41:09.980044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.222 [2024-07-12 12:41:09.980124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.980259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.980482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.980680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.980794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.980890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.981129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.981366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.981550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.981773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.981923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.982013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.982237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.982464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.982682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.982804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.982920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.983141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.983403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.983597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.983884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.983993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.984106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.984385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.984568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.984772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.984908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.984996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.985213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.985429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.985658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.985858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.985974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.986090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.986303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.986495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.986715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.223 [2024-07-12 12:41:09.986859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.223 qpair failed and we were unable to recover it. 00:27:16.223 [2024-07-12 12:41:09.986978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.987235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.987450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.987675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.987816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.987920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.988169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.988421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.988621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.988881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.988986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.989073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.989300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.989553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.989802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.989920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.989998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.990215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.990465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.990652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.990873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.990974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.991055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.991271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.991521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.991754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.991898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.991981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.992208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.992417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.992662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.992872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.992986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.224 qpair failed and we were unable to recover it. 00:27:16.224 [2024-07-12 12:41:09.993098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.224 [2024-07-12 12:41:09.993179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.993286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.993546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b58000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.993772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.993941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.994029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.994260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.994453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.994732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.994848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.994960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.995168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.995360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.995583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.995778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.995927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.996013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.996231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.996439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.996691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.996830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.996958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.997163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.997387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.997570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.997758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.997898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.997987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.998209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.998465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.998708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.998839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.998948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.999178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.999376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.999593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.225 [2024-07-12 12:41:09.999852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.225 [2024-07-12 12:41:09.999966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.225 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.000084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.000365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.000662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.000872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.000989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.001088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.001307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.001576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.001809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.001933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.002027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.002255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.002544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.002737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.002847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.002970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.003198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.003517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.003739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.003845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.003970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.004178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.004430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.004630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.004832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.004977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.005065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.005255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.005483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.005706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.005902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.005985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.006108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.006304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.006655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.006892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.006998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.007031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.007145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.007244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.007275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.007381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.007483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.007514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.226 qpair failed and we were unable to recover it. 00:27:16.226 [2024-07-12 12:41:10.007617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.226 [2024-07-12 12:41:10.007712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.007747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.007861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.008171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.008438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.008650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.008894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.008978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.009092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.009337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.009598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.009797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.009913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.010008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.010216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.010402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.010657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.010886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.010977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.011098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.011336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.011531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.011759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.011884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.011991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.012191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.012429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.012653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.012882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.012999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.013084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.013317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.013512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.013710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.013857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.013978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.014183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.014386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.014645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.014905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.014988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.015014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.227 qpair failed and we were unable to recover it. 00:27:16.227 [2024-07-12 12:41:10.015098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.227 [2024-07-12 12:41:10.015212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.015349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.015594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.015816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.015954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.016044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.016266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.016524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.016724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.016876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.016966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.017186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.017397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.017638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.017878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.017985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.018100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.018321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.018569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.018840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.018960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.019048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.019235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.019434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.019656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.019798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.019944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.020187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.020417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.020631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.020855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.020973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.021075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.021303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.021486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.228 [2024-07-12 12:41:10.021715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.228 [2024-07-12 12:41:10.021832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.228 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.021931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.022159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.022387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.022599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.022812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.022981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.023072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.023300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.023579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.023797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.023918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.024004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.024231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.024427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.024664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.024897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.024978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.025087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.025278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.025538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.025759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.025900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.026015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.026232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.026468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.026683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.026889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.026999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.027118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.027363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.027579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.027782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.027922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.028049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.028274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.028493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.028725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.028838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.028985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.029308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.029546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.229 qpair failed and we were unable to recover it. 00:27:16.229 [2024-07-12 12:41:10.029779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.229 [2024-07-12 12:41:10.029870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.029896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.029986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.030235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.030418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.030716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.030823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.030945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.031153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.031376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.031612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.031836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.031989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.032080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.032296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.032514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.032708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.032842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.032961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.033156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.033338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.033542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.033795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.033909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.033994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.034223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.034475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.034714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.034871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.034990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.035224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.035441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.035705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.035821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.035913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.036155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.036391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.036569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.036844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.036958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.037044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.037230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.037431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.037638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.230 qpair failed and we were unable to recover it. 00:27:16.230 [2024-07-12 12:41:10.037853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.230 [2024-07-12 12:41:10.037970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.038089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.038316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.038620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.038828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.038954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.039047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.039270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.039461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.039672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.039899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.039977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.040086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.040289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.040527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.040717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.040848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.040979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.041160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.041413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.041675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.041863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.041983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.042100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.042370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.042571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.042758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.042886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.043009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.043222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.043410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.043648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.043842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.043961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.044073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.044299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.044515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.044786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.044937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.045018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.045215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.045439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.045688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.231 qpair failed and we were unable to recover it. 00:27:16.231 [2024-07-12 12:41:10.045907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.231 [2024-07-12 12:41:10.045991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.046100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.046357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.046562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.046763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.046897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.046984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.047212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.047414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.047604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.047817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.047934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.048021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.048227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.048500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.048743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.048872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.048955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.049180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.049371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.049562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.049779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.049901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.049982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.050215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.050404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.050648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.050882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.050989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.051082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.051307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.051499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.051685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.051822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.051951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.052217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.052457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.052710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.232 qpair failed and we were unable to recover it. 00:27:16.232 [2024-07-12 12:41:10.052903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.232 [2024-07-12 12:41:10.052987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.053101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.053291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.053490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.053717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.053908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.053983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.054098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.054297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.054537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.054716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.054817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.054913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.055134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.055375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.055554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.055793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.055905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.055993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.056186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.056401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.056613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.056849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.056965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.057047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.057164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.057189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.057283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.057362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.057386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.233 qpair failed and we were unable to recover it. 00:27:16.233 [2024-07-12 12:41:10.057503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.057580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.233 [2024-07-12 12:41:10.057604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.057692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.057871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.057897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.058004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.058200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.058443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.058667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.058910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.058990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.059122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.059329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.059551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.059739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.059842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.059980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.060239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.060453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.060669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.060799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.060963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.061192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.061441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.061659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.061886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.061986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.062101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.062347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.062550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.062782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.062907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.063019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.063216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.063464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.063721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.063830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.063915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.064115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.064322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.234 qpair failed and we were unable to recover it. 00:27:16.234 [2024-07-12 12:41:10.064541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.234 [2024-07-12 12:41:10.064685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.064833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.064961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.064986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.065072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.065337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.065571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.065818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.065944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.066030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.066248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.066481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.066680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.066845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.066936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.067139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.067356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.067622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.067884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.067997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.068088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.068297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.068492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.068694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.068796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.068906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.069200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.069421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.069607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.069788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.069924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.070004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.070243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.070449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.070649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.070816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.070917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.071114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.071316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.235 qpair failed and we were unable to recover it. 00:27:16.235 [2024-07-12 12:41:10.071509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.235 [2024-07-12 12:41:10.071619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.071643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.071733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.071810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.071835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.071962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.072174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.072376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.072626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.072819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.072947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.073031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.073253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.073473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.073701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.073886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.074001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.074208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.074452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.074640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.074853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.074995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.075107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.075310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.075536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.075742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.075846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.075944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.076230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.076508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.076733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.076845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.076980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.077225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.077412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.077628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.236 [2024-07-12 12:41:10.077889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.077984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.236 [2024-07-12 12:41:10.078009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.236 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.078091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.078325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.078551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.078852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.078999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.079117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.079336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.079518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.079736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.079848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.079953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.080129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.080351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.080579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.080808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.080925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.081036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.081288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.081486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.081723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.081834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.081945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.082140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.082369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.082621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.082824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.082973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.083061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.083329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.083568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.083860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.083985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.084017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.084106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.084226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.084251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.084392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.084472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.237 [2024-07-12 12:41:10.084498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.237 qpair failed and we were unable to recover it. 00:27:16.237 [2024-07-12 12:41:10.084609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.238 [2024-07-12 12:41:10.084695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.238 [2024-07-12 12:41:10.084722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.238 qpair failed and we were unable to recover it. 00:27:16.238 [2024-07-12 12:41:10.084809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.238 [2024-07-12 12:41:10.084917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.238 [2024-07-12 12:41:10.084949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.238 qpair failed and we were unable to recover it. 00:27:16.238 [2024-07-12 12:41:10.085082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.238 [2024-07-12 12:41:10.085202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.238 [2024-07-12 12:41:10.085239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.238 qpair failed and we were unable to recover it. 00:27:16.238 [2024-07-12 12:41:10.085386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.085482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.085511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.085606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.085727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.085755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.085840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.085945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.085973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.086059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.086250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.086517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.086756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.086916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.087063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.087259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.087494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.087744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.087885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.087976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.088059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.088084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.505 [2024-07-12 12:41:10.088172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.088295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.505 [2024-07-12 12:41:10.088323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.505 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.088414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.088494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.088520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.088607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.088693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.088724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.088819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.088961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.088987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.089081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.089318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.089530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.089753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.089874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.089977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.090193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.090429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.090648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.090861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.090984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.091128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.091355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.091583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.091771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.091891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.091976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.092217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.092406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.092717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.092863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.092960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.093176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.093434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.093675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.093897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.093982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.094120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.094304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.094558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.094758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.094872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.094965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.095057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.095084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.506 qpair failed and we were unable to recover it. 00:27:16.506 [2024-07-12 12:41:10.095167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.506 [2024-07-12 12:41:10.095274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.095298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.095480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.095590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.095615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.095710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.095823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.095848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.095947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.096181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.096407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.096646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.096859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.096973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.097057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.097281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.097471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.097693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.097810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.097928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.098160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.098354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.098607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.098834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.098948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.099026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.099273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.099462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.099685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.099893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.099997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.100087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.100335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.100560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.100743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.100848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.101013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.101261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.101458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.101652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.101885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.101977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.507 [2024-07-12 12:41:10.102003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.507 qpair failed and we were unable to recover it. 00:27:16.507 [2024-07-12 12:41:10.102116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b68000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.102310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.102518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.102739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.102851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.102972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.103155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.103362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.103601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.103795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.103932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.104019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.104273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.104470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.104724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.104834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.104920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.105121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.105305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.105517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.105727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.105903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.106021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.106206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.106407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.106636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.106908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.106993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.107097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.107292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.107535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.107755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.107862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.107981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.108194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.108409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.508 qpair failed and we were unable to recover it. 00:27:16.508 [2024-07-12 12:41:10.108601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.508 [2024-07-12 12:41:10.108736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.108829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.108946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.108973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.109052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.109270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.109463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.109718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.109828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.109941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.110159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.110359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.110587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.110812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.110956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.111039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.111324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.111569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.111746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.111852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.111969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.112160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.112393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.112622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 12:41:10 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:16.509 [2024-07-12 12:41:10.112706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 12:41:10 -- common/autotest_common.sh@852 -- # return 0 00:27:16.509 [2024-07-12 12:41:10.112850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 12:41:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:16.509 [2024-07-12 12:41:10.112940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.112965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 12:41:10 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:16.509 [2024-07-12 12:41:10.113080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.509 [2024-07-12 12:41:10.113164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.113293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.113552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.113773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.113884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.509 [2024-07-12 12:41:10.113973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.114082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.509 [2024-07-12 12:41:10.114107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.509 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.114202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.114312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.114336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.114488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.114564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.114589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.114701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.114777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.114801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.114970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.115180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.115389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.115679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.115826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.115998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.116229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.116429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.116653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.116799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.116918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.117140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.117355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.117576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.117802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.117920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.118045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.118271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.118501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.118738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.118880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.118961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.119293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.119513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.119821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.119977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.120104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.120299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.120557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.120810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.120929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.121030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.121112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.121136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.121250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.121356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.121382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.510 qpair failed and we were unable to recover it. 00:27:16.510 [2024-07-12 12:41:10.121466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.121590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.510 [2024-07-12 12:41:10.121615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.121710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.121794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.121819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.121938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.122126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.122363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.122552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.122776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.122903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.122983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.123242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.123469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.123703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.123823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.123962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.124228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.124480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.124668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.124806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.124929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.125197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.125419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.125637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.125859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.125982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.126093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.126284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.126487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.126720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.126860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.126991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.127212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.127423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.127641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.127785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.127887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.128110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.128363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.511 qpair failed and we were unable to recover it. 00:27:16.511 [2024-07-12 12:41:10.128565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.511 [2024-07-12 12:41:10.128654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.128678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.128771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.128890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.128916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.128998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.129107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.129132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 12:41:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:16.512 [2024-07-12 12:41:10.129259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.129373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 12:41:10 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:16.512 [2024-07-12 12:41:10.129400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 12:41:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:16.512 [2024-07-12 12:41:10.129510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.129594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.512 [2024-07-12 12:41:10.129618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.129758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.129836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.129877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.129964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.130254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.130445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.130660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.130891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.130998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.131110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.131359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.131574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.131781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.131922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.132064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.132275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.132534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.132730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.132835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.132936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.133134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.133358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.133578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.133850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.133962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.134050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.134241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.134428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.134655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.134884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.134994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.135083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.135184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.135211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.512 qpair failed and we were unable to recover it. 00:27:16.512 [2024-07-12 12:41:10.135324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.512 [2024-07-12 12:41:10.135401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.135426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.135513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.135655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.135680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.135771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.135893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.135919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.136033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.136270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.136499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.136733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.136888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.136982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.137198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.137440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.137690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.137824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.137956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.138151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.138377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.138601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.138852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.138996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.139118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.139398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.139616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.139826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.139944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.140028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.140256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.140509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.140732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.140837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.140951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.141162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.141399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.141666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.141879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.141991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.142016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.142128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.142216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.142241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.142340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.142421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.142447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.513 qpair failed and we were unable to recover it. 00:27:16.513 [2024-07-12 12:41:10.142563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.513 [2024-07-12 12:41:10.142672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.142696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.142780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.142930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.142957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.143047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.143242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.143502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.143727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.143876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.143997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.144202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.144431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.144663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.144803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.144927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.145132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.145384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.145604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.145833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.145955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.146042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.146293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.146504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.146713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.146862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.146955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.147196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.147417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.147656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.147854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.147988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.148085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.148178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.148203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.148320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.148409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.148433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.514 qpair failed and we were unable to recover it. 00:27:16.514 [2024-07-12 12:41:10.148520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.148610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.514 [2024-07-12 12:41:10.148635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.148746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.148859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.148891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.148980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.149194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.149467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.149700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.149836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.150040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.150369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.150657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.150880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.150988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.151071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.151294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.151518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.151757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.151896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.152037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.152129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.152164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 Malloc0 00:27:16.515 [2024-07-12 12:41:10.152268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.152361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.152386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.152496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 12:41:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:16.515 [2024-07-12 12:41:10.152608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.152633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 12:41:10 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:16.515 [2024-07-12 12:41:10.152748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 12:41:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:16.515 [2024-07-12 12:41:10.152834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.152872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.515 [2024-07-12 12:41:10.152967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.153199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.153400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.153622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.153874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.153991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.154113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.154338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.154545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.154795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.154915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.154998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.155112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.155136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.155238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.155313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.155337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.155444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.155530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.515 [2024-07-12 12:41:10.155555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.515 qpair failed and we were unable to recover it. 00:27:16.515 [2024-07-12 12:41:10.155635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.155710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.155735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.155850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.155910] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:16.516 [2024-07-12 12:41:10.155968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.155992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.156077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.156266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.156468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.156669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.156861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.156981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.157064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.157274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.157472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.157694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.157834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.157967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.158224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.158439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.158657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.158773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.158926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.159154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.159402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.159608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.159783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.159900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.160199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.160432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.160688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.160917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.160990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.161098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.161333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.161582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.161805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.161946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.162045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.162132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.162159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.162244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.162324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.162349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.516 qpair failed and we were unable to recover it. 00:27:16.516 [2024-07-12 12:41:10.162427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.516 [2024-07-12 12:41:10.162534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.162559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.162677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.162785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.162810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.162902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.162989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.163102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.163347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.163597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.163834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.163962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.164056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 12:41:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:16.517 [2024-07-12 12:41:10.164142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.164177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.164273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 12:41:10 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:16.517 [2024-07-12 12:41:10.164386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 12:41:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:16.517 [2024-07-12 12:41:10.164410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.164495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.517 [2024-07-12 12:41:10.164577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.164603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.164690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.164799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.164824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.164919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.164999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.165136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.165398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.165582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.165838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.165969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.166117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.166232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.166262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.166493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.166574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.166598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.166707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.166822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.166848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.167012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.167249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.167435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.167684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.167828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.167948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.168167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.168382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.168567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.168824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.168977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.169003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.169089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.169198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.169223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.169328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.169406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.169430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.517 qpair failed and we were unable to recover it. 00:27:16.517 [2024-07-12 12:41:10.169523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.517 [2024-07-12 12:41:10.169638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.169665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.169779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.169873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.169899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.169982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.170222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.170454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.170657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.170889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.170999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.171133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.171370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.171574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.171799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.171937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.172027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.172142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 12:41:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:16.518 [2024-07-12 12:41:10.172177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.172265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 12:41:10 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:16.518 [2024-07-12 12:41:10.172349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.172375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 12:41:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:16.518 [2024-07-12 12:41:10.172453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.518 [2024-07-12 12:41:10.172595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.172619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.172706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.172821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.172847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.172975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.173215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.173458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.173659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.173925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.174041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.174270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.174530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.174752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.174916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.175001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.175086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.175111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.175226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.175341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.175367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.175452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.175681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.518 [2024-07-12 12:41:10.175706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.518 qpair failed and we were unable to recover it. 00:27:16.518 [2024-07-12 12:41:10.175870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.175968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.175994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.176089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.176311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.176540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.176759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.176877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.176970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.177198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.177424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.177628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.177774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.177925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.178124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.178383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.178569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.178821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.178944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.179025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.179251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.179488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.179715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.179916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.179994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.180138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 12:41:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:16.519 [2024-07-12 12:41:10.180219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2b60000b90 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 12:41:10 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:16.519 [2024-07-12 12:41:10.180361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 12:41:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:16.519 [2024-07-12 12:41:10.180489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.519 [2024-07-12 12:41:10.180613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.180801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.180959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.181057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.181257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.181475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.181693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.181901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.181987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.182011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.182094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.182208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.182233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.182318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.182398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.519 [2024-07-12 12:41:10.182428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.519 qpair failed and we were unable to recover it. 00:27:16.519 [2024-07-12 12:41:10.182521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.182610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.182635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.182717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.182800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.182824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.182920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.183167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.183343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.183565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.183817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.183943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x110e9f0 with addr=10.0.0.2, port=4420 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.184029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:16.520 [2024-07-12 12:41:10.184118] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:16.520 [2024-07-12 12:41:10.186890] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:27:16.520 [2024-07-12 12:41:10.186958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x110e9f0 (107): Transport endpoint is not connected 00:27:16.520 [2024-07-12 12:41:10.187024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 12:41:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:16.520 12:41:10 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:16.520 12:41:10 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:16.520 12:41:10 -- common/autotest_common.sh@10 -- # set +x 00:27:16.520 12:41:10 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:16.520 12:41:10 -- host/target_disconnect.sh@58 -- # wait 1389382 00:27:16.520 [2024-07-12 12:41:10.196500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.196656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.196683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.196699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.196714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.196743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.206485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.206582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.206608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.206624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.206638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.206667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.216433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.216533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.216559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.216574] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.216588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.216617] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.226487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.226598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.226625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.226640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.226654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.226683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.236492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.236600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.236626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.236649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.236664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.236693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.246546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.246650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.246675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.246690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.246703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.246734] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.256541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.256650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.256676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.256691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.256706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.256735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.266597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.266707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.266733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.266749] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.266763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.266792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.276632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.276741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.276764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.276780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.276793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.276822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.286645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.520 [2024-07-12 12:41:10.286775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.520 [2024-07-12 12:41:10.286801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.520 [2024-07-12 12:41:10.286816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.520 [2024-07-12 12:41:10.286830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.520 [2024-07-12 12:41:10.286858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.520 qpair failed and we were unable to recover it. 00:27:16.520 [2024-07-12 12:41:10.296656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.296748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.296774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.296789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.296803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.296831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.306758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.306881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.306910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.306926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.306940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.306970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.316733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.316829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.316855] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.316878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.316894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.316923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.326748] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.326888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.326914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.326937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.326952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.326981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.336772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.336894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.336920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.336936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.336951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.336979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.346817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.346932] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.346958] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.346974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.346988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.347017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.357011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.357125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.357161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.357176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.357190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.357233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.366919] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.367011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.367037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.367053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.367067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.367095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.376983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.377084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.377109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.377125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.377138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.377168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.386987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.387094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.387119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.387134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.387148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.387177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.396980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.397079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.397104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.397120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.397134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.397162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.521 [2024-07-12 12:41:10.407001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.521 [2024-07-12 12:41:10.407098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.521 [2024-07-12 12:41:10.407123] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.521 [2024-07-12 12:41:10.407138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.521 [2024-07-12 12:41:10.407153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.521 [2024-07-12 12:41:10.407182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.521 qpair failed and we were unable to recover it. 00:27:16.780 [2024-07-12 12:41:10.417035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.780 [2024-07-12 12:41:10.417145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.780 [2024-07-12 12:41:10.417172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.780 [2024-07-12 12:41:10.417194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.780 [2024-07-12 12:41:10.417210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.780 [2024-07-12 12:41:10.417239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.780 qpair failed and we were unable to recover it. 00:27:16.780 [2024-07-12 12:41:10.427079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.780 [2024-07-12 12:41:10.427181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.780 [2024-07-12 12:41:10.427210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.780 [2024-07-12 12:41:10.427230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.780 [2024-07-12 12:41:10.427245] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.780 [2024-07-12 12:41:10.427275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.780 qpair failed and we were unable to recover it. 00:27:16.780 [2024-07-12 12:41:10.437174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.780 [2024-07-12 12:41:10.437265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.437292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.437308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.437322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.437351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.447212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.447314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.447341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.447358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.447372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.447401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.457123] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.457222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.457247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.457263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.457277] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.457305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.467182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.467281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.467307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.467322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.467337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.467365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.477195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.477289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.477314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.477329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.477343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.477371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.487220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.487349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.487375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.487390] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.487405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.487433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.497232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.497335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.497361] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.497376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.497391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.497419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.507316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.507411] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.507441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.507457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.507471] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.507500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.517298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.517396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.517422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.517437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.517451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.517480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.527365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.527485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.527511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.527526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.527540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.527569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.537333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.537428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.537453] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.537469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.537483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.537511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.547396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.547494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.547520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.547535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.547549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.547577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.557409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.557508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.557534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.557549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.557564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.557592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.567425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.567510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.567534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.567551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.567565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.567593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.781 qpair failed and we were unable to recover it. 00:27:16.781 [2024-07-12 12:41:10.577496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.781 [2024-07-12 12:41:10.577607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.781 [2024-07-12 12:41:10.577633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.781 [2024-07-12 12:41:10.577648] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.781 [2024-07-12 12:41:10.577662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.781 [2024-07-12 12:41:10.577691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.587517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.587610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.587636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.587653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.587667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.587695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.597534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.597652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.597682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.597699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.597713] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.597742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.607572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.607670] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.607699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.607716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.607731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.607760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.617609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.617711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.617738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.617753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.617767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.617796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.627618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.627746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.627771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.627787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.627801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.627829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.637634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.637725] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.637751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.637767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.637782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.637816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.647671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.647754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.647780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.647796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.647810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.647838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.657718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.657824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.657860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.657886] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.657901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.657930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.667749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.667856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.667888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.667904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.667918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.667947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.677777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.677892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.677918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.677934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.677948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.677976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.687888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.687986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.688018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.688034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.688048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.688077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:16.782 [2024-07-12 12:41:10.697924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:16.782 [2024-07-12 12:41:10.698032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:16.782 [2024-07-12 12:41:10.698059] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:16.782 [2024-07-12 12:41:10.698075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:16.782 [2024-07-12 12:41:10.698090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:16.782 [2024-07-12 12:41:10.698130] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:16.782 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.707847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.707960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.707987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.708002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.708016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.041 [2024-07-12 12:41:10.708045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.041 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.717989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.718089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.718115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.718130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.718145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.041 [2024-07-12 12:41:10.718175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.041 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.727923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.728024] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.728049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.728065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.728079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.041 [2024-07-12 12:41:10.728115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.041 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.737987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.738095] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.738124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.738141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.738155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.041 [2024-07-12 12:41:10.738187] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.041 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.747972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.748068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.748095] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.748111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.748125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.041 [2024-07-12 12:41:10.748154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.041 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.757990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.758094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.758120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.758136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.758150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.041 [2024-07-12 12:41:10.758181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.041 qpair failed and we were unable to recover it. 00:27:17.041 [2024-07-12 12:41:10.768031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.041 [2024-07-12 12:41:10.768130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.041 [2024-07-12 12:41:10.768165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.041 [2024-07-12 12:41:10.768181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.041 [2024-07-12 12:41:10.768195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.768224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.778084] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.778181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.778212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.778229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.778243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.778271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.788090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.788189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.788215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.788230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.788244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.788272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.798117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.798211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.798237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.798252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.798266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.798294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.808129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.808220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.808245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.808260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.808274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.808302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.818181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.818283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.818309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.818325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.818339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.818373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.828196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.828285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.828311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.828326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.828340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.828369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.838276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.838401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.838427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.838443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.838457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.838486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.848347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.848436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.848461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.848476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.848488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.848516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.858289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.858392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.858416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.858431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.858445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.858473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.868337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.868430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.868461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.868477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.868491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.868520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.878372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.878465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.878492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.878509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.878522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.878551] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.888378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.888502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.888529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.888545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.888558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.888587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.898444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.898539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.898567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.898584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.898597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.898627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.908444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.042 [2024-07-12 12:41:10.908536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.042 [2024-07-12 12:41:10.908561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.042 [2024-07-12 12:41:10.908576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.042 [2024-07-12 12:41:10.908589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.042 [2024-07-12 12:41:10.908623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.042 qpair failed and we were unable to recover it. 00:27:17.042 [2024-07-12 12:41:10.918480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.043 [2024-07-12 12:41:10.918566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.043 [2024-07-12 12:41:10.918594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.043 [2024-07-12 12:41:10.918611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.043 [2024-07-12 12:41:10.918623] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.043 [2024-07-12 12:41:10.918653] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.043 qpair failed and we were unable to recover it. 00:27:17.043 [2024-07-12 12:41:10.928493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.043 [2024-07-12 12:41:10.928583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.043 [2024-07-12 12:41:10.928608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.043 [2024-07-12 12:41:10.928623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.043 [2024-07-12 12:41:10.928636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.043 [2024-07-12 12:41:10.928665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.043 qpair failed and we were unable to recover it. 00:27:17.043 [2024-07-12 12:41:10.938581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.043 [2024-07-12 12:41:10.938707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.043 [2024-07-12 12:41:10.938734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.043 [2024-07-12 12:41:10.938750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.043 [2024-07-12 12:41:10.938763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.043 [2024-07-12 12:41:10.938792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.043 qpair failed and we were unable to recover it. 00:27:17.043 [2024-07-12 12:41:10.948589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.043 [2024-07-12 12:41:10.948685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.043 [2024-07-12 12:41:10.948711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.043 [2024-07-12 12:41:10.948725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.043 [2024-07-12 12:41:10.948739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.043 [2024-07-12 12:41:10.948768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.043 qpair failed and we were unable to recover it. 00:27:17.043 [2024-07-12 12:41:10.958587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.043 [2024-07-12 12:41:10.958685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.043 [2024-07-12 12:41:10.958715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.043 [2024-07-12 12:41:10.958732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.043 [2024-07-12 12:41:10.958745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.043 [2024-07-12 12:41:10.958774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.043 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:10.968617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:10.968711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:10.968737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:10.968752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:10.968765] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:10.968794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:10.978708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:10.978854] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:10.978889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:10.978907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:10.978921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:10.978949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:10.988673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:10.988767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:10.988791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:10.988807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:10.988819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:10.988847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:10.998730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:10.998819] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:10.998844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:10.998859] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:10.998884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:10.998914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.008751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.008900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.008927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.008943] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.008956] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.008985] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.018793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.018892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.018916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.018932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.018944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.018973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.028789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.028887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.028912] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.028927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.028940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.028969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.038826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.038919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.038945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.038960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.038973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.039001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.048876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.048975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.049001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.049016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.049028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.049057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.058906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.059003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.059027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.059042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.059056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.059084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.068909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.068996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.069020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.069035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.069049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.302 [2024-07-12 12:41:11.069078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.302 qpair failed and we were unable to recover it. 00:27:17.302 [2024-07-12 12:41:11.079061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.302 [2024-07-12 12:41:11.079158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.302 [2024-07-12 12:41:11.079182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.302 [2024-07-12 12:41:11.079197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.302 [2024-07-12 12:41:11.079210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.079239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.088979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.089064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.089089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.089104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.089123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.089152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.099038] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.099136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.099161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.099176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.099189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.099219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.109134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.109269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.109296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.109312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.109326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.109354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.119075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.119202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.119229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.119244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.119258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.119286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.129208] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.129330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.129357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.129372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.129386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.129414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.139126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.139224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.139248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.139263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.139276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.139304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.149151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.149241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.149265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.149280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.149293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.149321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.159199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.159287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.159312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.159327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.159340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.159369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.169196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.169305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.169330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.169346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.169359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.169389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.179289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.179384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.179408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.179423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.179442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.179472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.189295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.189383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.189407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.189422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.189435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.189464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.199298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.199428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.199455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.199471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.199485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.199514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.209317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.209416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.209442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.209457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.209470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.209499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.303 [2024-07-12 12:41:11.219389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.303 [2024-07-12 12:41:11.219486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.303 [2024-07-12 12:41:11.219517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.303 [2024-07-12 12:41:11.219535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.303 [2024-07-12 12:41:11.219548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.303 [2024-07-12 12:41:11.219578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.303 qpair failed and we were unable to recover it. 00:27:17.562 [2024-07-12 12:41:11.229406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.562 [2024-07-12 12:41:11.229513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.562 [2024-07-12 12:41:11.229539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.562 [2024-07-12 12:41:11.229554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.562 [2024-07-12 12:41:11.229567] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.562 [2024-07-12 12:41:11.229596] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.562 qpair failed and we were unable to recover it. 00:27:17.562 [2024-07-12 12:41:11.239435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.562 [2024-07-12 12:41:11.239522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.562 [2024-07-12 12:41:11.239547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.562 [2024-07-12 12:41:11.239562] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.562 [2024-07-12 12:41:11.239575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.562 [2024-07-12 12:41:11.239603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.562 qpair failed and we were unable to recover it. 00:27:17.562 [2024-07-12 12:41:11.249420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.562 [2024-07-12 12:41:11.249521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.562 [2024-07-12 12:41:11.249545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.562 [2024-07-12 12:41:11.249560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.562 [2024-07-12 12:41:11.249573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.562 [2024-07-12 12:41:11.249601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.562 qpair failed and we were unable to recover it. 00:27:17.562 [2024-07-12 12:41:11.259474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.562 [2024-07-12 12:41:11.259568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.562 [2024-07-12 12:41:11.259592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.562 [2024-07-12 12:41:11.259607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.562 [2024-07-12 12:41:11.259620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.562 [2024-07-12 12:41:11.259648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.562 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.269491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.269589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.269617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.269634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.269653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.269684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.279567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.279684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.279709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.279725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.279738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.279768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.289543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.289634] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.289659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.289674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.289687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.289715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.299627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.299731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.299756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.299771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.299785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.299814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.309621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.309715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.309743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.309760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.309774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.309804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.319655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.319777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.319804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.319819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.319832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.319863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.329670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.329762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.329788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.329804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.329818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.329847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.339703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.339796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.339822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.339838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.339853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.339889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.349717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.349818] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.349844] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.349860] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.349885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.349916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.359775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.359873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.359900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.359921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.359936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.359965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.369803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.369896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.369920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.369936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.369951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.369979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.379827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.379934] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.379960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.379975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.379988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.380017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.389877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.389971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.389997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.390013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.390026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.390055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.399896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.399986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.563 [2024-07-12 12:41:11.400012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.563 [2024-07-12 12:41:11.400028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.563 [2024-07-12 12:41:11.400041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.563 [2024-07-12 12:41:11.400069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.563 qpair failed and we were unable to recover it. 00:27:17.563 [2024-07-12 12:41:11.409885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.563 [2024-07-12 12:41:11.409971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.409996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.410011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.410025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.410053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.419941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.420054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.420080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.420095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.420107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.420136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.429950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.430068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.430093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.430109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.430122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.430150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.440006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.440118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.440144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.440159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.440172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.440199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.450002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.450090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.450115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.450136] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.450150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.450178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.460141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.460236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.460261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.460275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.460288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.460316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.470070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.470201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.470226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.470241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.470255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.470282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.564 [2024-07-12 12:41:11.480109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.564 [2024-07-12 12:41:11.480217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.564 [2024-07-12 12:41:11.480246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.564 [2024-07-12 12:41:11.480263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.564 [2024-07-12 12:41:11.480276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.564 [2024-07-12 12:41:11.480305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.564 qpair failed and we were unable to recover it. 00:27:17.823 [2024-07-12 12:41:11.490146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.823 [2024-07-12 12:41:11.490242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.823 [2024-07-12 12:41:11.490269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.823 [2024-07-12 12:41:11.490285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.823 [2024-07-12 12:41:11.490299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.823 [2024-07-12 12:41:11.490328] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.823 qpair failed and we were unable to recover it. 00:27:17.823 [2024-07-12 12:41:11.500215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.823 [2024-07-12 12:41:11.500312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.823 [2024-07-12 12:41:11.500338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.823 [2024-07-12 12:41:11.500353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.823 [2024-07-12 12:41:11.500366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.823 [2024-07-12 12:41:11.500395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.823 qpair failed and we were unable to recover it. 00:27:17.823 [2024-07-12 12:41:11.510210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.823 [2024-07-12 12:41:11.510306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.823 [2024-07-12 12:41:11.510332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.823 [2024-07-12 12:41:11.510347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.823 [2024-07-12 12:41:11.510360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.823 [2024-07-12 12:41:11.510388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.823 qpair failed and we were unable to recover it. 00:27:17.823 [2024-07-12 12:41:11.520300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.823 [2024-07-12 12:41:11.520382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.823 [2024-07-12 12:41:11.520407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.823 [2024-07-12 12:41:11.520422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.823 [2024-07-12 12:41:11.520436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.823 [2024-07-12 12:41:11.520464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.823 qpair failed and we were unable to recover it. 00:27:17.823 [2024-07-12 12:41:11.530285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.823 [2024-07-12 12:41:11.530381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.823 [2024-07-12 12:41:11.530409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.823 [2024-07-12 12:41:11.530425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.823 [2024-07-12 12:41:11.530438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.823 [2024-07-12 12:41:11.530468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.823 qpair failed and we were unable to recover it. 00:27:17.823 [2024-07-12 12:41:11.540291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.823 [2024-07-12 12:41:11.540384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.823 [2024-07-12 12:41:11.540410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.823 [2024-07-12 12:41:11.540431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.823 [2024-07-12 12:41:11.540445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.823 [2024-07-12 12:41:11.540473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.823 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.550319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.550435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.550460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.550475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.550488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.550515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.560380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.560479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.560503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.560518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.560530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.560559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.570427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.570519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.570544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.570559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.570572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.570599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.580415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.580540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.580565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.580579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.580592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.580620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.590420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.590510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.590535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.590549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.590562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.590590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.600467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.600557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.600583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.600597] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.600610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.600637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.610566] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.610657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.610682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.610697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.610710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.610738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.620520] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.620614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.620639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.620654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.620667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.620694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.630546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.630636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.630662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.630683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.630696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.630725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.640625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.640716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.640741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.640756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.640769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.640796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.650670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.650760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.650785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.650800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.824 [2024-07-12 12:41:11.650812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.824 [2024-07-12 12:41:11.650840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.824 qpair failed and we were unable to recover it. 00:27:17.824 [2024-07-12 12:41:11.660636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.824 [2024-07-12 12:41:11.660727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.824 [2024-07-12 12:41:11.660751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.824 [2024-07-12 12:41:11.660765] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.660779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.660807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.670710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.670802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.670826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.670841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.670854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.670888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.680700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.680828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.680853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.680873] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.680887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.680916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.690738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.690832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.690857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.690879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.690893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.690921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.700789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.700892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.700919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.700933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.700947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.700974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.710815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.710915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.710941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.710956] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.710969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.710998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.720856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.721004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.721035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.721051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.721064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.721092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.730855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.730949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.730973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.730988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.731002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.731030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:17.825 [2024-07-12 12:41:11.740928] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:17.825 [2024-07-12 12:41:11.741038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:17.825 [2024-07-12 12:41:11.741063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:17.825 [2024-07-12 12:41:11.741078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:17.825 [2024-07-12 12:41:11.741091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:17.825 [2024-07-12 12:41:11.741119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:17.825 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.750991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.751089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.751115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.751130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.751143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.751172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.761007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.761130] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.761155] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.761170] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.761182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.761211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.770977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.771061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.771086] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.771100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.771113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.771141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.781019] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.781154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.781179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.781194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.781207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.781235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.791033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.791129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.791154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.791169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.791182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.791210] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.801055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.801148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.801174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.801188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.801201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.801229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.811108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.811240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.811270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.811285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.811299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.084 [2024-07-12 12:41:11.811327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.084 qpair failed and we were unable to recover it. 00:27:18.084 [2024-07-12 12:41:11.821212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.084 [2024-07-12 12:41:11.821311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.084 [2024-07-12 12:41:11.821335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.084 [2024-07-12 12:41:11.821350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.084 [2024-07-12 12:41:11.821363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.821391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.831156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.831242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.831267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.831282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.831295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.831322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.841157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.841243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.841269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.841284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.841297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.841324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.851195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.851278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.851303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.851318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.851331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.851365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.861229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.861344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.861369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.861383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.861397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.861425] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.871348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.871490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.871515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.871529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.871542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.871570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.881311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.881435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.881460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.881475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.881488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.881516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.891372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.891507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.891531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.891546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.891559] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.891587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.901345] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.901468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.901497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.901512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.901525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.901552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.911347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.911459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.911484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.911498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.911511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.911539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.921400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.921530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.921554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.921568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.921581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.921608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.931452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.931558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.931583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.931598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.931610] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.085 [2024-07-12 12:41:11.931638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.085 qpair failed and we were unable to recover it. 00:27:18.085 [2024-07-12 12:41:11.941500] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.085 [2024-07-12 12:41:11.941612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.085 [2024-07-12 12:41:11.941641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.085 [2024-07-12 12:41:11.941656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.085 [2024-07-12 12:41:11.941669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:11.941704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.086 [2024-07-12 12:41:11.951497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.086 [2024-07-12 12:41:11.951610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.086 [2024-07-12 12:41:11.951635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.086 [2024-07-12 12:41:11.951652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.086 [2024-07-12 12:41:11.951666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:11.951694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.086 [2024-07-12 12:41:11.961602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.086 [2024-07-12 12:41:11.961697] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.086 [2024-07-12 12:41:11.961722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.086 [2024-07-12 12:41:11.961737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.086 [2024-07-12 12:41:11.961751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:11.961778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.086 [2024-07-12 12:41:11.971628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.086 [2024-07-12 12:41:11.971720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.086 [2024-07-12 12:41:11.971745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.086 [2024-07-12 12:41:11.971760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.086 [2024-07-12 12:41:11.971774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:11.971802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.086 [2024-07-12 12:41:11.981624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.086 [2024-07-12 12:41:11.981732] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.086 [2024-07-12 12:41:11.981757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.086 [2024-07-12 12:41:11.981772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.086 [2024-07-12 12:41:11.981785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:11.981813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.086 [2024-07-12 12:41:11.991588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.086 [2024-07-12 12:41:11.991678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.086 [2024-07-12 12:41:11.991708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.086 [2024-07-12 12:41:11.991723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.086 [2024-07-12 12:41:11.991736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:11.991763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.086 [2024-07-12 12:41:12.001630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.086 [2024-07-12 12:41:12.001730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.086 [2024-07-12 12:41:12.001756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.086 [2024-07-12 12:41:12.001771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.086 [2024-07-12 12:41:12.001784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.086 [2024-07-12 12:41:12.001812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.086 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.011658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.011768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.011794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.011808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.011821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.011850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.021726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.021848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.021879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.021895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.021908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.021936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.031698] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.031835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.031860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.031882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.031894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.031928] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.041750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.041882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.041908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.041923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.041936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.041964] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.051752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.051831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.051856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.051877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.051892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.051919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.061802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.061898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.061924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.061938] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.061951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.061980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.071818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.071935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.071960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.071975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.071988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.072016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.081852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.081948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.081977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.081992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.082005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.082033] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.091884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.091983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.092008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.092023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.092036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.092063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.101916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.102009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.102034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.102049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.345 [2024-07-12 12:41:12.102061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.345 [2024-07-12 12:41:12.102090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.345 qpair failed and we were unable to recover it. 00:27:18.345 [2024-07-12 12:41:12.111936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.345 [2024-07-12 12:41:12.112029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.345 [2024-07-12 12:41:12.112055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.345 [2024-07-12 12:41:12.112070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.112082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.112111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.121982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.122092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.122118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.122133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.122146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.122180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.132000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.132088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.132114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.132129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.132142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.132171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.142065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.142164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.142190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.142205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.142218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.142247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.152087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.152204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.152229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.152244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.152257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.152286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.162160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.162254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.162278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.162292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.162304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.162331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.172140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.172226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.172256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.172273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.172288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.172316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.182201] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.182295] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.182319] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.182334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.182348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.182377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.192190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.192322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.192347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.192362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.192377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.192405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.202292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.202380] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.202405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.202420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.202433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.202463] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.212346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.212441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.212467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.212483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.212502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.212531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.222337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.222444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.222470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.222485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.222498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.222528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.232346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.232475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.232501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.232516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.232529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.232558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.242372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.242505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.242531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.242546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.242560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.242588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.346 [2024-07-12 12:41:12.252429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.346 [2024-07-12 12:41:12.252521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.346 [2024-07-12 12:41:12.252546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.346 [2024-07-12 12:41:12.252561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.346 [2024-07-12 12:41:12.252575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.346 [2024-07-12 12:41:12.252604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.346 qpair failed and we were unable to recover it. 00:27:18.347 [2024-07-12 12:41:12.262538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.347 [2024-07-12 12:41:12.262645] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.347 [2024-07-12 12:41:12.262672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.347 [2024-07-12 12:41:12.262687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.347 [2024-07-12 12:41:12.262702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.347 [2024-07-12 12:41:12.262730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.347 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.272538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.272633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.272659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.272675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.272688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.272717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.282487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.282577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.282603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.282619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.282633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.282662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.292517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.292613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.292638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.292654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.292667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.292697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.302550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.302646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.302671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.302687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.302707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.302736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.312578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.312669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.312694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.312710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.312725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.312753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.322631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.322716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.322742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.322758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.322771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.322800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.332679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.332800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.332827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.332843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.332856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.332893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.342659] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.342750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.342776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.342792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.342807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.342835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.352684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.352777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.352802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.352817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.352830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.352860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.362767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.362885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.362911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.362927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.362940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.362969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.372753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.372886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.372911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.372927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.372941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.372970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.382791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.382909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.382936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.382951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.382964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.382994] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.605 qpair failed and we were unable to recover it. 00:27:18.605 [2024-07-12 12:41:12.392822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.605 [2024-07-12 12:41:12.392922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.605 [2024-07-12 12:41:12.392948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.605 [2024-07-12 12:41:12.392963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.605 [2024-07-12 12:41:12.392982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.605 [2024-07-12 12:41:12.393013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.402825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.402914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.402940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.402955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.402968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.402997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.412891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.413009] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.413035] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.413050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.413065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.413093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.422895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.422988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.423013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.423029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.423043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.423072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.432959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.433079] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.433104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.433120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.433133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.433162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.442945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.443034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.443060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.443075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.443088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.443118] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.453083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.453173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.453198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.453214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.453228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.453256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.463059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.463153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.463179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.463194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.463209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.463237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.473122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.473211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.473237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.473252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.473266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.473294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.483082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.483172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.483201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.483217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.483239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.483269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.493122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.493252] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.493278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.493295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.493310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.493339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.503251] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.503379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.503405] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.503420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.503434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.503461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.513135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.513222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.513247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.513261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.513275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.513303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.606 [2024-07-12 12:41:12.523167] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.606 [2024-07-12 12:41:12.523261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.606 [2024-07-12 12:41:12.523287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.606 [2024-07-12 12:41:12.523303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.606 [2024-07-12 12:41:12.523316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.606 [2024-07-12 12:41:12.523344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.606 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.533218] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.533310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.533336] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.865 [2024-07-12 12:41:12.533352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.865 [2024-07-12 12:41:12.533365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.865 [2024-07-12 12:41:12.533393] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.865 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.543320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.543453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.543479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.865 [2024-07-12 12:41:12.543494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.865 [2024-07-12 12:41:12.543507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.865 [2024-07-12 12:41:12.543535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.865 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.553315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.553414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.553439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.865 [2024-07-12 12:41:12.553454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.865 [2024-07-12 12:41:12.553467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.865 [2024-07-12 12:41:12.553495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.865 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.563309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.563395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.563421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.865 [2024-07-12 12:41:12.563435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.865 [2024-07-12 12:41:12.563448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.865 [2024-07-12 12:41:12.563476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.865 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.573326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.573461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.573486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.865 [2024-07-12 12:41:12.573506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.865 [2024-07-12 12:41:12.573521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.865 [2024-07-12 12:41:12.573548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.865 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.583443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.583543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.583569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.865 [2024-07-12 12:41:12.583584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.865 [2024-07-12 12:41:12.583597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.865 [2024-07-12 12:41:12.583624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.865 qpair failed and we were unable to recover it. 00:27:18.865 [2024-07-12 12:41:12.593431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.865 [2024-07-12 12:41:12.593529] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.865 [2024-07-12 12:41:12.593554] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.593568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.593581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.593608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.603412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.603496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.603520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.603535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.603547] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.603574] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.613429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.613518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.613542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.613557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.613570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.613597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.623507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.623611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.623636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.623650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.623663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.623690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.633522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.633619] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.633643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.633658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.633671] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.633698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.643614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.643750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.643778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.643794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.643808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.643837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.653552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.653648] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.653673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.653688] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.653701] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.653729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.663608] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.663702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.663727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.663748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.663762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.663790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.673637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.673731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.673757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.673772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.673785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.673813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.683646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.683741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.683766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.683781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.683794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.683821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.693737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.693845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.693880] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.693899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.693912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.693941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.703810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.703908] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.703934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.703948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.703961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.703990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.713756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.713859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.713891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.713906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.713920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.713948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.723823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.723917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.723942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.723957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.723970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.866 [2024-07-12 12:41:12.723997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.866 qpair failed and we were unable to recover it. 00:27:18.866 [2024-07-12 12:41:12.733816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.866 [2024-07-12 12:41:12.733914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.866 [2024-07-12 12:41:12.733943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.866 [2024-07-12 12:41:12.733959] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.866 [2024-07-12 12:41:12.733972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.867 [2024-07-12 12:41:12.734001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.867 qpair failed and we were unable to recover it. 00:27:18.867 [2024-07-12 12:41:12.743846] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.867 [2024-07-12 12:41:12.743955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.867 [2024-07-12 12:41:12.743983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.867 [2024-07-12 12:41:12.744001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.867 [2024-07-12 12:41:12.744014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.867 [2024-07-12 12:41:12.744043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.867 qpair failed and we were unable to recover it. 00:27:18.867 [2024-07-12 12:41:12.753843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.867 [2024-07-12 12:41:12.753988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.867 [2024-07-12 12:41:12.754014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.867 [2024-07-12 12:41:12.754037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.867 [2024-07-12 12:41:12.754053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.867 [2024-07-12 12:41:12.754084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.867 qpair failed and we were unable to recover it. 00:27:18.867 [2024-07-12 12:41:12.763863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.867 [2024-07-12 12:41:12.763964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.867 [2024-07-12 12:41:12.763989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.867 [2024-07-12 12:41:12.764004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.867 [2024-07-12 12:41:12.764017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.867 [2024-07-12 12:41:12.764047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.867 qpair failed and we were unable to recover it. 00:27:18.867 [2024-07-12 12:41:12.773918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.867 [2024-07-12 12:41:12.774006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.867 [2024-07-12 12:41:12.774032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.867 [2024-07-12 12:41:12.774046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.867 [2024-07-12 12:41:12.774059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.867 [2024-07-12 12:41:12.774087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.867 qpair failed and we were unable to recover it. 00:27:18.867 [2024-07-12 12:41:12.783983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:18.867 [2024-07-12 12:41:12.784093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:18.867 [2024-07-12 12:41:12.784119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:18.867 [2024-07-12 12:41:12.784134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:18.867 [2024-07-12 12:41:12.784147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:18.867 [2024-07-12 12:41:12.784175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:18.867 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.793994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.794093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.794119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.794134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.794148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.794176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.804087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.804222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.804248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.804262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.804275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.804303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.814072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.814191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.814215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.814230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.814243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.814271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.824183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.824276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.824300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.824315] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.824328] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.824356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.834110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.834244] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.834270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.834284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.834297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.834325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.844106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.844199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.844224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.844245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.844259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.844287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.854157] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.854245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.854270] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.854285] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.854298] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.854326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.864180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.864272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.864297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.864312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.864325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.864353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.874231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.874361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.874386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.874401] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.874414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.874441] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.884326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.884416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.884442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.884457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.884470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.884498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.894352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.894434] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.894459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.894473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.894487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.894514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.126 [2024-07-12 12:41:12.904350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.126 [2024-07-12 12:41:12.904490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.126 [2024-07-12 12:41:12.904515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.126 [2024-07-12 12:41:12.904530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.126 [2024-07-12 12:41:12.904543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.126 [2024-07-12 12:41:12.904570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.126 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.914432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.914574] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.914599] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.914614] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.914627] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.914655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.924506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.924629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.924654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.924669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.924682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.924709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.934404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.934491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.934522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.934537] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.934550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.934578] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.944426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.944520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.944545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.944560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.944574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.944601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.954453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.954543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.954568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.954584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.954597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.954625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.964482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.964570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.964594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.964609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.964622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.964650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.974572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.974667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.974693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.974707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.974720] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.974747] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.984536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.984628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.984653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.984668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.984681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.984709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:12.994563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:12.994692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:12.994716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:12.994731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:12.994744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:12.994772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:13.004597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:13.004691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:13.004715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:13.004730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:13.004743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:13.004771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:13.014614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:13.014702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:13.014727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:13.014742] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:13.014755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:13.014783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:13.024735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:13.024827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:13.024856] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:13.024878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:13.024893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:13.024932] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:13.034667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:13.034755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:13.034779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:13.034794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:13.034808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:13.034837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.127 [2024-07-12 12:41:13.044719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.127 [2024-07-12 12:41:13.044817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.127 [2024-07-12 12:41:13.044845] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.127 [2024-07-12 12:41:13.044862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.127 [2024-07-12 12:41:13.044883] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.127 [2024-07-12 12:41:13.044913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.127 qpair failed and we were unable to recover it. 00:27:19.385 [2024-07-12 12:41:13.054782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.385 [2024-07-12 12:41:13.054887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.385 [2024-07-12 12:41:13.054913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.385 [2024-07-12 12:41:13.054928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.385 [2024-07-12 12:41:13.054941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.385 [2024-07-12 12:41:13.054970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.385 qpair failed and we were unable to recover it. 00:27:19.385 [2024-07-12 12:41:13.064858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.385 [2024-07-12 12:41:13.064965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.385 [2024-07-12 12:41:13.064990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.385 [2024-07-12 12:41:13.065005] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.385 [2024-07-12 12:41:13.065018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.385 [2024-07-12 12:41:13.065051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.385 qpair failed and we were unable to recover it. 00:27:19.385 [2024-07-12 12:41:13.074779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.385 [2024-07-12 12:41:13.074877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.385 [2024-07-12 12:41:13.074901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.385 [2024-07-12 12:41:13.074916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.385 [2024-07-12 12:41:13.074929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.385 [2024-07-12 12:41:13.074957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.385 qpair failed and we were unable to recover it. 00:27:19.385 [2024-07-12 12:41:13.084853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.385 [2024-07-12 12:41:13.084962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.385 [2024-07-12 12:41:13.084987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.385 [2024-07-12 12:41:13.085002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.385 [2024-07-12 12:41:13.085015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.385 [2024-07-12 12:41:13.085042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.385 qpair failed and we were unable to recover it. 00:27:19.385 [2024-07-12 12:41:13.094826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.385 [2024-07-12 12:41:13.094920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.385 [2024-07-12 12:41:13.094945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.385 [2024-07-12 12:41:13.094960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.385 [2024-07-12 12:41:13.094974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.385 [2024-07-12 12:41:13.095001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.104912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.105003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.105027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.105042] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.105054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.105082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.114933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.115025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.115055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.115071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.115083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.115111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.124927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.125021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.125046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.125061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.125074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.125101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.134995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.135089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.135113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.135128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.135141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.135168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.145053] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.145146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.145170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.145185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.145199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.145226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.155059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.155150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.155174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.155188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.155201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.155237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.165093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.165178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.165201] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.165215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.165227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.165255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.175230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.175364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.175389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.175403] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.175416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.175444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.185151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.185241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.185266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.185280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.185293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.185320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.195189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.195277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.195302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.195316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.195329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.195356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.205198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.205287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.205317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.205332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.205345] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.205373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.215262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.215344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.215369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.215383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.215396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.215423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.225372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.225469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.225493] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.225508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.225521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.225549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.235393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.235486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.235511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.235526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.235538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.235566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.245405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.245496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.245521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.245535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.245548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.245581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.255441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.255536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.255561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.255576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.255589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.255616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.265417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.265522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.265547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.265561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.265574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.265601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.275406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.275496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.275521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.275535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.275548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.275576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.285513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.285598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.285624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.285638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.285651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.285679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.386 [2024-07-12 12:41:13.295465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.386 [2024-07-12 12:41:13.295553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.386 [2024-07-12 12:41:13.295583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.386 [2024-07-12 12:41:13.295598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.386 [2024-07-12 12:41:13.295611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.386 [2024-07-12 12:41:13.295639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.386 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.305538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.305636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.305662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.305677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.305690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.305718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.315564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.315660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.315685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.315700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.315714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.315745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.325571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.325665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.325691] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.325705] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.325719] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.325746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.335602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.335713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.335739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.335754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.335767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.335800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.345679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.345774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.345799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.345814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.345826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.345854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.355656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.355743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.355768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.355783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.355795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.355823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.365674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.644 [2024-07-12 12:41:13.365761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.644 [2024-07-12 12:41:13.365787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.644 [2024-07-12 12:41:13.365802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.644 [2024-07-12 12:41:13.365815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.644 [2024-07-12 12:41:13.365842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.644 qpair failed and we were unable to recover it. 00:27:19.644 [2024-07-12 12:41:13.375726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.375826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.375850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.375871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.375886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.375914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.385882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.385997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.386026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.386041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.386054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.386082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.395765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.395889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.395914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.395929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.395942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.395969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.405796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.405928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.405954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.405969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.405982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.406009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.415907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.416036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.416060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.416075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.416087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.416115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.425847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.425951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.425976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.425991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.426009] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.426037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.435874] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.435966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.435991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.436006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.436019] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.436047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.445922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.446015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.446041] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.446055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.446068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.446096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.455939] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.456048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.456072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.456087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.456100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.456128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.466055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.466148] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.466173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.466188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.466201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.466229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.476049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.476153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.476178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.476192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.476205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.476233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.486031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.486122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.486147] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.486162] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.486175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.486202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.496165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.496250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.496275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.496289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.496302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.496329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.506083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.506213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.506238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.506252] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.645 [2024-07-12 12:41:13.506265] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.645 [2024-07-12 12:41:13.506293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.645 qpair failed and we were unable to recover it. 00:27:19.645 [2024-07-12 12:41:13.516102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.645 [2024-07-12 12:41:13.516189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.645 [2024-07-12 12:41:13.516213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.645 [2024-07-12 12:41:13.516228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.646 [2024-07-12 12:41:13.516246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.646 [2024-07-12 12:41:13.516274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.646 qpair failed and we were unable to recover it. 00:27:19.646 [2024-07-12 12:41:13.526139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.646 [2024-07-12 12:41:13.526226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.646 [2024-07-12 12:41:13.526251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.646 [2024-07-12 12:41:13.526265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.646 [2024-07-12 12:41:13.526279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.646 [2024-07-12 12:41:13.526306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.646 qpair failed and we were unable to recover it. 00:27:19.646 [2024-07-12 12:41:13.536252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.646 [2024-07-12 12:41:13.536343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.646 [2024-07-12 12:41:13.536368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.646 [2024-07-12 12:41:13.536382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.646 [2024-07-12 12:41:13.536395] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.646 [2024-07-12 12:41:13.536422] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.646 qpair failed and we were unable to recover it. 00:27:19.646 [2024-07-12 12:41:13.546233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.646 [2024-07-12 12:41:13.546324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.646 [2024-07-12 12:41:13.546349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.646 [2024-07-12 12:41:13.546364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.646 [2024-07-12 12:41:13.546377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.646 [2024-07-12 12:41:13.546405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.646 qpair failed and we were unable to recover it. 00:27:19.646 [2024-07-12 12:41:13.556261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.646 [2024-07-12 12:41:13.556355] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.646 [2024-07-12 12:41:13.556380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.646 [2024-07-12 12:41:13.556394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.646 [2024-07-12 12:41:13.556407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.646 [2024-07-12 12:41:13.556435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.646 qpair failed and we were unable to recover it. 00:27:19.904 [2024-07-12 12:41:13.566253] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.904 [2024-07-12 12:41:13.566346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.904 [2024-07-12 12:41:13.566372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.904 [2024-07-12 12:41:13.566387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.904 [2024-07-12 12:41:13.566400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.904 [2024-07-12 12:41:13.566429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.904 qpair failed and we were unable to recover it. 00:27:19.904 [2024-07-12 12:41:13.576360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.904 [2024-07-12 12:41:13.576502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.904 [2024-07-12 12:41:13.576527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.904 [2024-07-12 12:41:13.576542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.904 [2024-07-12 12:41:13.576555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.904 [2024-07-12 12:41:13.576583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.904 qpair failed and we were unable to recover it. 00:27:19.904 [2024-07-12 12:41:13.586395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.904 [2024-07-12 12:41:13.586518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.904 [2024-07-12 12:41:13.586542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.904 [2024-07-12 12:41:13.586557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.904 [2024-07-12 12:41:13.586570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.904 [2024-07-12 12:41:13.586597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.904 qpair failed and we were unable to recover it. 00:27:19.904 [2024-07-12 12:41:13.596328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.904 [2024-07-12 12:41:13.596454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.904 [2024-07-12 12:41:13.596479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.904 [2024-07-12 12:41:13.596494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.904 [2024-07-12 12:41:13.596507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.904 [2024-07-12 12:41:13.596535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.904 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.606386] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.606474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.606499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.606513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.606532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.606560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.616377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.616471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.616496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.616511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.616525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.616552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.626472] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.626562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.626587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.626602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.626615] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.626642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.636471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.636576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.636601] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.636616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.636629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.636656] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.646494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.646584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.646609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.646624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.646637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.646665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.656506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.656597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.656622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.656636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.656649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.656676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.666570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.666659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.666684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.666699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.666711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.666739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.676618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.676759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.676784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.676798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.676813] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.676843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.686632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.686721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.686746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.686761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.686774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.686801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.696631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.696726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.696752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.696768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.696786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.696815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.706681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.706801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.706826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.706841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.706854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.706888] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.716709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.716797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.716821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.716836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.716849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.716882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.726737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.726863] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.726894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.726909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.726922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.726950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.736818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.736912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.736946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.905 [2024-07-12 12:41:13.736961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.905 [2024-07-12 12:41:13.736974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:19.905 [2024-07-12 12:41:13.737001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:19.905 qpair failed and we were unable to recover it. 00:27:19.905 [2024-07-12 12:41:13.746837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.905 [2024-07-12 12:41:13.746954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.905 [2024-07-12 12:41:13.746987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.747004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.747017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.747048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.756862] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.756966] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.756992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.757008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.757022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.757052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.766889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.766987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.767013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.767030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.767043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.767074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.776924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.777010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.777037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.777052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.777065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.777095] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.786971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.787063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.787089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.787110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.787125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.787154] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.796942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.797036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.797061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.797076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.797090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.797120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.806964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.807050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.807076] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.807091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.807104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.807133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:19.906 [2024-07-12 12:41:13.817082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:19.906 [2024-07-12 12:41:13.817172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:19.906 [2024-07-12 12:41:13.817197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:19.906 [2024-07-12 12:41:13.817211] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:19.906 [2024-07-12 12:41:13.817225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:19.906 [2024-07-12 12:41:13.817253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:19.906 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.827055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.827172] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.827199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.827215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.827229] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.827259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.837057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.837146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.837174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.837189] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.837202] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.837232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.847122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.847212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.847238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.847253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.847266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.847295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.857141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.857231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.857257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.857271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.857285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.857314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.867136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.867232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.867257] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.867272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.867285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.867314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.877151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.877245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.877271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.877294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.877308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.877338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.887176] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.887262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.887287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.887302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.887315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.887344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.897198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.897329] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.165 [2024-07-12 12:41:13.897353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.165 [2024-07-12 12:41:13.897368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.165 [2024-07-12 12:41:13.897381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.165 [2024-07-12 12:41:13.897410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.165 qpair failed and we were unable to recover it. 00:27:20.165 [2024-07-12 12:41:13.907270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.165 [2024-07-12 12:41:13.907364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.907389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.907404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.907416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.907445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.917336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.917426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.917451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.917466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.917479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.917510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.927304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.927392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.927417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.927432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.927445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.927475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.937362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.937485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.937511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.937525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.937538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.937580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.947376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.947465] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.947491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.947505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.947518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.947549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.957444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.957542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.957568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.957583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.957596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.957625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.967431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.967518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.967548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.967564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.967577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.967621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.977452] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.977542] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.977568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.977583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.977595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.977624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.987489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.987580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.987605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.987619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.987632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.987661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:13.997536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:13.997628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:13.997653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:13.997668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:13.997681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:13.997710] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:14.007534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:14.007622] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:14.007647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:14.007662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:14.007676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:14.007711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:14.017683] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:14.017775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:14.017800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:14.017815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:14.017828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:14.017857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:14.027597] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:14.027690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:14.027715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:14.027729] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:14.027743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:14.027772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:14.037639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:14.037734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:14.037759] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:14.037775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:14.037789] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.166 [2024-07-12 12:41:14.037818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.166 qpair failed and we were unable to recover it. 00:27:20.166 [2024-07-12 12:41:14.047644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.166 [2024-07-12 12:41:14.047730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.166 [2024-07-12 12:41:14.047755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.166 [2024-07-12 12:41:14.047770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.166 [2024-07-12 12:41:14.047783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.167 [2024-07-12 12:41:14.047812] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.167 qpair failed and we were unable to recover it. 00:27:20.167 [2024-07-12 12:41:14.057749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.167 [2024-07-12 12:41:14.057836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.167 [2024-07-12 12:41:14.057874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.167 [2024-07-12 12:41:14.057893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.167 [2024-07-12 12:41:14.057907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.167 [2024-07-12 12:41:14.057937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.167 qpair failed and we were unable to recover it. 00:27:20.167 [2024-07-12 12:41:14.067731] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.167 [2024-07-12 12:41:14.067851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.167 [2024-07-12 12:41:14.067884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.167 [2024-07-12 12:41:14.067900] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.167 [2024-07-12 12:41:14.067913] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.167 [2024-07-12 12:41:14.067942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.167 qpair failed and we were unable to recover it. 00:27:20.167 [2024-07-12 12:41:14.077756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.167 [2024-07-12 12:41:14.077852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.167 [2024-07-12 12:41:14.077887] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.167 [2024-07-12 12:41:14.077903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.167 [2024-07-12 12:41:14.077917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.167 [2024-07-12 12:41:14.077947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.167 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.087764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.087857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.087893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.087909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.087923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.087954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.097799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.097920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.097947] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.097962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.097980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.098013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.107896] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.107996] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.108022] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.108037] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.108049] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.108078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.117887] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.118000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.118025] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.118040] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.118052] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.118080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.127911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.127993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.128018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.128033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.128045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.128075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.137923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.138012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.138037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.138052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.138065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.138094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.147981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.148113] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.148142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.148157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.148170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.148200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.157992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.158082] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.158108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.158123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.158136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.158180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.168086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.425 [2024-07-12 12:41:14.168183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.425 [2024-07-12 12:41:14.168207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.425 [2024-07-12 12:41:14.168221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.425 [2024-07-12 12:41:14.168233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.425 [2024-07-12 12:41:14.168262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.425 qpair failed and we were unable to recover it. 00:27:20.425 [2024-07-12 12:41:14.178033] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.178135] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.178160] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.178175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.178188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.178216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.188076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.188173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.188198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.188213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.188231] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.188263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.198108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.198209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.198234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.198249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.198262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.198291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.208120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.208209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.208233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.208248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.208261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.208289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.218185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.218297] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.218322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.218336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.218349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.218377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.228222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.228314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.228340] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.228355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.228368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.228397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.238215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.238308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.238333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.238348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.238361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.238389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.248241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.248333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.248357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.248372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.248385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.248415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.258260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.258349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.258374] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.258388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.258401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.258430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.268342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.268437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.268462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.268478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.268491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.268520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.278375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.278464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.278489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.278510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.278524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.278553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.288380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.288469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.288494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.288508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.288522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.288550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.298464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.298563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.298591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.298607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.298620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.298649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.308434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.308530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.308555] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.308570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.426 [2024-07-12 12:41:14.308583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.426 [2024-07-12 12:41:14.308612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.426 qpair failed and we were unable to recover it. 00:27:20.426 [2024-07-12 12:41:14.318476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.426 [2024-07-12 12:41:14.318567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.426 [2024-07-12 12:41:14.318593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.426 [2024-07-12 12:41:14.318607] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.427 [2024-07-12 12:41:14.318620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.427 [2024-07-12 12:41:14.318649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.427 qpair failed and we were unable to recover it. 00:27:20.427 [2024-07-12 12:41:14.328465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.427 [2024-07-12 12:41:14.328550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.427 [2024-07-12 12:41:14.328575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.427 [2024-07-12 12:41:14.328590] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.427 [2024-07-12 12:41:14.328603] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.427 [2024-07-12 12:41:14.328631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.427 qpair failed and we were unable to recover it. 00:27:20.427 [2024-07-12 12:41:14.338503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.427 [2024-07-12 12:41:14.338587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.427 [2024-07-12 12:41:14.338612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.427 [2024-07-12 12:41:14.338627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.427 [2024-07-12 12:41:14.338640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.427 [2024-07-12 12:41:14.338669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.427 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.348585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.348706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.348737] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.348762] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.348781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.348822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.358560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.358656] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.358682] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.358697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.358710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.358741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.368605] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.368690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.368716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.368737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.368751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.368781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.378599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.378684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.378710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.378725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.378739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.378768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.388696] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.388833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.388859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.388882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.388896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.388926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.398681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.398770] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.398795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.398810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.398823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.398853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.408704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.408790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.408815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.408829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.408843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.408879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.418736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.418877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.418902] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.418917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.418930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.418958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.428789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.428914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.428939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.428954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.428967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.428996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.438794] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.438898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.438924] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.438939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.438952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.438981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.448820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.448920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.448945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.448960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.448973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.449004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.458909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.459004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.459034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.459049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.459063] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.459106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.469022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.469143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.684 [2024-07-12 12:41:14.469174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.684 [2024-07-12 12:41:14.469190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.684 [2024-07-12 12:41:14.469203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.684 [2024-07-12 12:41:14.469233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.684 qpair failed and we were unable to recover it. 00:27:20.684 [2024-07-12 12:41:14.478959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.684 [2024-07-12 12:41:14.479062] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.479090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.479106] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.479119] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.479148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.488933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.489022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.489047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.489062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.489075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.489106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.498980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.499063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.499088] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.499103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.499116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.499151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.509012] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.509140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.509164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.509179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.509191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.509220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.519017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.519106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.519130] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.519145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.519158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.519188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.529040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.529132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.529157] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.529172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.529185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.529214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.539069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.539164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.539190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.539204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.539217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.539246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.549138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.549258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.549288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.549304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.549317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.549346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.559166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.559259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.559284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.559299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.559312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.559341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.569174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.569262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.569288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.569303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.569316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.569345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.579227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.579313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.579338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.579353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.579366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.579395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.589241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.589331] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.589356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.589370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.589383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.589430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.685 [2024-07-12 12:41:14.599284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.685 [2024-07-12 12:41:14.599403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.685 [2024-07-12 12:41:14.599429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.685 [2024-07-12 12:41:14.599443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.685 [2024-07-12 12:41:14.599456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.685 [2024-07-12 12:41:14.599485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.685 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.609302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.609395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.609423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.609438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.609451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.609481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.619378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.619471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.619497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.619512] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.619525] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.619554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.629361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.629459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.629486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.629501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.629514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.629544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.639405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.639497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.639533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.639549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.639563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.639592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.649416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.649509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.649535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.649550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.649564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.649593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.659417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.659508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.659534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.659549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.659562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.659591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.669465] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.669555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.669580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.669595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.669608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.669637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.679529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.679620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.679645] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.679659] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.679678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.679708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.689507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.689625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.689650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.689665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.689678] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.689707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.699541] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.699626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.699651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.699666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.699679] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.699720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.709596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.709690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.709715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.709730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.709743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.709772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.719609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.719694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.719719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.719734] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.719747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.719776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.729637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.729754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.729780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.729794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.729807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.729836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.739674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.739769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.739795] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.739810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.739823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.739852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.749736] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.749832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.749858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.749880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.749894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.749923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.759735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.759824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.759850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.944 [2024-07-12 12:41:14.759872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.944 [2024-07-12 12:41:14.759888] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.944 [2024-07-12 12:41:14.759919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.944 qpair failed and we were unable to recover it. 00:27:20.944 [2024-07-12 12:41:14.769840] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.944 [2024-07-12 12:41:14.769938] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.944 [2024-07-12 12:41:14.769964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.769979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.769997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.770029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.779844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.779987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.780012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.780027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.780040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.780069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.789824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.789940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.789965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.789980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.789993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.790022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.799889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.800026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.800051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.800066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.800079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.800121] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.809954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.810054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.810079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.810094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.810107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.810142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.819881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.819976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.820002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.820017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.820031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.820060] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.829942] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.830035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.830060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.830074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.830087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.830117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.839999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.840126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.840151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.840165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.840178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.840208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.850064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.850183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.850208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.850223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.850236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.850267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:20.945 [2024-07-12 12:41:14.860059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:20.945 [2024-07-12 12:41:14.860178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:20.945 [2024-07-12 12:41:14.860205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:20.945 [2024-07-12 12:41:14.860238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:20.945 [2024-07-12 12:41:14.860252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:20.945 [2024-07-12 12:41:14.860282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:20.945 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.870055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.870151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.870179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.870194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.870207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.870237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.880115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.880210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.880236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.880251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.880264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.880293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.890143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.890233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.890258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.890273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.890286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.890315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.900186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.900277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.900302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.900316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.900330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.900358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.910246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.910341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.910369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.910385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.910400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.910430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.920189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.920279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.920306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.920320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.920334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.920363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.930246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.930384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.930412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.930426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.930440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.204 [2024-07-12 12:41:14.930470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.204 qpair failed and we were unable to recover it. 00:27:21.204 [2024-07-12 12:41:14.940252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.204 [2024-07-12 12:41:14.940342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.204 [2024-07-12 12:41:14.940368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.204 [2024-07-12 12:41:14.940382] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.204 [2024-07-12 12:41:14.940396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:14.940427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:14.950300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:14.950441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:14.950471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:14.950487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:14.950500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:14.950529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:14.960331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:14.960421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:14.960446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:14.960462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:14.960475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:14.960504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:14.970348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:14.970466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:14.970491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:14.970506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:14.970519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:14.970549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:14.980349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:14.980436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:14.980462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:14.980476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:14.980490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:14.980518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:14.990421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:14.990511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:14.990535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:14.990550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:14.990563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:14.990598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.000474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.000561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.000586] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.000601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.000613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.000642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.010457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.010583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.010608] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.010622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.010636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.010665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.020491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.020578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.020603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.020618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.020632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.020661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.030561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.030655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.030680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.030695] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.030708] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.030751] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.040568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.040669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.040700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.040716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.040729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.040759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.050573] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.050661] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.050687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.050703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.050716] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.050746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.060613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.060706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.060731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.060745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.060758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.060787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.070740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.070879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.070904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.070919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.070932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.070961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.080669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.205 [2024-07-12 12:41:15.080799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.205 [2024-07-12 12:41:15.080825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.205 [2024-07-12 12:41:15.080840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.205 [2024-07-12 12:41:15.080853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.205 [2024-07-12 12:41:15.080896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.205 qpair failed and we were unable to recover it. 00:27:21.205 [2024-07-12 12:41:15.090677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.206 [2024-07-12 12:41:15.090768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.206 [2024-07-12 12:41:15.090793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.206 [2024-07-12 12:41:15.090808] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.206 [2024-07-12 12:41:15.090821] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.206 [2024-07-12 12:41:15.090849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-12 12:41:15.100716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.206 [2024-07-12 12:41:15.100808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.206 [2024-07-12 12:41:15.100834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.206 [2024-07-12 12:41:15.100848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.206 [2024-07-12 12:41:15.100861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.206 [2024-07-12 12:41:15.100897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-12 12:41:15.110856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.206 [2024-07-12 12:41:15.111010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.206 [2024-07-12 12:41:15.111038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.206 [2024-07-12 12:41:15.111055] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.206 [2024-07-12 12:41:15.111068] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.206 [2024-07-12 12:41:15.111097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.206 [2024-07-12 12:41:15.120766] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.206 [2024-07-12 12:41:15.120862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.206 [2024-07-12 12:41:15.120901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.206 [2024-07-12 12:41:15.120927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.206 [2024-07-12 12:41:15.120941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.206 [2024-07-12 12:41:15.120972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.206 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.130888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.130987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.131019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.131034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.131048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.131078] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.140898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.141017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.141043] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.141057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.141070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.141100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.150903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.151005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.151032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.151047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.151061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.151090] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.160954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.161050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.161075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.161090] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.161103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.161132] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.171009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.171139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.171164] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.171178] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.171196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.171225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.180955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.181076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.181102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.181117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.181130] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.181160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.190995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.191093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.191118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.191133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.191146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.191175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.201055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.201183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.201208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.201222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.201235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.201265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.211046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.211174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.211199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.211214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.211227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.211255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.465 qpair failed and we were unable to recover it. 00:27:21.465 [2024-07-12 12:41:15.221096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.465 [2024-07-12 12:41:15.221207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.465 [2024-07-12 12:41:15.221232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.465 [2024-07-12 12:41:15.221247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.465 [2024-07-12 12:41:15.221259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.465 [2024-07-12 12:41:15.221288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.231144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.231247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.231273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.231288] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.231301] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.231331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.241117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.241213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.241238] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.241253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.241266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.241295] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.251135] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.251228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.251253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.251268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.251281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.251310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.261150] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.261253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.261279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.261293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.261312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.261343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.271280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.271416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.271444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.271460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.271473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.271503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.281215] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.281309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.281334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.281349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.281362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.281391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.291313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.291410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.291435] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.291450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.291463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.291495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.301341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.301435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.301462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.301478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.301491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.301520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.311338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.311433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.311458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.311472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.311485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b68000b90 00:27:21.466 [2024-07-12 12:41:15.311515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.321429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.321520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.321551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.321568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.321581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b60000b90 00:27:21.466 [2024-07-12 12:41:15.321613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.331391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.331482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.331509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.331525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.331538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b60000b90 00:27:21.466 [2024-07-12 12:41:15.331568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.341425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.341513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.341545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.341564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.341578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b58000b90 00:27:21.466 [2024-07-12 12:41:15.341609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.351521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.351616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.351644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.351665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.351680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2b58000b90 00:27:21.466 [2024-07-12 12:41:15.351711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.351840] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:27:21.466 A controller has encountered a failure and is being reset. 00:27:21.466 [2024-07-12 12:41:15.361489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.466 [2024-07-12 12:41:15.361625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.466 [2024-07-12 12:41:15.361656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.466 [2024-07-12 12:41:15.361672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.466 [2024-07-12 12:41:15.361685] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:21.466 [2024-07-12 12:41:15.361714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:21.466 qpair failed and we were unable to recover it. 00:27:21.466 [2024-07-12 12:41:15.371496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:27:21.467 [2024-07-12 12:41:15.371581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:27:21.467 [2024-07-12 12:41:15.371609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:27:21.467 [2024-07-12 12:41:15.371624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:27:21.467 [2024-07-12 12:41:15.371637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x110e9f0 00:27:21.467 [2024-07-12 12:41:15.371666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:21.467 qpair failed and we were unable to recover it. 00:27:21.724 Controller properly reset. 00:27:21.724 Initializing NVMe Controllers 00:27:21.724 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:21.725 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:21.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:27:21.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:27:21.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:27:21.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:27:21.725 Initialization complete. Launching workers. 00:27:21.725 Starting thread on core 1 00:27:21.725 Starting thread on core 2 00:27:21.725 Starting thread on core 3 00:27:21.725 Starting thread on core 0 00:27:21.725 12:41:15 -- host/target_disconnect.sh@59 -- # sync 00:27:21.725 00:27:21.725 real 0m11.385s 00:27:21.725 user 0m21.210s 00:27:21.725 sys 0m5.398s 00:27:21.725 12:41:15 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:21.725 12:41:15 -- common/autotest_common.sh@10 -- # set +x 00:27:21.725 ************************************ 00:27:21.725 END TEST nvmf_target_disconnect_tc2 00:27:21.725 ************************************ 00:27:21.725 12:41:15 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:27:21.725 12:41:15 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:27:21.725 12:41:15 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:27:21.725 12:41:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:21.725 12:41:15 -- nvmf/common.sh@116 -- # sync 00:27:21.725 12:41:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:21.725 12:41:15 -- nvmf/common.sh@119 -- # set +e 00:27:21.725 12:41:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:21.725 12:41:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:21.725 rmmod nvme_tcp 00:27:21.725 rmmod nvme_fabrics 00:27:21.725 rmmod nvme_keyring 00:27:21.725 12:41:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:21.725 12:41:15 -- nvmf/common.sh@123 -- # set -e 00:27:21.725 12:41:15 -- nvmf/common.sh@124 -- # return 0 00:27:21.725 12:41:15 -- nvmf/common.sh@477 -- # '[' -n 1389819 ']' 00:27:21.725 12:41:15 -- nvmf/common.sh@478 -- # killprocess 1389819 00:27:21.725 12:41:15 -- common/autotest_common.sh@926 -- # '[' -z 1389819 ']' 00:27:21.725 12:41:15 -- common/autotest_common.sh@930 -- # kill -0 1389819 00:27:21.725 12:41:15 -- common/autotest_common.sh@931 -- # uname 00:27:21.725 12:41:15 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:21.725 12:41:15 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1389819 00:27:21.725 12:41:15 -- common/autotest_common.sh@932 -- # process_name=reactor_4 00:27:21.725 12:41:15 -- common/autotest_common.sh@936 -- # '[' reactor_4 = sudo ']' 00:27:21.725 12:41:15 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1389819' 00:27:21.725 killing process with pid 1389819 00:27:21.725 12:41:15 -- common/autotest_common.sh@945 -- # kill 1389819 00:27:21.725 12:41:15 -- common/autotest_common.sh@950 -- # wait 1389819 00:27:21.983 12:41:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:21.983 12:41:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:21.983 12:41:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:21.983 12:41:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:21.983 12:41:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:21.983 12:41:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:21.983 12:41:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:21.983 12:41:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:24.514 12:41:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:24.514 00:27:24.514 real 0m16.168s 00:27:24.514 user 0m47.131s 00:27:24.514 sys 0m7.376s 00:27:24.514 12:41:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:24.514 12:41:17 -- common/autotest_common.sh@10 -- # set +x 00:27:24.514 ************************************ 00:27:24.514 END TEST nvmf_target_disconnect 00:27:24.514 ************************************ 00:27:24.514 12:41:17 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:27:24.514 12:41:17 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:24.514 12:41:17 -- common/autotest_common.sh@10 -- # set +x 00:27:24.514 12:41:17 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:27:24.514 00:27:24.514 real 21m0.878s 00:27:24.514 user 60m54.025s 00:27:24.514 sys 4m57.779s 00:27:24.514 12:41:17 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:24.514 12:41:17 -- common/autotest_common.sh@10 -- # set +x 00:27:24.514 ************************************ 00:27:24.514 END TEST nvmf_tcp 00:27:24.514 ************************************ 00:27:24.514 12:41:17 -- spdk/autotest.sh@296 -- # [[ 0 -eq 0 ]] 00:27:24.514 12:41:17 -- spdk/autotest.sh@297 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:24.514 12:41:17 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:24.514 12:41:17 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:24.514 12:41:17 -- common/autotest_common.sh@10 -- # set +x 00:27:24.514 ************************************ 00:27:24.514 START TEST spdkcli_nvmf_tcp 00:27:24.514 ************************************ 00:27:24.514 12:41:17 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:27:24.514 * Looking for test storage... 00:27:24.514 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:27:24.514 12:41:17 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:27:24.514 12:41:17 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:27:24.514 12:41:17 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:27:24.514 12:41:17 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:24.514 12:41:17 -- nvmf/common.sh@7 -- # uname -s 00:27:24.514 12:41:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:24.514 12:41:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:24.514 12:41:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:24.514 12:41:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:24.515 12:41:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:24.515 12:41:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:24.515 12:41:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:24.515 12:41:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:24.515 12:41:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:24.515 12:41:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:24.515 12:41:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:24.515 12:41:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:24.515 12:41:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:24.515 12:41:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:24.515 12:41:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:24.515 12:41:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:24.515 12:41:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:24.515 12:41:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:24.515 12:41:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:24.515 12:41:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.515 12:41:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.515 12:41:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.515 12:41:17 -- paths/export.sh@5 -- # export PATH 00:27:24.515 12:41:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:24.515 12:41:17 -- nvmf/common.sh@46 -- # : 0 00:27:24.515 12:41:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:24.515 12:41:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:24.515 12:41:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:24.515 12:41:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:24.515 12:41:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:24.515 12:41:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:24.515 12:41:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:24.515 12:41:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:24.515 12:41:17 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:27:24.515 12:41:17 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:27:24.515 12:41:17 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:27:24.515 12:41:17 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:27:24.515 12:41:17 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:24.515 12:41:17 -- common/autotest_common.sh@10 -- # set +x 00:27:24.515 12:41:17 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:27:24.515 12:41:17 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1391032 00:27:24.515 12:41:17 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:27:24.515 12:41:17 -- spdkcli/common.sh@34 -- # waitforlisten 1391032 00:27:24.515 12:41:17 -- common/autotest_common.sh@819 -- # '[' -z 1391032 ']' 00:27:24.515 12:41:17 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:24.515 12:41:17 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:24.515 12:41:17 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:24.515 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:24.515 12:41:17 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:24.515 12:41:17 -- common/autotest_common.sh@10 -- # set +x 00:27:24.515 [2024-07-12 12:41:18.008995] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:24.515 [2024-07-12 12:41:18.009098] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1391032 ] 00:27:24.515 EAL: No free 2048 kB hugepages reported on node 1 00:27:24.515 [2024-07-12 12:41:18.067489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:27:24.515 [2024-07-12 12:41:18.176832] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:24.515 [2024-07-12 12:41:18.177039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:24.515 [2024-07-12 12:41:18.177046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:25.079 12:41:18 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:25.079 12:41:18 -- common/autotest_common.sh@852 -- # return 0 00:27:25.079 12:41:18 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:27:25.079 12:41:18 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:25.079 12:41:18 -- common/autotest_common.sh@10 -- # set +x 00:27:25.079 12:41:18 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:27:25.079 12:41:18 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:27:25.079 12:41:18 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:27:25.079 12:41:18 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:25.079 12:41:18 -- common/autotest_common.sh@10 -- # set +x 00:27:25.079 12:41:18 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:27:25.079 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:27:25.079 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:27:25.079 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:27:25.079 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:27:25.079 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:27:25.079 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:27:25.079 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:25.079 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:25.079 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:27:25.079 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:27:25.079 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:27:25.079 ' 00:27:25.643 [2024-07-12 12:41:19.368879] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:28.186 [2024-07-12 12:41:21.524852] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:29.119 [2024-07-12 12:41:22.745297] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:27:31.640 [2024-07-12 12:41:25.020565] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:27:33.537 [2024-07-12 12:41:26.995064] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:27:34.910 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:27:34.910 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:27:34.910 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:27:34.910 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:27:34.910 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:27:34.910 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:27:34.910 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:27:34.910 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:34.910 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:34.910 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:27:34.910 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:27:34.910 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:27:34.910 12:41:28 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:27:34.910 12:41:28 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:34.910 12:41:28 -- common/autotest_common.sh@10 -- # set +x 00:27:34.910 12:41:28 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:27:34.910 12:41:28 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:34.910 12:41:28 -- common/autotest_common.sh@10 -- # set +x 00:27:34.910 12:41:28 -- spdkcli/nvmf.sh@69 -- # check_match 00:27:34.910 12:41:28 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:27:35.168 12:41:29 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:27:35.168 12:41:29 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:27:35.168 12:41:29 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:27:35.168 12:41:29 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:35.168 12:41:29 -- common/autotest_common.sh@10 -- # set +x 00:27:35.168 12:41:29 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:27:35.168 12:41:29 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:35.168 12:41:29 -- common/autotest_common.sh@10 -- # set +x 00:27:35.168 12:41:29 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:27:35.168 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:27:35.168 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:35.168 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:27:35.168 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:27:35.168 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:27:35.168 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:27:35.168 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:27:35.168 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:27:35.168 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:27:35.168 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:27:35.168 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:27:35.168 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:27:35.168 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:27:35.168 ' 00:27:40.451 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:27:40.451 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:27:40.451 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:40.451 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:27:40.451 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:27:40.451 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:27:40.451 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:27:40.451 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:27:40.451 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:27:40.451 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:27:40.451 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:27:40.451 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:27:40.451 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:27:40.451 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:27:40.451 12:41:34 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:27:40.451 12:41:34 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:40.451 12:41:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.451 12:41:34 -- spdkcli/nvmf.sh@90 -- # killprocess 1391032 00:27:40.451 12:41:34 -- common/autotest_common.sh@926 -- # '[' -z 1391032 ']' 00:27:40.451 12:41:34 -- common/autotest_common.sh@930 -- # kill -0 1391032 00:27:40.451 12:41:34 -- common/autotest_common.sh@931 -- # uname 00:27:40.451 12:41:34 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:40.451 12:41:34 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1391032 00:27:40.451 12:41:34 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:40.451 12:41:34 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:40.451 12:41:34 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1391032' 00:27:40.451 killing process with pid 1391032 00:27:40.451 12:41:34 -- common/autotest_common.sh@945 -- # kill 1391032 00:27:40.451 [2024-07-12 12:41:34.264714] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:40.451 12:41:34 -- common/autotest_common.sh@950 -- # wait 1391032 00:27:40.709 12:41:34 -- spdkcli/nvmf.sh@1 -- # cleanup 00:27:40.709 12:41:34 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:27:40.709 12:41:34 -- spdkcli/common.sh@13 -- # '[' -n 1391032 ']' 00:27:40.709 12:41:34 -- spdkcli/common.sh@14 -- # killprocess 1391032 00:27:40.709 12:41:34 -- common/autotest_common.sh@926 -- # '[' -z 1391032 ']' 00:27:40.709 12:41:34 -- common/autotest_common.sh@930 -- # kill -0 1391032 00:27:40.709 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1391032) - No such process 00:27:40.709 12:41:34 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1391032 is not found' 00:27:40.709 Process with pid 1391032 is not found 00:27:40.709 12:41:34 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:27:40.709 12:41:34 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:27:40.709 12:41:34 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:27:40.709 00:27:40.709 real 0m16.616s 00:27:40.709 user 0m35.100s 00:27:40.709 sys 0m0.790s 00:27:40.709 12:41:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:40.709 12:41:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.709 ************************************ 00:27:40.709 END TEST spdkcli_nvmf_tcp 00:27:40.709 ************************************ 00:27:40.709 12:41:34 -- spdk/autotest.sh@298 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:40.709 12:41:34 -- common/autotest_common.sh@1077 -- # '[' 3 -le 1 ']' 00:27:40.709 12:41:34 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:40.709 12:41:34 -- common/autotest_common.sh@10 -- # set +x 00:27:40.709 ************************************ 00:27:40.709 START TEST nvmf_identify_passthru 00:27:40.709 ************************************ 00:27:40.709 12:41:34 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:27:40.709 * Looking for test storage... 00:27:40.709 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:40.709 12:41:34 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:40.709 12:41:34 -- nvmf/common.sh@7 -- # uname -s 00:27:40.709 12:41:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:40.709 12:41:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:40.709 12:41:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:40.709 12:41:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:40.709 12:41:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:40.709 12:41:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:40.709 12:41:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:40.709 12:41:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:40.709 12:41:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:40.709 12:41:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:40.709 12:41:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:40.709 12:41:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:40.709 12:41:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:40.709 12:41:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:40.709 12:41:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:40.709 12:41:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:40.709 12:41:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:40.709 12:41:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:40.709 12:41:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:40.709 12:41:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- paths/export.sh@5 -- # export PATH 00:27:40.710 12:41:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- nvmf/common.sh@46 -- # : 0 00:27:40.710 12:41:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:40.710 12:41:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:40.710 12:41:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:40.710 12:41:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:40.710 12:41:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:40.710 12:41:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:40.710 12:41:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:40.710 12:41:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:40.710 12:41:34 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:40.710 12:41:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:40.710 12:41:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:40.710 12:41:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:40.710 12:41:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- paths/export.sh@5 -- # export PATH 00:27:40.710 12:41:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.710 12:41:34 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:27:40.710 12:41:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:40.710 12:41:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:40.710 12:41:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:40.710 12:41:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:40.710 12:41:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:40.710 12:41:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.710 12:41:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:40.710 12:41:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:40.710 12:41:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:40.710 12:41:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:40.710 12:41:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:40.710 12:41:34 -- common/autotest_common.sh@10 -- # set +x 00:27:42.612 12:41:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:42.612 12:41:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:42.612 12:41:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:42.612 12:41:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:42.612 12:41:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:42.612 12:41:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:42.612 12:41:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:42.612 12:41:36 -- nvmf/common.sh@294 -- # net_devs=() 00:27:42.612 12:41:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:42.612 12:41:36 -- nvmf/common.sh@295 -- # e810=() 00:27:42.612 12:41:36 -- nvmf/common.sh@295 -- # local -ga e810 00:27:42.612 12:41:36 -- nvmf/common.sh@296 -- # x722=() 00:27:42.612 12:41:36 -- nvmf/common.sh@296 -- # local -ga x722 00:27:42.612 12:41:36 -- nvmf/common.sh@297 -- # mlx=() 00:27:42.612 12:41:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:42.612 12:41:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:42.612 12:41:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:42.612 12:41:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:42.612 12:41:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:42.612 12:41:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:42.612 12:41:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:42.612 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:42.612 12:41:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:42.612 12:41:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:42.612 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:42.612 12:41:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:42.612 12:41:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:42.613 12:41:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:42.613 12:41:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:42.613 12:41:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:42.613 12:41:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:42.613 12:41:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:42.613 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:42.613 12:41:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:42.613 12:41:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:42.613 12:41:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:42.613 12:41:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:42.613 12:41:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:42.613 12:41:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:42.613 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:42.613 12:41:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:42.613 12:41:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:42.613 12:41:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:42.613 12:41:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:42.613 12:41:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:42.613 12:41:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:42.613 12:41:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:42.613 12:41:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:42.613 12:41:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:42.613 12:41:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:42.613 12:41:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:42.613 12:41:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:42.613 12:41:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:42.613 12:41:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:42.613 12:41:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:42.613 12:41:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:42.613 12:41:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:42.613 12:41:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:42.873 12:41:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:42.873 12:41:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:42.873 12:41:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:42.873 12:41:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:42.873 12:41:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:42.873 12:41:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:42.873 12:41:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:42.873 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:42.873 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.109 ms 00:27:42.873 00:27:42.873 --- 10.0.0.2 ping statistics --- 00:27:42.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:42.873 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:27:42.873 12:41:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:42.873 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:42.873 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.106 ms 00:27:42.873 00:27:42.873 --- 10.0.0.1 ping statistics --- 00:27:42.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:42.873 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:27:42.873 12:41:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:42.873 12:41:36 -- nvmf/common.sh@410 -- # return 0 00:27:42.873 12:41:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:42.873 12:41:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:42.873 12:41:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:42.873 12:41:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:42.873 12:41:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:42.873 12:41:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:42.873 12:41:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:42.873 12:41:36 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:27:42.873 12:41:36 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:42.873 12:41:36 -- common/autotest_common.sh@10 -- # set +x 00:27:42.873 12:41:36 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:27:42.873 12:41:36 -- common/autotest_common.sh@1509 -- # bdfs=() 00:27:42.873 12:41:36 -- common/autotest_common.sh@1509 -- # local bdfs 00:27:42.873 12:41:36 -- common/autotest_common.sh@1510 -- # bdfs=($(get_nvme_bdfs)) 00:27:42.873 12:41:36 -- common/autotest_common.sh@1510 -- # get_nvme_bdfs 00:27:42.873 12:41:36 -- common/autotest_common.sh@1498 -- # bdfs=() 00:27:42.873 12:41:36 -- common/autotest_common.sh@1498 -- # local bdfs 00:27:42.873 12:41:36 -- common/autotest_common.sh@1499 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:42.873 12:41:36 -- common/autotest_common.sh@1499 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:42.873 12:41:36 -- common/autotest_common.sh@1499 -- # jq -r '.config[].params.traddr' 00:27:42.873 12:41:36 -- common/autotest_common.sh@1500 -- # (( 1 == 0 )) 00:27:42.873 12:41:36 -- common/autotest_common.sh@1504 -- # printf '%s\n' 0000:88:00.0 00:27:42.873 12:41:36 -- common/autotest_common.sh@1512 -- # echo 0000:88:00.0 00:27:42.873 12:41:36 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:27:42.873 12:41:36 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:27:42.873 12:41:36 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:42.873 12:41:36 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:27:42.873 12:41:36 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:27:42.873 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.060 12:41:40 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:27:47.060 12:41:40 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:27:47.060 12:41:40 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:27:47.060 12:41:40 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:27:47.060 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.250 12:41:45 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:27:51.250 12:41:45 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:27:51.250 12:41:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:51.250 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.250 12:41:45 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:27:51.250 12:41:45 -- common/autotest_common.sh@712 -- # xtrace_disable 00:27:51.250 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.250 12:41:45 -- target/identify_passthru.sh@31 -- # nvmfpid=1395779 00:27:51.250 12:41:45 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:27:51.250 12:41:45 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:51.250 12:41:45 -- target/identify_passthru.sh@35 -- # waitforlisten 1395779 00:27:51.250 12:41:45 -- common/autotest_common.sh@819 -- # '[' -z 1395779 ']' 00:27:51.250 12:41:45 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:51.250 12:41:45 -- common/autotest_common.sh@824 -- # local max_retries=100 00:27:51.250 12:41:45 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:51.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:51.250 12:41:45 -- common/autotest_common.sh@828 -- # xtrace_disable 00:27:51.250 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.512 [2024-07-12 12:41:45.202168] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:27:51.512 [2024-07-12 12:41:45.202260] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:51.512 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.512 [2024-07-12 12:41:45.269337] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:51.512 [2024-07-12 12:41:45.375827] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:51.512 [2024-07-12 12:41:45.375992] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:51.512 [2024-07-12 12:41:45.376010] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:51.512 [2024-07-12 12:41:45.376022] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:51.512 [2024-07-12 12:41:45.376073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:51.512 [2024-07-12 12:41:45.376132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:51.512 [2024-07-12 12:41:45.376191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:51.512 [2024-07-12 12:41:45.376193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:51.512 12:41:45 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:27:51.512 12:41:45 -- common/autotest_common.sh@852 -- # return 0 00:27:51.512 12:41:45 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:27:51.512 12:41:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.512 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.512 INFO: Log level set to 20 00:27:51.512 INFO: Requests: 00:27:51.512 { 00:27:51.512 "jsonrpc": "2.0", 00:27:51.512 "method": "nvmf_set_config", 00:27:51.512 "id": 1, 00:27:51.512 "params": { 00:27:51.512 "admin_cmd_passthru": { 00:27:51.512 "identify_ctrlr": true 00:27:51.512 } 00:27:51.512 } 00:27:51.512 } 00:27:51.512 00:27:51.512 INFO: response: 00:27:51.512 { 00:27:51.512 "jsonrpc": "2.0", 00:27:51.512 "id": 1, 00:27:51.512 "result": true 00:27:51.512 } 00:27:51.512 00:27:51.512 12:41:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.512 12:41:45 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:27:51.512 12:41:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.512 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.512 INFO: Setting log level to 20 00:27:51.512 INFO: Setting log level to 20 00:27:51.512 INFO: Log level set to 20 00:27:51.512 INFO: Log level set to 20 00:27:51.512 INFO: Requests: 00:27:51.512 { 00:27:51.512 "jsonrpc": "2.0", 00:27:51.512 "method": "framework_start_init", 00:27:51.512 "id": 1 00:27:51.512 } 00:27:51.512 00:27:51.512 INFO: Requests: 00:27:51.512 { 00:27:51.512 "jsonrpc": "2.0", 00:27:51.512 "method": "framework_start_init", 00:27:51.512 "id": 1 00:27:51.512 } 00:27:51.512 00:27:51.769 [2024-07-12 12:41:45.505090] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:27:51.769 INFO: response: 00:27:51.769 { 00:27:51.769 "jsonrpc": "2.0", 00:27:51.769 "id": 1, 00:27:51.769 "result": true 00:27:51.769 } 00:27:51.769 00:27:51.769 INFO: response: 00:27:51.769 { 00:27:51.769 "jsonrpc": "2.0", 00:27:51.769 "id": 1, 00:27:51.769 "result": true 00:27:51.769 } 00:27:51.769 00:27:51.769 12:41:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.769 12:41:45 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:51.769 12:41:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.769 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.769 INFO: Setting log level to 40 00:27:51.769 INFO: Setting log level to 40 00:27:51.769 INFO: Setting log level to 40 00:27:51.769 [2024-07-12 12:41:45.515075] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:51.769 12:41:45 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:51.769 12:41:45 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:27:51.769 12:41:45 -- common/autotest_common.sh@718 -- # xtrace_disable 00:27:51.769 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:51.769 12:41:45 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:27:51.769 12:41:45 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:51.769 12:41:45 -- common/autotest_common.sh@10 -- # set +x 00:27:55.053 Nvme0n1 00:27:55.053 12:41:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:55.053 12:41:48 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:27:55.053 12:41:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:55.053 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:27:55.053 12:41:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:55.053 12:41:48 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:27:55.053 12:41:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:55.053 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:27:55.053 12:41:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:55.053 12:41:48 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:55.053 12:41:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:55.053 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:27:55.053 [2024-07-12 12:41:48.400204] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:55.053 12:41:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:55.053 12:41:48 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:27:55.053 12:41:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:55.053 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:27:55.053 [2024-07-12 12:41:48.407932] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:27:55.053 [ 00:27:55.053 { 00:27:55.053 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:27:55.053 "subtype": "Discovery", 00:27:55.053 "listen_addresses": [], 00:27:55.053 "allow_any_host": true, 00:27:55.053 "hosts": [] 00:27:55.053 }, 00:27:55.053 { 00:27:55.053 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:27:55.053 "subtype": "NVMe", 00:27:55.053 "listen_addresses": [ 00:27:55.053 { 00:27:55.053 "transport": "TCP", 00:27:55.053 "trtype": "TCP", 00:27:55.053 "adrfam": "IPv4", 00:27:55.053 "traddr": "10.0.0.2", 00:27:55.053 "trsvcid": "4420" 00:27:55.053 } 00:27:55.053 ], 00:27:55.053 "allow_any_host": true, 00:27:55.053 "hosts": [], 00:27:55.053 "serial_number": "SPDK00000000000001", 00:27:55.053 "model_number": "SPDK bdev Controller", 00:27:55.053 "max_namespaces": 1, 00:27:55.053 "min_cntlid": 1, 00:27:55.053 "max_cntlid": 65519, 00:27:55.053 "namespaces": [ 00:27:55.053 { 00:27:55.053 "nsid": 1, 00:27:55.053 "bdev_name": "Nvme0n1", 00:27:55.053 "name": "Nvme0n1", 00:27:55.053 "nguid": "4016B774EFE342BA8CFBB68B8E5D4ACB", 00:27:55.053 "uuid": "4016b774-efe3-42ba-8cfb-b68b8e5d4acb" 00:27:55.053 } 00:27:55.053 ] 00:27:55.053 } 00:27:55.053 ] 00:27:55.053 12:41:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:55.053 12:41:48 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:27:55.053 12:41:48 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:27:55.053 12:41:48 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:27:55.053 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.053 12:41:48 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:27:55.053 12:41:48 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:27:55.053 12:41:48 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:27:55.053 12:41:48 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:27:55.053 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.053 12:41:48 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:27:55.053 12:41:48 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:27:55.053 12:41:48 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:27:55.053 12:41:48 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:55.053 12:41:48 -- common/autotest_common.sh@551 -- # xtrace_disable 00:27:55.053 12:41:48 -- common/autotest_common.sh@10 -- # set +x 00:27:55.053 12:41:48 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:27:55.053 12:41:48 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:27:55.053 12:41:48 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:27:55.053 12:41:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:55.053 12:41:48 -- nvmf/common.sh@116 -- # sync 00:27:55.053 12:41:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:55.053 12:41:48 -- nvmf/common.sh@119 -- # set +e 00:27:55.053 12:41:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:55.053 12:41:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:55.053 rmmod nvme_tcp 00:27:55.053 rmmod nvme_fabrics 00:27:55.053 rmmod nvme_keyring 00:27:55.053 12:41:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:55.053 12:41:48 -- nvmf/common.sh@123 -- # set -e 00:27:55.053 12:41:48 -- nvmf/common.sh@124 -- # return 0 00:27:55.053 12:41:48 -- nvmf/common.sh@477 -- # '[' -n 1395779 ']' 00:27:55.053 12:41:48 -- nvmf/common.sh@478 -- # killprocess 1395779 00:27:55.053 12:41:48 -- common/autotest_common.sh@926 -- # '[' -z 1395779 ']' 00:27:55.053 12:41:48 -- common/autotest_common.sh@930 -- # kill -0 1395779 00:27:55.053 12:41:48 -- common/autotest_common.sh@931 -- # uname 00:27:55.053 12:41:48 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:27:55.053 12:41:48 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1395779 00:27:55.053 12:41:48 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:27:55.053 12:41:48 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:27:55.053 12:41:48 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1395779' 00:27:55.053 killing process with pid 1395779 00:27:55.053 12:41:48 -- common/autotest_common.sh@945 -- # kill 1395779 00:27:55.053 [2024-07-12 12:41:48.787623] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:27:55.053 12:41:48 -- common/autotest_common.sh@950 -- # wait 1395779 00:27:56.953 12:41:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:56.953 12:41:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:56.953 12:41:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:56.953 12:41:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:56.953 12:41:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:56.953 12:41:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:56.953 12:41:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:56.953 12:41:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:58.856 12:41:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:58.856 00:27:58.856 real 0m17.905s 00:27:58.856 user 0m26.362s 00:27:58.856 sys 0m2.259s 00:27:58.856 12:41:52 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:27:58.856 12:41:52 -- common/autotest_common.sh@10 -- # set +x 00:27:58.856 ************************************ 00:27:58.857 END TEST nvmf_identify_passthru 00:27:58.857 ************************************ 00:27:58.857 12:41:52 -- spdk/autotest.sh@300 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:27:58.857 12:41:52 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:27:58.857 12:41:52 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:27:58.857 12:41:52 -- common/autotest_common.sh@10 -- # set +x 00:27:58.857 ************************************ 00:27:58.857 START TEST nvmf_dif 00:27:58.857 ************************************ 00:27:58.857 12:41:52 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:27:58.857 * Looking for test storage... 00:27:58.857 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:27:58.857 12:41:52 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:58.857 12:41:52 -- nvmf/common.sh@7 -- # uname -s 00:27:58.857 12:41:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:58.857 12:41:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:58.857 12:41:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:58.857 12:41:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:58.857 12:41:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:58.857 12:41:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:58.857 12:41:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:58.857 12:41:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:58.857 12:41:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:58.857 12:41:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:58.857 12:41:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:58.857 12:41:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:58.857 12:41:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:58.857 12:41:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:58.857 12:41:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:58.857 12:41:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:58.857 12:41:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:58.857 12:41:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:58.857 12:41:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:58.857 12:41:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.857 12:41:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.857 12:41:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.857 12:41:52 -- paths/export.sh@5 -- # export PATH 00:27:58.857 12:41:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:58.857 12:41:52 -- nvmf/common.sh@46 -- # : 0 00:27:58.857 12:41:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:58.857 12:41:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:58.857 12:41:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:58.857 12:41:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:58.857 12:41:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:58.857 12:41:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:58.857 12:41:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:58.857 12:41:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:58.857 12:41:52 -- target/dif.sh@15 -- # NULL_META=16 00:27:58.857 12:41:52 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:27:58.857 12:41:52 -- target/dif.sh@15 -- # NULL_SIZE=64 00:27:58.857 12:41:52 -- target/dif.sh@15 -- # NULL_DIF=1 00:27:58.857 12:41:52 -- target/dif.sh@135 -- # nvmftestinit 00:27:58.857 12:41:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:58.857 12:41:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:58.857 12:41:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:58.857 12:41:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:58.857 12:41:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:58.857 12:41:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:58.857 12:41:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:27:58.857 12:41:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:58.857 12:41:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:58.857 12:41:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:58.857 12:41:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:58.857 12:41:52 -- common/autotest_common.sh@10 -- # set +x 00:28:00.759 12:41:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:00.759 12:41:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:00.759 12:41:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:00.759 12:41:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:00.759 12:41:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:00.759 12:41:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:00.759 12:41:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:00.759 12:41:54 -- nvmf/common.sh@294 -- # net_devs=() 00:28:00.759 12:41:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:00.759 12:41:54 -- nvmf/common.sh@295 -- # e810=() 00:28:00.759 12:41:54 -- nvmf/common.sh@295 -- # local -ga e810 00:28:00.759 12:41:54 -- nvmf/common.sh@296 -- # x722=() 00:28:00.759 12:41:54 -- nvmf/common.sh@296 -- # local -ga x722 00:28:00.759 12:41:54 -- nvmf/common.sh@297 -- # mlx=() 00:28:00.759 12:41:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:00.759 12:41:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:00.759 12:41:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:00.760 12:41:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:00.760 12:41:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:00.760 12:41:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:00.760 12:41:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:00.760 12:41:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:00.760 12:41:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:00.760 12:41:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:00.760 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:00.760 12:41:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:00.760 12:41:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:00.760 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:00.760 12:41:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:00.760 12:41:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:00.760 12:41:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:00.760 12:41:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:00.760 12:41:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:00.760 12:41:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:00.760 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:00.760 12:41:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:00.760 12:41:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:00.760 12:41:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:00.760 12:41:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:00.760 12:41:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:00.760 12:41:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:00.760 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:00.760 12:41:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:00.760 12:41:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:00.760 12:41:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:00.760 12:41:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:00.760 12:41:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:00.760 12:41:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:00.760 12:41:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:00.760 12:41:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:00.760 12:41:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:00.760 12:41:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:00.760 12:41:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:00.760 12:41:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:00.760 12:41:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:00.760 12:41:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:00.760 12:41:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:00.760 12:41:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:00.760 12:41:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:00.760 12:41:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:00.760 12:41:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:00.760 12:41:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:00.760 12:41:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:00.760 12:41:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:00.760 12:41:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:00.760 12:41:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:00.760 12:41:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:00.760 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:00.760 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:28:00.760 00:28:00.760 --- 10.0.0.2 ping statistics --- 00:28:00.760 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:00.760 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:28:00.760 12:41:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:00.760 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:00.760 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:28:00.760 00:28:00.760 --- 10.0.0.1 ping statistics --- 00:28:00.760 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:00.760 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:28:00.760 12:41:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:00.760 12:41:54 -- nvmf/common.sh@410 -- # return 0 00:28:00.760 12:41:54 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:00.760 12:41:54 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:02.136 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:02.136 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:02.136 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:02.136 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:02.136 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:02.136 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:02.136 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:02.136 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:02.136 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:02.136 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:02.136 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:02.136 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:02.136 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:02.136 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:02.136 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:02.136 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:02.136 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:02.136 12:41:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:02.136 12:41:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:02.136 12:41:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:02.137 12:41:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:02.137 12:41:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:02.137 12:41:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:02.137 12:41:55 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:02.137 12:41:55 -- target/dif.sh@137 -- # nvmfappstart 00:28:02.137 12:41:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:02.137 12:41:55 -- common/autotest_common.sh@712 -- # xtrace_disable 00:28:02.137 12:41:55 -- common/autotest_common.sh@10 -- # set +x 00:28:02.137 12:41:55 -- nvmf/common.sh@469 -- # nvmfpid=1399083 00:28:02.137 12:41:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:02.137 12:41:55 -- nvmf/common.sh@470 -- # waitforlisten 1399083 00:28:02.137 12:41:55 -- common/autotest_common.sh@819 -- # '[' -z 1399083 ']' 00:28:02.137 12:41:55 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:02.137 12:41:55 -- common/autotest_common.sh@824 -- # local max_retries=100 00:28:02.137 12:41:55 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:02.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:02.137 12:41:55 -- common/autotest_common.sh@828 -- # xtrace_disable 00:28:02.137 12:41:55 -- common/autotest_common.sh@10 -- # set +x 00:28:02.137 [2024-07-12 12:41:55.933226] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:28:02.137 [2024-07-12 12:41:55.933287] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:02.137 EAL: No free 2048 kB hugepages reported on node 1 00:28:02.137 [2024-07-12 12:41:55.997258] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:02.396 [2024-07-12 12:41:56.110524] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:02.396 [2024-07-12 12:41:56.110696] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:02.396 [2024-07-12 12:41:56.110717] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:02.396 [2024-07-12 12:41:56.110732] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:02.396 [2024-07-12 12:41:56.110763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:02.963 12:41:56 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:28:02.963 12:41:56 -- common/autotest_common.sh@852 -- # return 0 00:28:02.963 12:41:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:02.963 12:41:56 -- common/autotest_common.sh@718 -- # xtrace_disable 00:28:02.963 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.221 12:41:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:03.221 12:41:56 -- target/dif.sh@139 -- # create_transport 00:28:03.221 12:41:56 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:03.221 12:41:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:03.221 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.222 [2024-07-12 12:41:56.889055] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:03.222 12:41:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:03.222 12:41:56 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:03.222 12:41:56 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:03.222 12:41:56 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:03.222 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.222 ************************************ 00:28:03.222 START TEST fio_dif_1_default 00:28:03.222 ************************************ 00:28:03.222 12:41:56 -- common/autotest_common.sh@1104 -- # fio_dif_1 00:28:03.222 12:41:56 -- target/dif.sh@86 -- # create_subsystems 0 00:28:03.222 12:41:56 -- target/dif.sh@28 -- # local sub 00:28:03.222 12:41:56 -- target/dif.sh@30 -- # for sub in "$@" 00:28:03.222 12:41:56 -- target/dif.sh@31 -- # create_subsystem 0 00:28:03.222 12:41:56 -- target/dif.sh@18 -- # local sub_id=0 00:28:03.222 12:41:56 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:03.222 12:41:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:03.222 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.222 bdev_null0 00:28:03.222 12:41:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:03.222 12:41:56 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:03.222 12:41:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:03.222 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.222 12:41:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:03.222 12:41:56 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:03.222 12:41:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:03.222 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.222 12:41:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:03.222 12:41:56 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:03.222 12:41:56 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:03.222 12:41:56 -- common/autotest_common.sh@10 -- # set +x 00:28:03.222 [2024-07-12 12:41:56.925306] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:03.222 12:41:56 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:03.222 12:41:56 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:03.222 12:41:56 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:03.222 12:41:56 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:03.222 12:41:56 -- nvmf/common.sh@520 -- # config=() 00:28:03.222 12:41:56 -- nvmf/common.sh@520 -- # local subsystem config 00:28:03.222 12:41:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:03.222 12:41:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:03.222 { 00:28:03.222 "params": { 00:28:03.222 "name": "Nvme$subsystem", 00:28:03.222 "trtype": "$TEST_TRANSPORT", 00:28:03.222 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:03.222 "adrfam": "ipv4", 00:28:03.222 "trsvcid": "$NVMF_PORT", 00:28:03.222 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:03.222 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:03.222 "hdgst": ${hdgst:-false}, 00:28:03.222 "ddgst": ${ddgst:-false} 00:28:03.222 }, 00:28:03.222 "method": "bdev_nvme_attach_controller" 00:28:03.222 } 00:28:03.222 EOF 00:28:03.222 )") 00:28:03.222 12:41:56 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:03.222 12:41:56 -- target/dif.sh@82 -- # gen_fio_conf 00:28:03.222 12:41:56 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:03.222 12:41:56 -- target/dif.sh@54 -- # local file 00:28:03.222 12:41:56 -- target/dif.sh@56 -- # cat 00:28:03.222 12:41:56 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:03.222 12:41:56 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:03.222 12:41:56 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:03.222 12:41:56 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:03.222 12:41:56 -- common/autotest_common.sh@1320 -- # shift 00:28:03.222 12:41:56 -- nvmf/common.sh@542 -- # cat 00:28:03.222 12:41:56 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:03.222 12:41:56 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:03.222 12:41:56 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:03.222 12:41:56 -- target/dif.sh@72 -- # (( file <= files )) 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:03.222 12:41:56 -- nvmf/common.sh@544 -- # jq . 00:28:03.222 12:41:56 -- nvmf/common.sh@545 -- # IFS=, 00:28:03.222 12:41:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:03.222 "params": { 00:28:03.222 "name": "Nvme0", 00:28:03.222 "trtype": "tcp", 00:28:03.222 "traddr": "10.0.0.2", 00:28:03.222 "adrfam": "ipv4", 00:28:03.222 "trsvcid": "4420", 00:28:03.222 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:03.222 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:03.222 "hdgst": false, 00:28:03.222 "ddgst": false 00:28:03.222 }, 00:28:03.222 "method": "bdev_nvme_attach_controller" 00:28:03.222 }' 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:03.222 12:41:56 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:03.222 12:41:56 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:03.222 12:41:56 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:03.222 12:41:56 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:03.222 12:41:56 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:03.222 12:41:56 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:03.482 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:03.482 fio-3.35 00:28:03.482 Starting 1 thread 00:28:03.482 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.740 [2024-07-12 12:41:57.555807] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:03.740 [2024-07-12 12:41:57.555917] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:15.962 00:28:15.962 filename0: (groupid=0, jobs=1): err= 0: pid=1399325: Fri Jul 12 12:42:07 2024 00:28:15.962 read: IOPS=97, BW=392KiB/s (401kB/s)(3920KiB/10010msec) 00:28:15.962 slat (nsec): min=4858, max=76434, avg=8591.58, stdev=3908.12 00:28:15.962 clat (usec): min=636, max=44708, avg=40828.87, stdev=2585.34 00:28:15.962 lat (usec): min=644, max=44735, avg=40837.46, stdev=2585.35 00:28:15.962 clat percentiles (usec): 00:28:15.962 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:15.962 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:15.962 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:15.962 | 99.00th=[41157], 99.50th=[41681], 99.90th=[44827], 99.95th=[44827], 00:28:15.962 | 99.99th=[44827] 00:28:15.962 bw ( KiB/s): min= 384, max= 416, per=99.59%, avg=390.40, stdev=13.13, samples=20 00:28:15.962 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:28:15.962 lat (usec) : 750=0.41% 00:28:15.962 lat (msec) : 50=99.59% 00:28:15.962 cpu : usr=90.75%, sys=8.95%, ctx=17, majf=0, minf=280 00:28:15.962 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:15.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:15.962 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:15.962 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:15.962 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:15.962 00:28:15.962 Run status group 0 (all jobs): 00:28:15.962 READ: bw=392KiB/s (401kB/s), 392KiB/s-392KiB/s (401kB/s-401kB/s), io=3920KiB (4014kB), run=10010-10010msec 00:28:15.962 12:42:07 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:15.962 12:42:07 -- target/dif.sh@43 -- # local sub 00:28:15.962 12:42:07 -- target/dif.sh@45 -- # for sub in "$@" 00:28:15.962 12:42:07 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:15.962 12:42:07 -- target/dif.sh@36 -- # local sub_id=0 00:28:15.962 12:42:07 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:15.962 12:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:07 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:15.962 12:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 00:28:15.962 real 0m11.052s 00:28:15.962 user 0m10.047s 00:28:15.962 sys 0m1.169s 00:28:15.962 12:42:07 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 ************************************ 00:28:15.962 END TEST fio_dif_1_default 00:28:15.962 ************************************ 00:28:15.962 12:42:07 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:15.962 12:42:07 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:15.962 12:42:07 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 ************************************ 00:28:15.962 START TEST fio_dif_1_multi_subsystems 00:28:15.962 ************************************ 00:28:15.962 12:42:07 -- common/autotest_common.sh@1104 -- # fio_dif_1_multi_subsystems 00:28:15.962 12:42:07 -- target/dif.sh@92 -- # local files=1 00:28:15.962 12:42:07 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:15.962 12:42:07 -- target/dif.sh@28 -- # local sub 00:28:15.962 12:42:07 -- target/dif.sh@30 -- # for sub in "$@" 00:28:15.962 12:42:07 -- target/dif.sh@31 -- # create_subsystem 0 00:28:15.962 12:42:07 -- target/dif.sh@18 -- # local sub_id=0 00:28:15.962 12:42:07 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:15.962 12:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 bdev_null0 00:28:15.962 12:42:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:07 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:15.962 12:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:07 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:15.962 12:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:07 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:15.962 12:42:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:07 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 [2024-07-12 12:42:08.000849] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:15.962 12:42:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:08 -- target/dif.sh@30 -- # for sub in "$@" 00:28:15.962 12:42:08 -- target/dif.sh@31 -- # create_subsystem 1 00:28:15.962 12:42:08 -- target/dif.sh@18 -- # local sub_id=1 00:28:15.962 12:42:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:15.962 12:42:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:08 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 bdev_null1 00:28:15.962 12:42:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:15.962 12:42:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:08 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:15.962 12:42:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:08 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:15.962 12:42:08 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:15.962 12:42:08 -- common/autotest_common.sh@10 -- # set +x 00:28:15.962 12:42:08 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:15.962 12:42:08 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:15.962 12:42:08 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:15.962 12:42:08 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:15.962 12:42:08 -- nvmf/common.sh@520 -- # config=() 00:28:15.962 12:42:08 -- nvmf/common.sh@520 -- # local subsystem config 00:28:15.962 12:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:15.962 12:42:08 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:15.962 12:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:15.962 { 00:28:15.962 "params": { 00:28:15.962 "name": "Nvme$subsystem", 00:28:15.962 "trtype": "$TEST_TRANSPORT", 00:28:15.962 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:15.962 "adrfam": "ipv4", 00:28:15.962 "trsvcid": "$NVMF_PORT", 00:28:15.962 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:15.962 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:15.962 "hdgst": ${hdgst:-false}, 00:28:15.962 "ddgst": ${ddgst:-false} 00:28:15.962 }, 00:28:15.962 "method": "bdev_nvme_attach_controller" 00:28:15.962 } 00:28:15.962 EOF 00:28:15.962 )") 00:28:15.962 12:42:08 -- target/dif.sh@82 -- # gen_fio_conf 00:28:15.962 12:42:08 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:15.962 12:42:08 -- target/dif.sh@54 -- # local file 00:28:15.962 12:42:08 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:15.962 12:42:08 -- target/dif.sh@56 -- # cat 00:28:15.962 12:42:08 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:15.962 12:42:08 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:15.962 12:42:08 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:15.962 12:42:08 -- common/autotest_common.sh@1320 -- # shift 00:28:15.962 12:42:08 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:15.962 12:42:08 -- nvmf/common.sh@542 -- # cat 00:28:15.962 12:42:08 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:15.962 12:42:08 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:15.962 12:42:08 -- target/dif.sh@72 -- # (( file <= files )) 00:28:15.962 12:42:08 -- target/dif.sh@73 -- # cat 00:28:15.962 12:42:08 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:15.962 12:42:08 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:15.962 12:42:08 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:15.962 12:42:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:15.962 12:42:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:15.962 { 00:28:15.962 "params": { 00:28:15.962 "name": "Nvme$subsystem", 00:28:15.962 "trtype": "$TEST_TRANSPORT", 00:28:15.962 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:15.962 "adrfam": "ipv4", 00:28:15.962 "trsvcid": "$NVMF_PORT", 00:28:15.962 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:15.962 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:15.962 "hdgst": ${hdgst:-false}, 00:28:15.963 "ddgst": ${ddgst:-false} 00:28:15.963 }, 00:28:15.963 "method": "bdev_nvme_attach_controller" 00:28:15.963 } 00:28:15.963 EOF 00:28:15.963 )") 00:28:15.963 12:42:08 -- target/dif.sh@72 -- # (( file++ )) 00:28:15.963 12:42:08 -- target/dif.sh@72 -- # (( file <= files )) 00:28:15.963 12:42:08 -- nvmf/common.sh@542 -- # cat 00:28:15.963 12:42:08 -- nvmf/common.sh@544 -- # jq . 00:28:15.963 12:42:08 -- nvmf/common.sh@545 -- # IFS=, 00:28:15.963 12:42:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:15.963 "params": { 00:28:15.963 "name": "Nvme0", 00:28:15.963 "trtype": "tcp", 00:28:15.963 "traddr": "10.0.0.2", 00:28:15.963 "adrfam": "ipv4", 00:28:15.963 "trsvcid": "4420", 00:28:15.963 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:15.963 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:15.963 "hdgst": false, 00:28:15.963 "ddgst": false 00:28:15.963 }, 00:28:15.963 "method": "bdev_nvme_attach_controller" 00:28:15.963 },{ 00:28:15.963 "params": { 00:28:15.963 "name": "Nvme1", 00:28:15.963 "trtype": "tcp", 00:28:15.963 "traddr": "10.0.0.2", 00:28:15.963 "adrfam": "ipv4", 00:28:15.963 "trsvcid": "4420", 00:28:15.963 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:15.963 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:15.963 "hdgst": false, 00:28:15.963 "ddgst": false 00:28:15.963 }, 00:28:15.963 "method": "bdev_nvme_attach_controller" 00:28:15.963 }' 00:28:15.963 12:42:08 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:15.963 12:42:08 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:15.963 12:42:08 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:15.963 12:42:08 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:15.963 12:42:08 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:15.963 12:42:08 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:15.963 12:42:08 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:15.963 12:42:08 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:15.963 12:42:08 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:15.963 12:42:08 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:15.963 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:15.963 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:15.963 fio-3.35 00:28:15.963 Starting 2 threads 00:28:15.963 EAL: No free 2048 kB hugepages reported on node 1 00:28:15.963 [2024-07-12 12:42:08.924820] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:15.963 [2024-07-12 12:42:08.924909] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:25.926 00:28:25.926 filename0: (groupid=0, jobs=1): err= 0: pid=1401375: Fri Jul 12 12:42:19 2024 00:28:25.926 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10015msec) 00:28:25.926 slat (nsec): min=4073, max=35392, avg=10821.39, stdev=4680.30 00:28:25.926 clat (usec): min=40694, max=46188, avg=41007.08, stdev=357.67 00:28:25.926 lat (usec): min=40703, max=46217, avg=41017.90, stdev=357.76 00:28:25.926 clat percentiles (usec): 00:28:25.926 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:25.926 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:25.926 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:25.926 | 99.00th=[41681], 99.50th=[42206], 99.90th=[46400], 99.95th=[46400], 00:28:25.926 | 99.99th=[46400] 00:28:25.926 bw ( KiB/s): min= 384, max= 416, per=33.99%, avg=388.80, stdev=11.72, samples=20 00:28:25.926 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:25.926 lat (msec) : 50=100.00% 00:28:25.926 cpu : usr=96.86%, sys=2.83%, ctx=15, majf=0, minf=82 00:28:25.926 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:25.926 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.926 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.927 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:25.927 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:25.927 filename1: (groupid=0, jobs=1): err= 0: pid=1401376: Fri Jul 12 12:42:19 2024 00:28:25.927 read: IOPS=188, BW=753KiB/s (771kB/s)(7552KiB/10035msec) 00:28:25.927 slat (usec): min=5, max=110, avg= 9.48, stdev= 4.94 00:28:25.927 clat (usec): min=542, max=45697, avg=21229.93, stdev=20440.79 00:28:25.927 lat (usec): min=550, max=45726, avg=21239.41, stdev=20439.71 00:28:25.927 clat percentiles (usec): 00:28:25.927 | 1.00th=[ 570], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 611], 00:28:25.927 | 30.00th=[ 619], 40.00th=[ 635], 50.00th=[41157], 60.00th=[41157], 00:28:25.927 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:28:25.927 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876], 00:28:25.927 | 99.99th=[45876] 00:28:25.927 bw ( KiB/s): min= 673, max= 768, per=65.96%, avg=753.65, stdev=30.08, samples=20 00:28:25.927 iops : min= 168, max= 192, avg=188.40, stdev= 7.56, samples=20 00:28:25.927 lat (usec) : 750=48.25%, 1000=1.22% 00:28:25.927 lat (msec) : 2=0.11%, 50=50.42% 00:28:25.927 cpu : usr=96.95%, sys=2.76%, ctx=12, majf=0, minf=267 00:28:25.927 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:25.927 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.927 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:25.927 issued rwts: total=1888,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:25.927 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:25.927 00:28:25.927 Run status group 0 (all jobs): 00:28:25.927 READ: bw=1142KiB/s (1169kB/s), 390KiB/s-753KiB/s (399kB/s-771kB/s), io=11.2MiB (11.7MB), run=10015-10035msec 00:28:25.927 12:42:19 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:28:25.927 12:42:19 -- target/dif.sh@43 -- # local sub 00:28:25.927 12:42:19 -- target/dif.sh@45 -- # for sub in "$@" 00:28:25.927 12:42:19 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:25.927 12:42:19 -- target/dif.sh@36 -- # local sub_id=0 00:28:25.927 12:42:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@45 -- # for sub in "$@" 00:28:25.927 12:42:19 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:25.927 12:42:19 -- target/dif.sh@36 -- # local sub_id=1 00:28:25.927 12:42:19 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 00:28:25.927 real 0m11.410s 00:28:25.927 user 0m20.823s 00:28:25.927 sys 0m0.829s 00:28:25.927 12:42:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 ************************************ 00:28:25.927 END TEST fio_dif_1_multi_subsystems 00:28:25.927 ************************************ 00:28:25.927 12:42:19 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:28:25.927 12:42:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:25.927 12:42:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 ************************************ 00:28:25.927 START TEST fio_dif_rand_params 00:28:25.927 ************************************ 00:28:25.927 12:42:19 -- common/autotest_common.sh@1104 -- # fio_dif_rand_params 00:28:25.927 12:42:19 -- target/dif.sh@100 -- # local NULL_DIF 00:28:25.927 12:42:19 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:28:25.927 12:42:19 -- target/dif.sh@103 -- # NULL_DIF=3 00:28:25.927 12:42:19 -- target/dif.sh@103 -- # bs=128k 00:28:25.927 12:42:19 -- target/dif.sh@103 -- # numjobs=3 00:28:25.927 12:42:19 -- target/dif.sh@103 -- # iodepth=3 00:28:25.927 12:42:19 -- target/dif.sh@103 -- # runtime=5 00:28:25.927 12:42:19 -- target/dif.sh@105 -- # create_subsystems 0 00:28:25.927 12:42:19 -- target/dif.sh@28 -- # local sub 00:28:25.927 12:42:19 -- target/dif.sh@30 -- # for sub in "$@" 00:28:25.927 12:42:19 -- target/dif.sh@31 -- # create_subsystem 0 00:28:25.927 12:42:19 -- target/dif.sh@18 -- # local sub_id=0 00:28:25.927 12:42:19 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 bdev_null0 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:25.927 12:42:19 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:25.927 12:42:19 -- common/autotest_common.sh@10 -- # set +x 00:28:25.927 [2024-07-12 12:42:19.442615] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:25.927 12:42:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:25.927 12:42:19 -- target/dif.sh@106 -- # fio /dev/fd/62 00:28:25.927 12:42:19 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:28:25.927 12:42:19 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:25.927 12:42:19 -- nvmf/common.sh@520 -- # config=() 00:28:25.927 12:42:19 -- nvmf/common.sh@520 -- # local subsystem config 00:28:25.927 12:42:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:25.927 12:42:19 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.927 12:42:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:25.927 { 00:28:25.927 "params": { 00:28:25.927 "name": "Nvme$subsystem", 00:28:25.927 "trtype": "$TEST_TRANSPORT", 00:28:25.927 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:25.927 "adrfam": "ipv4", 00:28:25.927 "trsvcid": "$NVMF_PORT", 00:28:25.927 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:25.927 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:25.927 "hdgst": ${hdgst:-false}, 00:28:25.927 "ddgst": ${ddgst:-false} 00:28:25.927 }, 00:28:25.927 "method": "bdev_nvme_attach_controller" 00:28:25.927 } 00:28:25.927 EOF 00:28:25.927 )") 00:28:25.927 12:42:19 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.927 12:42:19 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:25.927 12:42:19 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:25.927 12:42:19 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:25.927 12:42:19 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.927 12:42:19 -- target/dif.sh@82 -- # gen_fio_conf 00:28:25.927 12:42:19 -- common/autotest_common.sh@1320 -- # shift 00:28:25.927 12:42:19 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:25.927 12:42:19 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.927 12:42:19 -- target/dif.sh@54 -- # local file 00:28:25.927 12:42:19 -- target/dif.sh@56 -- # cat 00:28:25.927 12:42:19 -- nvmf/common.sh@542 -- # cat 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:25.927 12:42:19 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:25.927 12:42:19 -- target/dif.sh@72 -- # (( file <= files )) 00:28:25.927 12:42:19 -- nvmf/common.sh@544 -- # jq . 00:28:25.927 12:42:19 -- nvmf/common.sh@545 -- # IFS=, 00:28:25.927 12:42:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:25.927 "params": { 00:28:25.927 "name": "Nvme0", 00:28:25.927 "trtype": "tcp", 00:28:25.927 "traddr": "10.0.0.2", 00:28:25.927 "adrfam": "ipv4", 00:28:25.927 "trsvcid": "4420", 00:28:25.927 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:25.927 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:25.927 "hdgst": false, 00:28:25.927 "ddgst": false 00:28:25.927 }, 00:28:25.927 "method": "bdev_nvme_attach_controller" 00:28:25.927 }' 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:25.927 12:42:19 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:25.927 12:42:19 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:25.927 12:42:19 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:25.927 12:42:19 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:25.927 12:42:19 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:25.927 12:42:19 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:25.927 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:25.927 ... 00:28:25.927 fio-3.35 00:28:25.927 Starting 3 threads 00:28:25.927 EAL: No free 2048 kB hugepages reported on node 1 00:28:26.491 [2024-07-12 12:42:20.242617] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:26.491 [2024-07-12 12:42:20.242676] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:31.755 00:28:31.755 filename0: (groupid=0, jobs=1): err= 0: pid=1402933: Fri Jul 12 12:42:25 2024 00:28:31.755 read: IOPS=236, BW=29.6MiB/s (31.0MB/s)(149MiB/5047msec) 00:28:31.755 slat (nsec): min=4413, max=50471, avg=17585.84, stdev=5071.46 00:28:31.755 clat (usec): min=4481, max=54678, avg=12623.12, stdev=6177.95 00:28:31.755 lat (usec): min=4493, max=54696, avg=12640.71, stdev=6178.03 00:28:31.755 clat percentiles (usec): 00:28:31.755 | 1.00th=[ 5473], 5.00th=[ 8356], 10.00th=[ 9110], 20.00th=[10159], 00:28:31.755 | 30.00th=[10814], 40.00th=[11469], 50.00th=[11994], 60.00th=[12387], 00:28:31.755 | 70.00th=[12911], 80.00th=[13566], 90.00th=[14353], 95.00th=[15401], 00:28:31.755 | 99.00th=[51643], 99.50th=[52691], 99.90th=[54264], 99.95th=[54789], 00:28:31.755 | 99.99th=[54789] 00:28:31.755 bw ( KiB/s): min=23552, max=33792, per=34.00%, avg=30489.60, stdev=3277.18, samples=10 00:28:31.755 iops : min= 184, max= 264, avg=238.20, stdev=25.60, samples=10 00:28:31.755 lat (msec) : 10=18.76%, 20=78.98%, 50=0.17%, 100=2.09% 00:28:31.755 cpu : usr=94.07%, sys=5.45%, ctx=10, majf=0, minf=92 00:28:31.755 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:31.755 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:31.755 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:31.755 issued rwts: total=1194,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:31.755 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:31.755 filename0: (groupid=0, jobs=1): err= 0: pid=1402934: Fri Jul 12 12:42:25 2024 00:28:31.755 read: IOPS=220, BW=27.6MiB/s (28.9MB/s)(138MiB/5004msec) 00:28:31.755 slat (nsec): min=4183, max=72999, avg=17457.57, stdev=4975.70 00:28:31.755 clat (usec): min=4578, max=92392, avg=13573.70, stdev=8376.98 00:28:31.755 lat (usec): min=4597, max=92408, avg=13591.16, stdev=8377.00 00:28:31.755 clat percentiles (usec): 00:28:31.755 | 1.00th=[ 7635], 5.00th=[ 8455], 10.00th=[ 9110], 20.00th=[10683], 00:28:31.755 | 30.00th=[11338], 40.00th=[11863], 50.00th=[12387], 60.00th=[12780], 00:28:31.755 | 70.00th=[13304], 80.00th=[14091], 90.00th=[15139], 95.00th=[16188], 00:28:31.755 | 99.00th=[53216], 99.50th=[54789], 99.90th=[90702], 99.95th=[92799], 00:28:31.755 | 99.99th=[92799] 00:28:31.755 bw ( KiB/s): min=18432, max=34304, per=31.46%, avg=28211.20, stdev=4741.65, samples=10 00:28:31.755 iops : min= 144, max= 268, avg=220.40, stdev=37.04, samples=10 00:28:31.755 lat (msec) : 10=14.49%, 20=82.34%, 50=0.09%, 100=3.08% 00:28:31.755 cpu : usr=93.76%, sys=5.10%, ctx=243, majf=0, minf=139 00:28:31.755 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:31.755 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:31.755 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:31.755 issued rwts: total=1104,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:31.755 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:31.755 filename0: (groupid=0, jobs=1): err= 0: pid=1402935: Fri Jul 12 12:42:25 2024 00:28:31.755 read: IOPS=245, BW=30.7MiB/s (32.2MB/s)(155MiB/5044msec) 00:28:31.755 slat (nsec): min=4091, max=54398, avg=18518.11, stdev=6482.93 00:28:31.755 clat (usec): min=5020, max=55075, avg=12167.61, stdev=5587.52 00:28:31.755 lat (usec): min=5033, max=55094, avg=12186.13, stdev=5587.51 00:28:31.755 clat percentiles (usec): 00:28:31.755 | 1.00th=[ 6587], 5.00th=[ 7504], 10.00th=[ 8029], 20.00th=[ 9241], 00:28:31.755 | 30.00th=[10552], 40.00th=[11338], 50.00th=[11863], 60.00th=[12387], 00:28:31.755 | 70.00th=[12911], 80.00th=[13566], 90.00th=[14615], 95.00th=[15533], 00:28:31.755 | 99.00th=[51643], 99.50th=[52691], 99.90th=[55313], 99.95th=[55313], 00:28:31.755 | 99.99th=[55313] 00:28:31.755 bw ( KiB/s): min=26112, max=36681, per=35.26%, avg=31623.30, stdev=2610.27, samples=10 00:28:31.755 iops : min= 204, max= 286, avg=247.00, stdev=20.27, samples=10 00:28:31.755 lat (msec) : 10=24.80%, 20=73.34%, 50=0.48%, 100=1.37% 00:28:31.755 cpu : usr=91.29%, sys=6.70%, ctx=203, majf=0, minf=130 00:28:31.755 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:31.755 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:31.755 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:31.755 issued rwts: total=1238,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:31.755 latency : target=0, window=0, percentile=100.00%, depth=3 00:28:31.755 00:28:31.755 Run status group 0 (all jobs): 00:28:31.756 READ: bw=87.6MiB/s (91.8MB/s), 27.6MiB/s-30.7MiB/s (28.9MB/s-32.2MB/s), io=442MiB (463MB), run=5004-5047msec 00:28:32.015 12:42:25 -- target/dif.sh@107 -- # destroy_subsystems 0 00:28:32.015 12:42:25 -- target/dif.sh@43 -- # local sub 00:28:32.015 12:42:25 -- target/dif.sh@45 -- # for sub in "$@" 00:28:32.015 12:42:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:32.015 12:42:25 -- target/dif.sh@36 -- # local sub_id=0 00:28:32.015 12:42:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@109 -- # NULL_DIF=2 00:28:32.015 12:42:25 -- target/dif.sh@109 -- # bs=4k 00:28:32.015 12:42:25 -- target/dif.sh@109 -- # numjobs=8 00:28:32.015 12:42:25 -- target/dif.sh@109 -- # iodepth=16 00:28:32.015 12:42:25 -- target/dif.sh@109 -- # runtime= 00:28:32.015 12:42:25 -- target/dif.sh@109 -- # files=2 00:28:32.015 12:42:25 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:28:32.015 12:42:25 -- target/dif.sh@28 -- # local sub 00:28:32.015 12:42:25 -- target/dif.sh@30 -- # for sub in "$@" 00:28:32.015 12:42:25 -- target/dif.sh@31 -- # create_subsystem 0 00:28:32.015 12:42:25 -- target/dif.sh@18 -- # local sub_id=0 00:28:32.015 12:42:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 bdev_null0 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 [2024-07-12 12:42:25.728753] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@30 -- # for sub in "$@" 00:28:32.015 12:42:25 -- target/dif.sh@31 -- # create_subsystem 1 00:28:32.015 12:42:25 -- target/dif.sh@18 -- # local sub_id=1 00:28:32.015 12:42:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 bdev_null1 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@30 -- # for sub in "$@" 00:28:32.015 12:42:25 -- target/dif.sh@31 -- # create_subsystem 2 00:28:32.015 12:42:25 -- target/dif.sh@18 -- # local sub_id=2 00:28:32.015 12:42:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 bdev_null2 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:28:32.015 12:42:25 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:32.015 12:42:25 -- common/autotest_common.sh@10 -- # set +x 00:28:32.015 12:42:25 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:32.015 12:42:25 -- target/dif.sh@112 -- # fio /dev/fd/62 00:28:32.015 12:42:25 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:28:32.015 12:42:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:28:32.015 12:42:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:32.015 12:42:25 -- nvmf/common.sh@520 -- # config=() 00:28:32.015 12:42:25 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:32.015 12:42:25 -- nvmf/common.sh@520 -- # local subsystem config 00:28:32.015 12:42:25 -- target/dif.sh@82 -- # gen_fio_conf 00:28:32.016 12:42:25 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:32.016 12:42:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:32.016 12:42:25 -- target/dif.sh@54 -- # local file 00:28:32.016 12:42:25 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:32.016 12:42:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:32.016 { 00:28:32.016 "params": { 00:28:32.016 "name": "Nvme$subsystem", 00:28:32.016 "trtype": "$TEST_TRANSPORT", 00:28:32.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:32.016 "adrfam": "ipv4", 00:28:32.016 "trsvcid": "$NVMF_PORT", 00:28:32.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:32.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:32.016 "hdgst": ${hdgst:-false}, 00:28:32.016 "ddgst": ${ddgst:-false} 00:28:32.016 }, 00:28:32.016 "method": "bdev_nvme_attach_controller" 00:28:32.016 } 00:28:32.016 EOF 00:28:32.016 )") 00:28:32.016 12:42:25 -- target/dif.sh@56 -- # cat 00:28:32.016 12:42:25 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:32.016 12:42:25 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:32.016 12:42:25 -- common/autotest_common.sh@1320 -- # shift 00:28:32.016 12:42:25 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:32.016 12:42:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:32.016 12:42:25 -- nvmf/common.sh@542 -- # cat 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:32.016 12:42:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:32.016 12:42:25 -- target/dif.sh@72 -- # (( file <= files )) 00:28:32.016 12:42:25 -- target/dif.sh@73 -- # cat 00:28:32.016 12:42:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:32.016 12:42:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:32.016 { 00:28:32.016 "params": { 00:28:32.016 "name": "Nvme$subsystem", 00:28:32.016 "trtype": "$TEST_TRANSPORT", 00:28:32.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:32.016 "adrfam": "ipv4", 00:28:32.016 "trsvcid": "$NVMF_PORT", 00:28:32.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:32.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:32.016 "hdgst": ${hdgst:-false}, 00:28:32.016 "ddgst": ${ddgst:-false} 00:28:32.016 }, 00:28:32.016 "method": "bdev_nvme_attach_controller" 00:28:32.016 } 00:28:32.016 EOF 00:28:32.016 )") 00:28:32.016 12:42:25 -- target/dif.sh@72 -- # (( file++ )) 00:28:32.016 12:42:25 -- target/dif.sh@72 -- # (( file <= files )) 00:28:32.016 12:42:25 -- nvmf/common.sh@542 -- # cat 00:28:32.016 12:42:25 -- target/dif.sh@73 -- # cat 00:28:32.016 12:42:25 -- target/dif.sh@72 -- # (( file++ )) 00:28:32.016 12:42:25 -- target/dif.sh@72 -- # (( file <= files )) 00:28:32.016 12:42:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:32.016 12:42:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:32.016 { 00:28:32.016 "params": { 00:28:32.016 "name": "Nvme$subsystem", 00:28:32.016 "trtype": "$TEST_TRANSPORT", 00:28:32.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:32.016 "adrfam": "ipv4", 00:28:32.016 "trsvcid": "$NVMF_PORT", 00:28:32.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:32.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:32.016 "hdgst": ${hdgst:-false}, 00:28:32.016 "ddgst": ${ddgst:-false} 00:28:32.016 }, 00:28:32.016 "method": "bdev_nvme_attach_controller" 00:28:32.016 } 00:28:32.016 EOF 00:28:32.016 )") 00:28:32.016 12:42:25 -- nvmf/common.sh@542 -- # cat 00:28:32.016 12:42:25 -- nvmf/common.sh@544 -- # jq . 00:28:32.016 12:42:25 -- nvmf/common.sh@545 -- # IFS=, 00:28:32.016 12:42:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:32.016 "params": { 00:28:32.016 "name": "Nvme0", 00:28:32.016 "trtype": "tcp", 00:28:32.016 "traddr": "10.0.0.2", 00:28:32.016 "adrfam": "ipv4", 00:28:32.016 "trsvcid": "4420", 00:28:32.016 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:32.016 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:32.016 "hdgst": false, 00:28:32.016 "ddgst": false 00:28:32.016 }, 00:28:32.016 "method": "bdev_nvme_attach_controller" 00:28:32.016 },{ 00:28:32.016 "params": { 00:28:32.016 "name": "Nvme1", 00:28:32.016 "trtype": "tcp", 00:28:32.016 "traddr": "10.0.0.2", 00:28:32.016 "adrfam": "ipv4", 00:28:32.016 "trsvcid": "4420", 00:28:32.016 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:32.016 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:32.016 "hdgst": false, 00:28:32.016 "ddgst": false 00:28:32.016 }, 00:28:32.016 "method": "bdev_nvme_attach_controller" 00:28:32.016 },{ 00:28:32.016 "params": { 00:28:32.016 "name": "Nvme2", 00:28:32.016 "trtype": "tcp", 00:28:32.016 "traddr": "10.0.0.2", 00:28:32.016 "adrfam": "ipv4", 00:28:32.016 "trsvcid": "4420", 00:28:32.016 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:28:32.016 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:28:32.016 "hdgst": false, 00:28:32.016 "ddgst": false 00:28:32.016 }, 00:28:32.016 "method": "bdev_nvme_attach_controller" 00:28:32.016 }' 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:32.016 12:42:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:32.016 12:42:25 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:32.016 12:42:25 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:32.016 12:42:25 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:32.016 12:42:25 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:32.016 12:42:25 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:32.275 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:32.275 ... 00:28:32.275 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:32.275 ... 00:28:32.275 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:28:32.275 ... 00:28:32.275 fio-3.35 00:28:32.275 Starting 24 threads 00:28:32.275 EAL: No free 2048 kB hugepages reported on node 1 00:28:32.846 [2024-07-12 12:42:26.738037] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:32.846 [2024-07-12 12:42:26.738109] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:45.068 00:28:45.068 filename0: (groupid=0, jobs=1): err= 0: pid=1403714: Fri Jul 12 12:42:37 2024 00:28:45.068 read: IOPS=86, BW=346KiB/s (354kB/s)(3520KiB/10171msec) 00:28:45.068 slat (nsec): min=6445, max=93933, avg=15856.56, stdev=13041.29 00:28:45.068 clat (msec): min=23, max=345, avg=184.75, stdev=48.24 00:28:45.068 lat (msec): min=23, max=345, avg=184.77, stdev=48.23 00:28:45.068 clat percentiles (msec): 00:28:45.068 | 1.00th=[ 24], 5.00th=[ 115], 10.00th=[ 142], 20.00th=[ 155], 00:28:45.068 | 30.00th=[ 159], 40.00th=[ 165], 50.00th=[ 180], 60.00th=[ 197], 00:28:45.068 | 70.00th=[ 209], 80.00th=[ 226], 90.00th=[ 257], 95.00th=[ 259], 00:28:45.068 | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 347], 99.95th=[ 347], 00:28:45.068 | 99.99th=[ 347] 00:28:45.068 bw ( KiB/s): min= 256, max= 512, per=5.94%, avg=345.60, stdev=66.36, samples=20 00:28:45.068 iops : min= 64, max= 128, avg=86.40, stdev=16.59, samples=20 00:28:45.068 lat (msec) : 50=1.59%, 100=2.50%, 250=82.95%, 500=12.95% 00:28:45.068 cpu : usr=98.19%, sys=1.41%, ctx=22, majf=0, minf=9 00:28:45.068 IO depths : 1=1.7%, 2=8.0%, 4=25.0%, 8=54.5%, 16=10.8%, 32=0.0%, >=64=0.0% 00:28:45.068 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.068 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.068 issued rwts: total=880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.068 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.068 filename0: (groupid=0, jobs=1): err= 0: pid=1403715: Fri Jul 12 12:42:37 2024 00:28:45.068 read: IOPS=58, BW=234KiB/s (239kB/s)(2368KiB/10134msec) 00:28:45.068 slat (usec): min=8, max=106, avg=54.81, stdev=26.35 00:28:45.068 clat (msec): min=154, max=470, avg=273.38, stdev=38.81 00:28:45.068 lat (msec): min=154, max=470, avg=273.43, stdev=38.80 00:28:45.068 clat percentiles (msec): 00:28:45.068 | 1.00th=[ 182], 5.00th=[ 209], 10.00th=[ 215], 20.00th=[ 259], 00:28:45.068 | 30.00th=[ 262], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.068 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 309], 95.00th=[ 321], 00:28:45.068 | 99.00th=[ 414], 99.50th=[ 468], 99.90th=[ 472], 99.95th=[ 472], 00:28:45.068 | 99.99th=[ 472] 00:28:45.068 bw ( KiB/s): min= 128, max= 272, per=3.96%, avg=230.40, stdev=52.79, samples=20 00:28:45.068 iops : min= 32, max= 68, avg=57.60, stdev=13.20, samples=20 00:28:45.068 lat (msec) : 250=19.93%, 500=80.07% 00:28:45.068 cpu : usr=98.30%, sys=1.16%, ctx=139, majf=0, minf=9 00:28:45.068 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:28:45.068 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.068 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.068 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.068 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.068 filename0: (groupid=0, jobs=1): err= 0: pid=1403716: Fri Jul 12 12:42:37 2024 00:28:45.068 read: IOPS=59, BW=240KiB/s (245kB/s)(2432KiB/10149msec) 00:28:45.068 slat (usec): min=10, max=127, avg=45.39, stdev=25.36 00:28:45.068 clat (msec): min=130, max=414, avg=266.68, stdev=45.97 00:28:45.068 lat (msec): min=130, max=414, avg=266.73, stdev=45.98 00:28:45.068 clat percentiles (msec): 00:28:45.068 | 1.00th=[ 131], 5.00th=[ 184], 10.00th=[ 209], 20.00th=[ 243], 00:28:45.068 | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 275], 00:28:45.068 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 309], 95.00th=[ 321], 00:28:45.068 | 99.00th=[ 368], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:28:45.068 | 99.99th=[ 414] 00:28:45.068 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=61.11, samples=20 00:28:45.069 iops : min= 32, max= 96, avg=59.20, stdev=15.28, samples=20 00:28:45.069 lat (msec) : 250=25.33%, 500=74.67% 00:28:45.069 cpu : usr=98.04%, sys=1.34%, ctx=62, majf=0, minf=9 00:28:45.069 IO depths : 1=4.9%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.6%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename0: (groupid=0, jobs=1): err= 0: pid=1403717: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=58, BW=234KiB/s (239kB/s)(2368KiB/10138msec) 00:28:45.069 slat (usec): min=8, max=109, avg=34.39, stdev=15.47 00:28:45.069 clat (msec): min=165, max=368, avg=273.71, stdev=37.09 00:28:45.069 lat (msec): min=165, max=369, avg=273.74, stdev=37.08 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 167], 5.00th=[ 209], 10.00th=[ 213], 20.00th=[ 245], 00:28:45.069 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.069 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 309], 95.00th=[ 321], 00:28:45.069 | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], 00:28:45.069 | 99.99th=[ 368] 00:28:45.069 bw ( KiB/s): min= 128, max= 272, per=3.96%, avg=230.40, stdev=49.08, samples=20 00:28:45.069 iops : min= 32, max= 68, avg=57.60, stdev=12.27, samples=20 00:28:45.069 lat (msec) : 250=20.61%, 500=79.39% 00:28:45.069 cpu : usr=98.28%, sys=1.30%, ctx=35, majf=0, minf=9 00:28:45.069 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename0: (groupid=0, jobs=1): err= 0: pid=1403718: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=59, BW=238KiB/s (244kB/s)(2424KiB/10166msec) 00:28:45.069 slat (usec): min=5, max=118, avg=65.05, stdev=21.57 00:28:45.069 clat (msec): min=146, max=472, avg=267.60, stdev=55.41 00:28:45.069 lat (msec): min=146, max=472, avg=267.66, stdev=55.42 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 146], 5.00th=[ 167], 10.00th=[ 184], 20.00th=[ 215], 00:28:45.069 | 30.00th=[ 259], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 275], 00:28:45.069 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 326], 00:28:45.069 | 99.00th=[ 456], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], 00:28:45.069 | 99.99th=[ 472] 00:28:45.069 bw ( KiB/s): min= 128, max= 384, per=4.04%, avg=236.00, stdev=59.39, samples=20 00:28:45.069 iops : min= 32, max= 96, avg=59.00, stdev=14.85, samples=20 00:28:45.069 lat (msec) : 250=27.72%, 500=72.28% 00:28:45.069 cpu : usr=98.09%, sys=1.41%, ctx=28, majf=0, minf=9 00:28:45.069 IO depths : 1=3.1%, 2=9.4%, 4=25.1%, 8=53.1%, 16=9.2%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=606,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename0: (groupid=0, jobs=1): err= 0: pid=1403719: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=58, BW=233KiB/s (239kB/s)(2368KiB/10150msec) 00:28:45.069 slat (usec): min=10, max=131, avg=81.38, stdev=18.89 00:28:45.069 clat (msec): min=186, max=324, avg=273.60, stdev=34.03 00:28:45.069 lat (msec): min=186, max=324, avg=273.68, stdev=34.03 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 186], 5.00th=[ 197], 10.00th=[ 213], 20.00th=[ 262], 00:28:45.069 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.069 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 321], 00:28:45.069 | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], 00:28:45.069 | 99.99th=[ 326] 00:28:45.069 bw ( KiB/s): min= 128, max= 272, per=3.96%, avg=230.40, stdev=52.79, samples=20 00:28:45.069 iops : min= 32, max= 68, avg=57.60, stdev=13.20, samples=20 00:28:45.069 lat (msec) : 250=18.58%, 500=81.42% 00:28:45.069 cpu : usr=98.34%, sys=1.17%, ctx=17, majf=0, minf=9 00:28:45.069 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename0: (groupid=0, jobs=1): err= 0: pid=1403720: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=58, BW=233KiB/s (239kB/s)(2360KiB/10132msec) 00:28:45.069 slat (usec): min=20, max=116, avg=78.67, stdev=15.32 00:28:45.069 clat (msec): min=155, max=472, avg=273.82, stdev=50.28 00:28:45.069 lat (msec): min=155, max=472, avg=273.90, stdev=50.28 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 165], 5.00th=[ 182], 10.00th=[ 209], 20.00th=[ 243], 00:28:45.069 | 30.00th=[ 262], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.069 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 351], 00:28:45.069 | 99.00th=[ 468], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], 00:28:45.069 | 99.99th=[ 472] 00:28:45.069 bw ( KiB/s): min= 128, max= 256, per=3.94%, avg=229.60, stdev=48.50, samples=20 00:28:45.069 iops : min= 32, max= 64, avg=57.40, stdev=12.12, samples=20 00:28:45.069 lat (msec) : 250=23.05%, 500=76.95% 00:28:45.069 cpu : usr=98.38%, sys=1.18%, ctx=14, majf=0, minf=9 00:28:45.069 IO depths : 1=3.4%, 2=9.7%, 4=25.1%, 8=52.9%, 16=9.0%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=590,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename0: (groupid=0, jobs=1): err= 0: pid=1403721: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=57, BW=229KiB/s (235kB/s)(2304KiB/10040msec) 00:28:45.069 slat (usec): min=7, max=117, avg=21.66, stdev=23.54 00:28:45.069 clat (msec): min=186, max=345, avg=278.67, stdev=35.20 00:28:45.069 lat (msec): min=186, max=345, avg=278.69, stdev=35.18 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 188], 5.00th=[ 207], 10.00th=[ 224], 20.00th=[ 262], 00:28:45.069 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.069 | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 338], 00:28:45.069 | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], 00:28:45.069 | 99.99th=[ 347] 00:28:45.069 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:28:45.069 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:28:45.069 lat (msec) : 250=11.11%, 500=88.89% 00:28:45.069 cpu : usr=98.06%, sys=1.20%, ctx=79, majf=0, minf=9 00:28:45.069 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename1: (groupid=0, jobs=1): err= 0: pid=1403722: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=58, BW=234KiB/s (239kB/s)(2368KiB/10134msec) 00:28:45.069 slat (usec): min=14, max=126, avg=81.67, stdev=17.79 00:28:45.069 clat (msec): min=155, max=471, avg=273.20, stdev=48.18 00:28:45.069 lat (msec): min=155, max=472, avg=273.28, stdev=48.18 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 159], 5.00th=[ 186], 10.00th=[ 211], 20.00th=[ 243], 00:28:45.069 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.069 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 326], 00:28:45.069 | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 472], 99.95th=[ 472], 00:28:45.069 | 99.99th=[ 472] 00:28:45.069 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=230.40, stdev=48.81, samples=20 00:28:45.069 iops : min= 32, max= 64, avg=57.60, stdev=12.20, samples=20 00:28:45.069 lat (msec) : 250=23.31%, 500=76.69% 00:28:45.069 cpu : usr=97.67%, sys=1.61%, ctx=120, majf=0, minf=9 00:28:45.069 IO depths : 1=3.9%, 2=10.1%, 4=25.0%, 8=52.4%, 16=8.6%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename1: (groupid=0, jobs=1): err= 0: pid=1403723: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=61, BW=245KiB/s (251kB/s)(2496KiB/10169msec) 00:28:45.069 slat (usec): min=6, max=152, avg=75.77, stdev=23.09 00:28:45.069 clat (msec): min=22, max=324, avg=260.08, stdev=58.52 00:28:45.069 lat (msec): min=22, max=324, avg=260.16, stdev=58.54 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 23], 5.00th=[ 116], 10.00th=[ 188], 20.00th=[ 234], 00:28:45.069 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 284], 00:28:45.069 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 321], 00:28:45.069 | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], 00:28:45.069 | 99.99th=[ 326] 00:28:45.069 bw ( KiB/s): min= 128, max= 512, per=4.18%, avg=243.20, stdev=82.01, samples=20 00:28:45.069 iops : min= 32, max= 128, avg=60.80, stdev=20.50, samples=20 00:28:45.069 lat (msec) : 50=2.24%, 100=0.64%, 250=22.44%, 500=74.68% 00:28:45.069 cpu : usr=97.70%, sys=1.63%, ctx=43, majf=0, minf=9 00:28:45.069 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.069 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.069 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.069 filename1: (groupid=0, jobs=1): err= 0: pid=1403724: Fri Jul 12 12:42:37 2024 00:28:45.069 read: IOPS=58, BW=234KiB/s (239kB/s)(2368KiB/10137msec) 00:28:45.069 slat (usec): min=13, max=122, avg=45.32, stdev=25.69 00:28:45.069 clat (msec): min=156, max=472, avg=273.60, stdev=36.38 00:28:45.069 lat (msec): min=156, max=472, avg=273.64, stdev=36.38 00:28:45.069 clat percentiles (msec): 00:28:45.069 | 1.00th=[ 169], 5.00th=[ 209], 10.00th=[ 215], 20.00th=[ 259], 00:28:45.069 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.069 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 309], 95.00th=[ 321], 00:28:45.069 | 99.00th=[ 326], 99.50th=[ 368], 99.90th=[ 472], 99.95th=[ 472], 00:28:45.069 | 99.99th=[ 472] 00:28:45.069 bw ( KiB/s): min= 128, max= 272, per=3.96%, avg=230.40, stdev=50.97, samples=20 00:28:45.069 iops : min= 32, max= 68, avg=57.60, stdev=12.74, samples=20 00:28:45.069 lat (msec) : 250=19.59%, 500=80.41% 00:28:45.069 cpu : usr=98.20%, sys=1.27%, ctx=29, majf=0, minf=9 00:28:45.069 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:28:45.069 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename1: (groupid=0, jobs=1): err= 0: pid=1403725: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=58, BW=233KiB/s (239kB/s)(2368KiB/10149msec) 00:28:45.070 slat (usec): min=8, max=101, avg=29.48, stdev=15.64 00:28:45.070 clat (msec): min=171, max=355, avg=274.04, stdev=36.26 00:28:45.070 lat (msec): min=171, max=355, avg=274.07, stdev=36.25 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 186], 5.00th=[ 197], 10.00th=[ 213], 20.00th=[ 251], 00:28:45.070 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.070 | 99.00th=[ 351], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:28:45.070 | 99.99th=[ 355] 00:28:45.070 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=230.40, stdev=50.70, samples=20 00:28:45.070 iops : min= 32, max= 64, avg=57.60, stdev=12.68, samples=20 00:28:45.070 lat (msec) : 250=17.91%, 500=82.09% 00:28:45.070 cpu : usr=98.00%, sys=1.33%, ctx=68, majf=0, minf=9 00:28:45.070 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.7%, 16=9.0%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename1: (groupid=0, jobs=1): err= 0: pid=1403726: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=57, BW=229KiB/s (235kB/s)(2304KiB/10041msec) 00:28:45.070 slat (usec): min=21, max=116, avg=77.31, stdev=13.92 00:28:45.070 clat (msec): min=76, max=439, avg=278.23, stdev=43.24 00:28:45.070 lat (msec): min=76, max=439, avg=278.30, stdev=43.24 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 144], 5.00th=[ 205], 10.00th=[ 224], 20.00th=[ 262], 00:28:45.070 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 305], 80.00th=[ 309], 90.00th=[ 326], 95.00th=[ 338], 00:28:45.070 | 99.00th=[ 388], 99.50th=[ 426], 99.90th=[ 439], 99.95th=[ 439], 00:28:45.070 | 99.99th=[ 439] 00:28:45.070 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=69.06, samples=20 00:28:45.070 iops : min= 32, max= 96, avg=56.00, stdev=17.27, samples=20 00:28:45.070 lat (msec) : 100=0.35%, 250=11.81%, 500=87.85% 00:28:45.070 cpu : usr=97.64%, sys=1.52%, ctx=97, majf=0, minf=9 00:28:45.070 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename1: (groupid=0, jobs=1): err= 0: pid=1403727: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=59, BW=240KiB/s (245kB/s)(2432KiB/10150msec) 00:28:45.070 slat (nsec): min=7755, max=53366, avg=28221.26, stdev=7017.32 00:28:45.070 clat (msec): min=130, max=355, avg=266.83, stdev=45.02 00:28:45.070 lat (msec): min=130, max=355, avg=266.86, stdev=45.02 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 131], 5.00th=[ 184], 10.00th=[ 209], 20.00th=[ 228], 00:28:45.070 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.070 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:28:45.070 | 99.99th=[ 355] 00:28:45.070 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=61.11, samples=20 00:28:45.070 iops : min= 32, max= 96, avg=59.20, stdev=15.28, samples=20 00:28:45.070 lat (msec) : 250=25.00%, 500=75.00% 00:28:45.070 cpu : usr=98.21%, sys=1.43%, ctx=24, majf=0, minf=9 00:28:45.070 IO depths : 1=3.1%, 2=9.4%, 4=25.0%, 8=53.1%, 16=9.4%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename1: (groupid=0, jobs=1): err= 0: pid=1403728: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=59, BW=239KiB/s (245kB/s)(2432KiB/10165msec) 00:28:45.070 slat (nsec): min=8188, max=45806, avg=21051.61, stdev=6578.39 00:28:45.070 clat (msec): min=146, max=324, avg=267.30, stdev=42.07 00:28:45.070 lat (msec): min=146, max=324, avg=267.32, stdev=42.07 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 146], 5.00th=[ 186], 10.00th=[ 199], 20.00th=[ 234], 00:28:45.070 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.070 | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], 00:28:45.070 | 99.99th=[ 326] 00:28:45.070 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=62.64, samples=20 00:28:45.070 iops : min= 32, max= 96, avg=59.20, stdev=15.66, samples=20 00:28:45.070 lat (msec) : 250=22.86%, 500=77.14% 00:28:45.070 cpu : usr=98.02%, sys=1.36%, ctx=122, majf=0, minf=9 00:28:45.070 IO depths : 1=5.1%, 2=11.3%, 4=25.0%, 8=51.2%, 16=7.4%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename1: (groupid=0, jobs=1): err= 0: pid=1403729: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=59, BW=239KiB/s (245kB/s)(2432KiB/10164msec) 00:28:45.070 slat (usec): min=8, max=116, avg=33.32, stdev=13.41 00:28:45.070 clat (msec): min=145, max=354, avg=267.18, stdev=42.27 00:28:45.070 lat (msec): min=145, max=354, avg=267.21, stdev=42.27 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 146], 5.00th=[ 184], 10.00th=[ 209], 20.00th=[ 232], 00:28:45.070 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.070 | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 355], 99.95th=[ 355], 00:28:45.070 | 99.99th=[ 355] 00:28:45.070 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=62.64, samples=20 00:28:45.070 iops : min= 32, max= 96, avg=59.20, stdev=15.66, samples=20 00:28:45.070 lat (msec) : 250=24.34%, 500=75.66% 00:28:45.070 cpu : usr=97.01%, sys=1.83%, ctx=179, majf=0, minf=9 00:28:45.070 IO depths : 1=5.6%, 2=11.8%, 4=25.0%, 8=50.7%, 16=6.9%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename2: (groupid=0, jobs=1): err= 0: pid=1403730: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=58, BW=233KiB/s (239kB/s)(2368KiB/10151msec) 00:28:45.070 slat (usec): min=7, max=113, avg=66.51, stdev=25.08 00:28:45.070 clat (msec): min=160, max=355, avg=273.73, stdev=36.02 00:28:45.070 lat (msec): min=160, max=355, avg=273.79, stdev=36.02 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 186], 5.00th=[ 197], 10.00th=[ 213], 20.00th=[ 251], 00:28:45.070 | 30.00th=[ 262], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.070 | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:28:45.070 | 99.99th=[ 355] 00:28:45.070 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=230.40, stdev=50.70, samples=20 00:28:45.070 iops : min= 32, max= 64, avg=57.60, stdev=12.68, samples=20 00:28:45.070 lat (msec) : 250=19.93%, 500=80.07% 00:28:45.070 cpu : usr=98.38%, sys=1.17%, ctx=18, majf=0, minf=9 00:28:45.070 IO depths : 1=3.7%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.8%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename2: (groupid=0, jobs=1): err= 0: pid=1403731: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=58, BW=233KiB/s (238kB/s)(2360KiB/10142msec) 00:28:45.070 slat (usec): min=15, max=104, avg=41.03, stdev=17.72 00:28:45.070 clat (msec): min=154, max=474, avg=274.40, stdev=50.77 00:28:45.070 lat (msec): min=154, max=474, avg=274.44, stdev=50.77 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 165], 5.00th=[ 180], 10.00th=[ 209], 20.00th=[ 243], 00:28:45.070 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 351], 00:28:45.070 | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 477], 99.95th=[ 477], 00:28:45.070 | 99.99th=[ 477] 00:28:45.070 bw ( KiB/s): min= 128, max= 272, per=3.94%, avg=229.60, stdev=48.77, samples=20 00:28:45.070 iops : min= 32, max= 68, avg=57.40, stdev=12.19, samples=20 00:28:45.070 lat (msec) : 250=23.05%, 500=76.95% 00:28:45.070 cpu : usr=98.39%, sys=1.16%, ctx=15, majf=0, minf=9 00:28:45.070 IO depths : 1=3.2%, 2=9.5%, 4=25.1%, 8=53.1%, 16=9.2%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=590,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename2: (groupid=0, jobs=1): err= 0: pid=1403732: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=59, BW=240KiB/s (245kB/s)(2432KiB/10149msec) 00:28:45.070 slat (nsec): min=8016, max=93903, avg=24638.35, stdev=15527.23 00:28:45.070 clat (msec): min=130, max=324, avg=266.86, stdev=43.92 00:28:45.070 lat (msec): min=130, max=324, avg=266.88, stdev=43.92 00:28:45.070 clat percentiles (msec): 00:28:45.070 | 1.00th=[ 131], 5.00th=[ 184], 10.00th=[ 201], 20.00th=[ 232], 00:28:45.070 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.070 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.070 | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], 00:28:45.070 | 99.99th=[ 326] 00:28:45.070 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=61.11, samples=20 00:28:45.070 iops : min= 32, max= 96, avg=59.20, stdev=15.28, samples=20 00:28:45.070 lat (msec) : 250=22.37%, 500=77.63% 00:28:45.070 cpu : usr=98.14%, sys=1.28%, ctx=45, majf=0, minf=9 00:28:45.070 IO depths : 1=4.9%, 2=11.2%, 4=25.0%, 8=51.3%, 16=7.6%, 32=0.0%, >=64=0.0% 00:28:45.070 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.070 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.070 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.070 filename2: (groupid=0, jobs=1): err= 0: pid=1403733: Fri Jul 12 12:42:37 2024 00:28:45.070 read: IOPS=58, BW=233KiB/s (238kB/s)(2360KiB/10141msec) 00:28:45.071 slat (usec): min=8, max=103, avg=37.97, stdev=17.77 00:28:45.071 clat (msec): min=154, max=473, avg=274.35, stdev=50.70 00:28:45.071 lat (msec): min=154, max=473, avg=274.39, stdev=50.70 00:28:45.071 clat percentiles (msec): 00:28:45.071 | 1.00th=[ 165], 5.00th=[ 180], 10.00th=[ 209], 20.00th=[ 243], 00:28:45.071 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.071 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 351], 00:28:45.071 | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], 00:28:45.071 | 99.99th=[ 472] 00:28:45.071 bw ( KiB/s): min= 128, max= 256, per=3.94%, avg=229.60, stdev=48.50, samples=20 00:28:45.071 iops : min= 32, max= 64, avg=57.40, stdev=12.12, samples=20 00:28:45.071 lat (msec) : 250=23.05%, 500=76.95% 00:28:45.071 cpu : usr=98.46%, sys=1.11%, ctx=37, majf=0, minf=9 00:28:45.071 IO depths : 1=3.4%, 2=9.7%, 4=25.1%, 8=52.9%, 16=9.0%, 32=0.0%, >=64=0.0% 00:28:45.071 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 issued rwts: total=590,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.071 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.071 filename2: (groupid=0, jobs=1): err= 0: pid=1403734: Fri Jul 12 12:42:37 2024 00:28:45.071 read: IOPS=73, BW=296KiB/s (303kB/s)(3008KiB/10171msec) 00:28:45.071 slat (usec): min=6, max=101, avg=39.80, stdev=30.12 00:28:45.071 clat (msec): min=16, max=275, avg=216.00, stdev=58.92 00:28:45.071 lat (msec): min=16, max=275, avg=216.04, stdev=58.93 00:28:45.071 clat percentiles (msec): 00:28:45.071 | 1.00th=[ 23], 5.00th=[ 112], 10.00th=[ 155], 20.00th=[ 165], 00:28:45.071 | 30.00th=[ 186], 40.00th=[ 201], 50.00th=[ 234], 60.00th=[ 259], 00:28:45.071 | 70.00th=[ 262], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], 00:28:45.071 | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], 00:28:45.071 | 99.99th=[ 275] 00:28:45.071 bw ( KiB/s): min= 128, max= 512, per=5.06%, avg=294.40, stdev=81.82, samples=20 00:28:45.071 iops : min= 32, max= 128, avg=73.60, stdev=20.45, samples=20 00:28:45.071 lat (msec) : 20=0.93%, 50=1.20%, 100=2.13%, 250=46.54%, 500=49.20% 00:28:45.071 cpu : usr=98.17%, sys=1.31%, ctx=28, majf=0, minf=9 00:28:45.071 IO depths : 1=3.3%, 2=9.4%, 4=24.5%, 8=53.6%, 16=9.2%, 32=0.0%, >=64=0.0% 00:28:45.071 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 issued rwts: total=752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.071 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.071 filename2: (groupid=0, jobs=1): err= 0: pid=1403735: Fri Jul 12 12:42:37 2024 00:28:45.071 read: IOPS=58, BW=233KiB/s (239kB/s)(2368KiB/10146msec) 00:28:45.071 slat (usec): min=15, max=107, avg=38.59, stdev=13.60 00:28:45.071 clat (msec): min=165, max=414, avg=273.87, stdev=43.53 00:28:45.071 lat (msec): min=165, max=414, avg=273.91, stdev=43.52 00:28:45.071 clat percentiles (msec): 00:28:45.071 | 1.00th=[ 167], 5.00th=[ 186], 10.00th=[ 211], 20.00th=[ 245], 00:28:45.071 | 30.00th=[ 264], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.071 | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 326], 00:28:45.071 | 99.00th=[ 409], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], 00:28:45.071 | 99.99th=[ 414] 00:28:45.071 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=230.40, stdev=50.70, samples=20 00:28:45.071 iops : min= 32, max= 64, avg=57.60, stdev=12.68, samples=20 00:28:45.071 lat (msec) : 250=21.96%, 500=78.04% 00:28:45.071 cpu : usr=98.36%, sys=1.19%, ctx=11, majf=0, minf=9 00:28:45.071 IO depths : 1=4.2%, 2=10.5%, 4=25.0%, 8=52.0%, 16=8.3%, 32=0.0%, >=64=0.0% 00:28:45.071 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.071 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.071 filename2: (groupid=0, jobs=1): err= 0: pid=1403736: Fri Jul 12 12:42:37 2024 00:28:45.071 read: IOPS=59, BW=239KiB/s (245kB/s)(2432KiB/10164msec) 00:28:45.071 slat (nsec): min=7934, max=92046, avg=33330.73, stdev=12766.50 00:28:45.071 clat (msec): min=145, max=355, avg=267.18, stdev=42.97 00:28:45.071 lat (msec): min=145, max=355, avg=267.21, stdev=42.97 00:28:45.071 clat percentiles (msec): 00:28:45.071 | 1.00th=[ 146], 5.00th=[ 184], 10.00th=[ 209], 20.00th=[ 232], 00:28:45.071 | 30.00th=[ 262], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 275], 00:28:45.071 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 317], 95.00th=[ 326], 00:28:45.071 | 99.00th=[ 351], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], 00:28:45.071 | 99.99th=[ 355] 00:28:45.071 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=61.11, samples=20 00:28:45.071 iops : min= 32, max= 96, avg=59.20, stdev=15.28, samples=20 00:28:45.071 lat (msec) : 250=24.01%, 500=75.99% 00:28:45.071 cpu : usr=97.80%, sys=1.52%, ctx=69, majf=0, minf=9 00:28:45.071 IO depths : 1=4.4%, 2=10.7%, 4=25.0%, 8=51.8%, 16=8.1%, 32=0.0%, >=64=0.0% 00:28:45.071 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.071 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.071 filename2: (groupid=0, jobs=1): err= 0: pid=1403737: Fri Jul 12 12:42:37 2024 00:28:45.071 read: IOPS=59, BW=239KiB/s (245kB/s)(2432KiB/10165msec) 00:28:45.071 slat (usec): min=8, max=112, avg=61.36, stdev=23.20 00:28:45.071 clat (msec): min=146, max=413, avg=267.00, stdev=48.98 00:28:45.071 lat (msec): min=146, max=413, avg=267.06, stdev=48.98 00:28:45.071 clat percentiles (msec): 00:28:45.071 | 1.00th=[ 148], 5.00th=[ 167], 10.00th=[ 186], 20.00th=[ 232], 00:28:45.071 | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 271], 60.00th=[ 288], 00:28:45.071 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 321], 95.00th=[ 326], 00:28:45.071 | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 414], 99.95th=[ 414], 00:28:45.071 | 99.99th=[ 414] 00:28:45.071 bw ( KiB/s): min= 128, max= 384, per=4.06%, avg=236.80, stdev=62.64, samples=20 00:28:45.071 iops : min= 32, max= 96, avg=59.20, stdev=15.66, samples=20 00:28:45.071 lat (msec) : 250=26.32%, 500=73.68% 00:28:45.071 cpu : usr=98.40%, sys=1.10%, ctx=26, majf=0, minf=9 00:28:45.071 IO depths : 1=3.8%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.7%, 32=0.0%, >=64=0.0% 00:28:45.071 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:45.071 issued rwts: total=608,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:45.071 latency : target=0, window=0, percentile=100.00%, depth=16 00:28:45.071 00:28:45.071 Run status group 0 (all jobs): 00:28:45.071 READ: bw=5811KiB/s (5950kB/s), 229KiB/s-346KiB/s (235kB/s-354kB/s), io=57.7MiB (60.5MB), run=10040-10171msec 00:28:45.071 12:42:37 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:28:45.071 12:42:37 -- target/dif.sh@43 -- # local sub 00:28:45.071 12:42:37 -- target/dif.sh@45 -- # for sub in "$@" 00:28:45.071 12:42:37 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:45.071 12:42:37 -- target/dif.sh@36 -- # local sub_id=0 00:28:45.071 12:42:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@45 -- # for sub in "$@" 00:28:45.071 12:42:37 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:45.071 12:42:37 -- target/dif.sh@36 -- # local sub_id=1 00:28:45.071 12:42:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@45 -- # for sub in "$@" 00:28:45.071 12:42:37 -- target/dif.sh@46 -- # destroy_subsystem 2 00:28:45.071 12:42:37 -- target/dif.sh@36 -- # local sub_id=2 00:28:45.071 12:42:37 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@115 -- # NULL_DIF=1 00:28:45.071 12:42:37 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:28:45.071 12:42:37 -- target/dif.sh@115 -- # numjobs=2 00:28:45.071 12:42:37 -- target/dif.sh@115 -- # iodepth=8 00:28:45.071 12:42:37 -- target/dif.sh@115 -- # runtime=5 00:28:45.071 12:42:37 -- target/dif.sh@115 -- # files=1 00:28:45.071 12:42:37 -- target/dif.sh@117 -- # create_subsystems 0 1 00:28:45.071 12:42:37 -- target/dif.sh@28 -- # local sub 00:28:45.071 12:42:37 -- target/dif.sh@30 -- # for sub in "$@" 00:28:45.071 12:42:37 -- target/dif.sh@31 -- # create_subsystem 0 00:28:45.071 12:42:37 -- target/dif.sh@18 -- # local sub_id=0 00:28:45.071 12:42:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 bdev_null0 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:45.071 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.071 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.071 [2024-07-12 12:42:37.442100] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:45.071 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.071 12:42:37 -- target/dif.sh@30 -- # for sub in "$@" 00:28:45.072 12:42:37 -- target/dif.sh@31 -- # create_subsystem 1 00:28:45.072 12:42:37 -- target/dif.sh@18 -- # local sub_id=1 00:28:45.072 12:42:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:45.072 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.072 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.072 bdev_null1 00:28:45.072 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.072 12:42:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:45.072 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.072 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.072 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.072 12:42:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:45.072 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.072 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.072 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.072 12:42:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:45.072 12:42:37 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:45.072 12:42:37 -- common/autotest_common.sh@10 -- # set +x 00:28:45.072 12:42:37 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:45.072 12:42:37 -- target/dif.sh@118 -- # fio /dev/fd/62 00:28:45.072 12:42:37 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:28:45.072 12:42:37 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:45.072 12:42:37 -- nvmf/common.sh@520 -- # config=() 00:28:45.072 12:42:37 -- nvmf/common.sh@520 -- # local subsystem config 00:28:45.072 12:42:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:45.072 12:42:37 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.072 12:42:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:45.072 { 00:28:45.072 "params": { 00:28:45.072 "name": "Nvme$subsystem", 00:28:45.072 "trtype": "$TEST_TRANSPORT", 00:28:45.072 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:45.072 "adrfam": "ipv4", 00:28:45.072 "trsvcid": "$NVMF_PORT", 00:28:45.072 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:45.072 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:45.072 "hdgst": ${hdgst:-false}, 00:28:45.072 "ddgst": ${ddgst:-false} 00:28:45.072 }, 00:28:45.072 "method": "bdev_nvme_attach_controller" 00:28:45.072 } 00:28:45.072 EOF 00:28:45.072 )") 00:28:45.072 12:42:37 -- target/dif.sh@82 -- # gen_fio_conf 00:28:45.072 12:42:37 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.072 12:42:37 -- target/dif.sh@54 -- # local file 00:28:45.072 12:42:37 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:45.072 12:42:37 -- target/dif.sh@56 -- # cat 00:28:45.072 12:42:37 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:45.072 12:42:37 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:45.072 12:42:37 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.072 12:42:37 -- common/autotest_common.sh@1320 -- # shift 00:28:45.072 12:42:37 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:45.072 12:42:37 -- nvmf/common.sh@542 -- # cat 00:28:45.072 12:42:37 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.072 12:42:37 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:45.072 12:42:37 -- target/dif.sh@72 -- # (( file <= files )) 00:28:45.072 12:42:37 -- target/dif.sh@73 -- # cat 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:45.072 12:42:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:45.072 12:42:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:45.072 { 00:28:45.072 "params": { 00:28:45.072 "name": "Nvme$subsystem", 00:28:45.072 "trtype": "$TEST_TRANSPORT", 00:28:45.072 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:45.072 "adrfam": "ipv4", 00:28:45.072 "trsvcid": "$NVMF_PORT", 00:28:45.072 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:45.072 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:45.072 "hdgst": ${hdgst:-false}, 00:28:45.072 "ddgst": ${ddgst:-false} 00:28:45.072 }, 00:28:45.072 "method": "bdev_nvme_attach_controller" 00:28:45.072 } 00:28:45.072 EOF 00:28:45.072 )") 00:28:45.072 12:42:37 -- nvmf/common.sh@542 -- # cat 00:28:45.072 12:42:37 -- target/dif.sh@72 -- # (( file++ )) 00:28:45.072 12:42:37 -- target/dif.sh@72 -- # (( file <= files )) 00:28:45.072 12:42:37 -- nvmf/common.sh@544 -- # jq . 00:28:45.072 12:42:37 -- nvmf/common.sh@545 -- # IFS=, 00:28:45.072 12:42:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:45.072 "params": { 00:28:45.072 "name": "Nvme0", 00:28:45.072 "trtype": "tcp", 00:28:45.072 "traddr": "10.0.0.2", 00:28:45.072 "adrfam": "ipv4", 00:28:45.072 "trsvcid": "4420", 00:28:45.072 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:45.072 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:45.072 "hdgst": false, 00:28:45.072 "ddgst": false 00:28:45.072 }, 00:28:45.072 "method": "bdev_nvme_attach_controller" 00:28:45.072 },{ 00:28:45.072 "params": { 00:28:45.072 "name": "Nvme1", 00:28:45.072 "trtype": "tcp", 00:28:45.072 "traddr": "10.0.0.2", 00:28:45.072 "adrfam": "ipv4", 00:28:45.072 "trsvcid": "4420", 00:28:45.072 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:45.072 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:45.072 "hdgst": false, 00:28:45.072 "ddgst": false 00:28:45.072 }, 00:28:45.072 "method": "bdev_nvme_attach_controller" 00:28:45.072 }' 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:45.072 12:42:37 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:45.072 12:42:37 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:45.072 12:42:37 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:45.072 12:42:37 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:45.072 12:42:37 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:45.072 12:42:37 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.072 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:45.072 ... 00:28:45.072 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:28:45.072 ... 00:28:45.072 fio-3.35 00:28:45.072 Starting 4 threads 00:28:45.072 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.072 [2024-07-12 12:42:38.228525] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:45.072 [2024-07-12 12:42:38.228594] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:50.332 00:28:50.332 filename0: (groupid=0, jobs=1): err= 0: pid=1405277: Fri Jul 12 12:42:43 2024 00:28:50.332 read: IOPS=2021, BW=15.8MiB/s (16.6MB/s)(79.0MiB/5002msec) 00:28:50.332 slat (nsec): min=4308, max=38727, avg=13152.59, stdev=4587.08 00:28:50.332 clat (usec): min=594, max=7819, avg=3912.62, stdev=435.57 00:28:50.332 lat (usec): min=607, max=7850, avg=3925.77, stdev=435.68 00:28:50.332 clat percentiles (usec): 00:28:50.332 | 1.00th=[ 2573], 5.00th=[ 3261], 10.00th=[ 3523], 20.00th=[ 3785], 00:28:50.332 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 3982], 00:28:50.332 | 70.00th=[ 4015], 80.00th=[ 4047], 90.00th=[ 4146], 95.00th=[ 4359], 00:28:50.332 | 99.00th=[ 5538], 99.50th=[ 5997], 99.90th=[ 7242], 99.95th=[ 7635], 00:28:50.332 | 99.99th=[ 7701] 00:28:50.332 bw ( KiB/s): min=15968, max=17008, per=25.49%, avg=16204.44, stdev=341.93, samples=9 00:28:50.332 iops : min= 1996, max= 2126, avg=2025.56, stdev=42.74, samples=9 00:28:50.332 lat (usec) : 750=0.02%, 1000=0.02% 00:28:50.332 lat (msec) : 2=0.37%, 4=70.35%, 10=29.25% 00:28:50.332 cpu : usr=94.36%, sys=5.12%, ctx=7, majf=0, minf=23 00:28:50.332 IO depths : 1=0.2%, 2=10.9%, 4=61.6%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:50.332 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.332 complete : 0=0.0%, 4=92.0%, 8=8.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.332 issued rwts: total=10114,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:50.332 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:50.332 filename0: (groupid=0, jobs=1): err= 0: pid=1405278: Fri Jul 12 12:42:43 2024 00:28:50.332 read: IOPS=1988, BW=15.5MiB/s (16.3MB/s)(77.7MiB/5001msec) 00:28:50.333 slat (nsec): min=4597, max=71321, avg=14109.25, stdev=4006.66 00:28:50.333 clat (usec): min=749, max=7300, avg=3972.44, stdev=526.42 00:28:50.333 lat (usec): min=762, max=7317, avg=3986.55, stdev=526.31 00:28:50.333 clat percentiles (usec): 00:28:50.333 | 1.00th=[ 2606], 5.00th=[ 3294], 10.00th=[ 3589], 20.00th=[ 3851], 00:28:50.333 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 3982], 00:28:50.333 | 70.00th=[ 4015], 80.00th=[ 4047], 90.00th=[ 4293], 95.00th=[ 4752], 00:28:50.333 | 99.00th=[ 6325], 99.50th=[ 6587], 99.90th=[ 7046], 99.95th=[ 7177], 00:28:50.333 | 99.99th=[ 7308] 00:28:50.333 bw ( KiB/s): min=15552, max=16112, per=25.01%, avg=15902.22, stdev=224.06, samples=9 00:28:50.333 iops : min= 1944, max= 2014, avg=1988.00, stdev=28.20, samples=9 00:28:50.333 lat (usec) : 750=0.01%, 1000=0.01% 00:28:50.333 lat (msec) : 2=0.66%, 4=69.86%, 10=29.46% 00:28:50.333 cpu : usr=94.56%, sys=4.92%, ctx=10, majf=0, minf=71 00:28:50.333 IO depths : 1=0.1%, 2=17.3%, 4=55.4%, 8=27.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:50.333 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.333 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.333 issued rwts: total=9942,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:50.333 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:50.333 filename1: (groupid=0, jobs=1): err= 0: pid=1405279: Fri Jul 12 12:42:43 2024 00:28:50.333 read: IOPS=2025, BW=15.8MiB/s (16.6MB/s)(79.2MiB/5001msec) 00:28:50.333 slat (nsec): min=4128, max=80325, avg=14536.93, stdev=5641.95 00:28:50.333 clat (usec): min=811, max=7237, avg=3891.87, stdev=507.12 00:28:50.333 lat (usec): min=824, max=7250, avg=3906.41, stdev=507.32 00:28:50.333 clat percentiles (usec): 00:28:50.333 | 1.00th=[ 2212], 5.00th=[ 3163], 10.00th=[ 3425], 20.00th=[ 3752], 00:28:50.333 | 30.00th=[ 3851], 40.00th=[ 3884], 50.00th=[ 3916], 60.00th=[ 3949], 00:28:50.333 | 70.00th=[ 3982], 80.00th=[ 4015], 90.00th=[ 4146], 95.00th=[ 4424], 00:28:50.333 | 99.00th=[ 5997], 99.50th=[ 6390], 99.90th=[ 6980], 99.95th=[ 7046], 00:28:50.333 | 99.99th=[ 7177] 00:28:50.333 bw ( KiB/s): min=15984, max=16480, per=25.39%, avg=16140.44, stdev=181.86, samples=9 00:28:50.333 iops : min= 1998, max= 2060, avg=2017.56, stdev=22.73, samples=9 00:28:50.333 lat (usec) : 1000=0.04% 00:28:50.333 lat (msec) : 2=0.75%, 4=74.28%, 10=24.93% 00:28:50.333 cpu : usr=85.36%, sys=9.74%, ctx=184, majf=0, minf=36 00:28:50.333 IO depths : 1=0.3%, 2=19.1%, 4=54.3%, 8=26.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:50.333 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.333 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.333 issued rwts: total=10132,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:50.333 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:50.333 filename1: (groupid=0, jobs=1): err= 0: pid=1405280: Fri Jul 12 12:42:43 2024 00:28:50.333 read: IOPS=1958, BW=15.3MiB/s (16.0MB/s)(77.1MiB/5041msec) 00:28:50.333 slat (nsec): min=4151, max=46198, avg=14788.19, stdev=5115.95 00:28:50.333 clat (usec): min=740, max=42514, avg=4007.65, stdev=755.19 00:28:50.333 lat (usec): min=753, max=42530, avg=4022.44, stdev=755.02 00:28:50.333 clat percentiles (usec): 00:28:50.333 | 1.00th=[ 2212], 5.00th=[ 3425], 10.00th=[ 3654], 20.00th=[ 3851], 00:28:50.333 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3949], 60.00th=[ 3982], 00:28:50.333 | 70.00th=[ 4015], 80.00th=[ 4080], 90.00th=[ 4359], 95.00th=[ 4817], 00:28:50.333 | 99.00th=[ 6390], 99.50th=[ 6652], 99.90th=[ 6980], 99.95th=[ 7177], 00:28:50.333 | 99.99th=[42730] 00:28:50.333 bw ( KiB/s): min=15472, max=16080, per=24.84%, avg=15792.00, stdev=207.25, samples=10 00:28:50.333 iops : min= 1934, max= 2010, avg=1974.00, stdev=25.91, samples=10 00:28:50.333 lat (usec) : 750=0.01%, 1000=0.10% 00:28:50.333 lat (msec) : 2=0.62%, 4=66.19%, 10=33.06%, 50=0.02% 00:28:50.333 cpu : usr=92.72%, sys=5.60%, ctx=178, majf=0, minf=42 00:28:50.333 IO depths : 1=0.1%, 2=14.5%, 4=57.6%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:50.333 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.333 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:50.333 issued rwts: total=9872,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:50.333 latency : target=0, window=0, percentile=100.00%, depth=8 00:28:50.333 00:28:50.333 Run status group 0 (all jobs): 00:28:50.333 READ: bw=62.1MiB/s (65.1MB/s), 15.3MiB/s-15.8MiB/s (16.0MB/s-16.6MB/s), io=313MiB (328MB), run=5001-5041msec 00:28:50.333 12:42:43 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:28:50.333 12:42:43 -- target/dif.sh@43 -- # local sub 00:28:50.333 12:42:43 -- target/dif.sh@45 -- # for sub in "$@" 00:28:50.333 12:42:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:50.333 12:42:43 -- target/dif.sh@36 -- # local sub_id=0 00:28:50.333 12:42:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@45 -- # for sub in "$@" 00:28:50.333 12:42:43 -- target/dif.sh@46 -- # destroy_subsystem 1 00:28:50.333 12:42:43 -- target/dif.sh@36 -- # local sub_id=1 00:28:50.333 12:42:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 00:28:50.333 real 0m24.242s 00:28:50.333 user 4m35.705s 00:28:50.333 sys 0m6.335s 00:28:50.333 12:42:43 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 ************************************ 00:28:50.333 END TEST fio_dif_rand_params 00:28:50.333 ************************************ 00:28:50.333 12:42:43 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:28:50.333 12:42:43 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:28:50.333 12:42:43 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 ************************************ 00:28:50.333 START TEST fio_dif_digest 00:28:50.333 ************************************ 00:28:50.333 12:42:43 -- common/autotest_common.sh@1104 -- # fio_dif_digest 00:28:50.333 12:42:43 -- target/dif.sh@123 -- # local NULL_DIF 00:28:50.333 12:42:43 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:28:50.333 12:42:43 -- target/dif.sh@125 -- # local hdgst ddgst 00:28:50.333 12:42:43 -- target/dif.sh@127 -- # NULL_DIF=3 00:28:50.333 12:42:43 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:28:50.333 12:42:43 -- target/dif.sh@127 -- # numjobs=3 00:28:50.333 12:42:43 -- target/dif.sh@127 -- # iodepth=3 00:28:50.333 12:42:43 -- target/dif.sh@127 -- # runtime=10 00:28:50.333 12:42:43 -- target/dif.sh@128 -- # hdgst=true 00:28:50.333 12:42:43 -- target/dif.sh@128 -- # ddgst=true 00:28:50.333 12:42:43 -- target/dif.sh@130 -- # create_subsystems 0 00:28:50.333 12:42:43 -- target/dif.sh@28 -- # local sub 00:28:50.333 12:42:43 -- target/dif.sh@30 -- # for sub in "$@" 00:28:50.333 12:42:43 -- target/dif.sh@31 -- # create_subsystem 0 00:28:50.333 12:42:43 -- target/dif.sh@18 -- # local sub_id=0 00:28:50.333 12:42:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 bdev_null0 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:50.333 12:42:43 -- common/autotest_common.sh@551 -- # xtrace_disable 00:28:50.333 12:42:43 -- common/autotest_common.sh@10 -- # set +x 00:28:50.333 [2024-07-12 12:42:43.709767] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:50.333 12:42:43 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:28:50.333 12:42:43 -- target/dif.sh@131 -- # fio /dev/fd/62 00:28:50.333 12:42:43 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:28:50.333 12:42:43 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:50.333 12:42:43 -- nvmf/common.sh@520 -- # config=() 00:28:50.333 12:42:43 -- nvmf/common.sh@520 -- # local subsystem config 00:28:50.333 12:42:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:50.333 12:42:43 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:50.333 12:42:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:50.333 { 00:28:50.333 "params": { 00:28:50.333 "name": "Nvme$subsystem", 00:28:50.333 "trtype": "$TEST_TRANSPORT", 00:28:50.333 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:50.333 "adrfam": "ipv4", 00:28:50.333 "trsvcid": "$NVMF_PORT", 00:28:50.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:50.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:50.334 "hdgst": ${hdgst:-false}, 00:28:50.334 "ddgst": ${ddgst:-false} 00:28:50.334 }, 00:28:50.334 "method": "bdev_nvme_attach_controller" 00:28:50.334 } 00:28:50.334 EOF 00:28:50.334 )") 00:28:50.334 12:42:43 -- target/dif.sh@82 -- # gen_fio_conf 00:28:50.334 12:42:43 -- common/autotest_common.sh@1335 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:50.334 12:42:43 -- target/dif.sh@54 -- # local file 00:28:50.334 12:42:43 -- common/autotest_common.sh@1316 -- # local fio_dir=/usr/src/fio 00:28:50.334 12:42:43 -- target/dif.sh@56 -- # cat 00:28:50.334 12:42:43 -- common/autotest_common.sh@1318 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:50.334 12:42:43 -- common/autotest_common.sh@1318 -- # local sanitizers 00:28:50.334 12:42:43 -- common/autotest_common.sh@1319 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:50.334 12:42:43 -- common/autotest_common.sh@1320 -- # shift 00:28:50.334 12:42:43 -- common/autotest_common.sh@1322 -- # local asan_lib= 00:28:50.334 12:42:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:50.334 12:42:43 -- nvmf/common.sh@542 -- # cat 00:28:50.334 12:42:43 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:50.334 12:42:43 -- target/dif.sh@72 -- # (( file <= files )) 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # grep libasan 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:50.334 12:42:43 -- nvmf/common.sh@544 -- # jq . 00:28:50.334 12:42:43 -- nvmf/common.sh@545 -- # IFS=, 00:28:50.334 12:42:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:50.334 "params": { 00:28:50.334 "name": "Nvme0", 00:28:50.334 "trtype": "tcp", 00:28:50.334 "traddr": "10.0.0.2", 00:28:50.334 "adrfam": "ipv4", 00:28:50.334 "trsvcid": "4420", 00:28:50.334 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:50.334 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:50.334 "hdgst": true, 00:28:50.334 "ddgst": true 00:28:50.334 }, 00:28:50.334 "method": "bdev_nvme_attach_controller" 00:28:50.334 }' 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:50.334 12:42:43 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:50.334 12:42:43 -- common/autotest_common.sh@1323 -- # for sanitizer in "${sanitizers[@]}" 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # grep libclang_rt.asan 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # awk '{print $3}' 00:28:50.334 12:42:43 -- common/autotest_common.sh@1324 -- # asan_lib= 00:28:50.334 12:42:43 -- common/autotest_common.sh@1325 -- # [[ -n '' ]] 00:28:50.334 12:42:43 -- common/autotest_common.sh@1331 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:50.334 12:42:43 -- common/autotest_common.sh@1331 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:50.334 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:28:50.334 ... 00:28:50.334 fio-3.35 00:28:50.334 Starting 3 threads 00:28:50.334 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.592 [2024-07-12 12:42:44.314017] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:50.592 [2024-07-12 12:42:44.314082] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:00.586 00:29:00.586 filename0: (groupid=0, jobs=1): err= 0: pid=1406052: Fri Jul 12 12:42:54 2024 00:29:00.586 read: IOPS=210, BW=26.4MiB/s (27.7MB/s)(265MiB/10044msec) 00:29:00.586 slat (nsec): min=4522, max=55047, avg=18234.48, stdev=5408.47 00:29:00.586 clat (usec): min=10630, max=55753, avg=14177.93, stdev=1634.22 00:29:00.586 lat (usec): min=10650, max=55761, avg=14196.17, stdev=1633.60 00:29:00.586 clat percentiles (usec): 00:29:00.586 | 1.00th=[11600], 5.00th=[12387], 10.00th=[12780], 20.00th=[13304], 00:29:00.586 | 30.00th=[13566], 40.00th=[13829], 50.00th=[14091], 60.00th=[14353], 00:29:00.586 | 70.00th=[14615], 80.00th=[15008], 90.00th=[15533], 95.00th=[15926], 00:29:00.586 | 99.00th=[16909], 99.50th=[17433], 99.90th=[21890], 99.95th=[49546], 00:29:00.586 | 99.99th=[55837] 00:29:00.586 bw ( KiB/s): min=26112, max=28672, per=34.44%, avg=27097.60, stdev=762.48, samples=20 00:29:00.586 iops : min= 204, max= 224, avg=211.70, stdev= 5.96, samples=20 00:29:00.586 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:29:00.586 cpu : usr=94.18%, sys=5.19%, ctx=103, majf=0, minf=209 00:29:00.586 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:00.586 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.586 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.586 issued rwts: total=2119,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:00.586 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:00.586 filename0: (groupid=0, jobs=1): err= 0: pid=1406053: Fri Jul 12 12:42:54 2024 00:29:00.586 read: IOPS=203, BW=25.5MiB/s (26.7MB/s)(256MiB/10043msec) 00:29:00.586 slat (nsec): min=4898, max=78619, avg=15471.14, stdev=4851.71 00:29:00.586 clat (usec): min=11200, max=53199, avg=14693.50, stdev=1581.40 00:29:00.586 lat (usec): min=11218, max=53218, avg=14708.97, stdev=1581.62 00:29:00.586 clat percentiles (usec): 00:29:00.586 | 1.00th=[12256], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:29:00.586 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:29:00.586 | 70.00th=[15139], 80.00th=[15401], 90.00th=[15926], 95.00th=[16319], 00:29:00.586 | 99.00th=[17171], 99.50th=[17695], 99.90th=[22676], 99.95th=[51119], 00:29:00.586 | 99.99th=[53216] 00:29:00.586 bw ( KiB/s): min=25088, max=27392, per=33.24%, avg=26152.90, stdev=662.78, samples=20 00:29:00.586 iops : min= 196, max= 214, avg=204.30, stdev= 5.20, samples=20 00:29:00.586 lat (msec) : 20=99.76%, 50=0.15%, 100=0.10% 00:29:00.586 cpu : usr=93.86%, sys=5.68%, ctx=21, majf=0, minf=100 00:29:00.586 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:00.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.587 issued rwts: total=2045,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:00.587 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:00.587 filename0: (groupid=0, jobs=1): err= 0: pid=1406054: Fri Jul 12 12:42:54 2024 00:29:00.587 read: IOPS=200, BW=25.1MiB/s (26.3MB/s)(251MiB/10002msec) 00:29:00.587 slat (nsec): min=4119, max=78000, avg=15398.97, stdev=4875.30 00:29:00.587 clat (usec): min=11061, max=22550, avg=14909.18, stdev=1142.99 00:29:00.587 lat (usec): min=11068, max=22570, avg=14924.58, stdev=1143.27 00:29:00.587 clat percentiles (usec): 00:29:00.587 | 1.00th=[12518], 5.00th=[13173], 10.00th=[13566], 20.00th=[13960], 00:29:00.587 | 30.00th=[14353], 40.00th=[14615], 50.00th=[14877], 60.00th=[15139], 00:29:00.587 | 70.00th=[15401], 80.00th=[15795], 90.00th=[16319], 95.00th=[16909], 00:29:00.587 | 99.00th=[17695], 99.50th=[17957], 99.90th=[22414], 99.95th=[22676], 00:29:00.587 | 99.99th=[22676] 00:29:00.587 bw ( KiB/s): min=23760, max=26880, per=32.62%, avg=25664.84, stdev=837.05, samples=19 00:29:00.587 iops : min= 185, max= 210, avg=200.47, stdev= 6.62, samples=19 00:29:00.587 lat (msec) : 20=99.85%, 50=0.15% 00:29:00.587 cpu : usr=93.11%, sys=6.41%, ctx=43, majf=0, minf=215 00:29:00.587 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:00.587 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.587 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:00.587 issued rwts: total=2010,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:00.587 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:00.587 00:29:00.587 Run status group 0 (all jobs): 00:29:00.587 READ: bw=76.8MiB/s (80.6MB/s), 25.1MiB/s-26.4MiB/s (26.3MB/s-27.7MB/s), io=772MiB (809MB), run=10002-10044msec 00:29:01.151 12:42:54 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:01.151 12:42:54 -- target/dif.sh@43 -- # local sub 00:29:01.151 12:42:54 -- target/dif.sh@45 -- # for sub in "$@" 00:29:01.151 12:42:54 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:01.151 12:42:54 -- target/dif.sh@36 -- # local sub_id=0 00:29:01.151 12:42:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:01.151 12:42:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:01.151 12:42:54 -- common/autotest_common.sh@10 -- # set +x 00:29:01.151 12:42:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:01.151 12:42:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:01.151 12:42:54 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:01.151 12:42:54 -- common/autotest_common.sh@10 -- # set +x 00:29:01.151 12:42:54 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:01.151 00:29:01.151 real 0m11.126s 00:29:01.151 user 0m29.303s 00:29:01.151 sys 0m1.992s 00:29:01.151 12:42:54 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:01.151 12:42:54 -- common/autotest_common.sh@10 -- # set +x 00:29:01.151 ************************************ 00:29:01.151 END TEST fio_dif_digest 00:29:01.151 ************************************ 00:29:01.151 12:42:54 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:01.151 12:42:54 -- target/dif.sh@147 -- # nvmftestfini 00:29:01.151 12:42:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:01.151 12:42:54 -- nvmf/common.sh@116 -- # sync 00:29:01.151 12:42:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:01.151 12:42:54 -- nvmf/common.sh@119 -- # set +e 00:29:01.151 12:42:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:01.151 12:42:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:01.151 rmmod nvme_tcp 00:29:01.151 rmmod nvme_fabrics 00:29:01.151 rmmod nvme_keyring 00:29:01.151 12:42:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:01.151 12:42:54 -- nvmf/common.sh@123 -- # set -e 00:29:01.151 12:42:54 -- nvmf/common.sh@124 -- # return 0 00:29:01.151 12:42:54 -- nvmf/common.sh@477 -- # '[' -n 1399083 ']' 00:29:01.151 12:42:54 -- nvmf/common.sh@478 -- # killprocess 1399083 00:29:01.151 12:42:54 -- common/autotest_common.sh@926 -- # '[' -z 1399083 ']' 00:29:01.151 12:42:54 -- common/autotest_common.sh@930 -- # kill -0 1399083 00:29:01.151 12:42:54 -- common/autotest_common.sh@931 -- # uname 00:29:01.151 12:42:54 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:01.151 12:42:54 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1399083 00:29:01.151 12:42:54 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:01.151 12:42:54 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:01.151 12:42:54 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1399083' 00:29:01.151 killing process with pid 1399083 00:29:01.151 12:42:54 -- common/autotest_common.sh@945 -- # kill 1399083 00:29:01.151 12:42:54 -- common/autotest_common.sh@950 -- # wait 1399083 00:29:01.408 12:42:55 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:01.408 12:42:55 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:02.782 Waiting for block devices as requested 00:29:02.782 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:02.782 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:02.782 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:02.782 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:03.040 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:03.040 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:03.040 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:03.040 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:03.299 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:03.299 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:03.299 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:03.299 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:03.558 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:03.558 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:03.558 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:03.558 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:03.817 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:03.817 12:42:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:03.817 12:42:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:03.817 12:42:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:03.817 12:42:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:03.817 12:42:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:03.817 12:42:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:03.817 12:42:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:06.350 12:42:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:06.350 00:29:06.350 real 1m7.219s 00:29:06.350 user 6m33.686s 00:29:06.350 sys 0m16.760s 00:29:06.350 12:42:59 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:06.350 12:42:59 -- common/autotest_common.sh@10 -- # set +x 00:29:06.350 ************************************ 00:29:06.350 END TEST nvmf_dif 00:29:06.350 ************************************ 00:29:06.350 12:42:59 -- spdk/autotest.sh@301 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:06.350 12:42:59 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:06.350 12:42:59 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:06.350 12:42:59 -- common/autotest_common.sh@10 -- # set +x 00:29:06.350 ************************************ 00:29:06.350 START TEST nvmf_abort_qd_sizes 00:29:06.350 ************************************ 00:29:06.350 12:42:59 -- common/autotest_common.sh@1104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:06.350 * Looking for test storage... 00:29:06.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:06.350 12:42:59 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:06.350 12:42:59 -- nvmf/common.sh@7 -- # uname -s 00:29:06.350 12:42:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:06.350 12:42:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:06.350 12:42:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:06.350 12:42:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:06.350 12:42:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:06.350 12:42:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:06.350 12:42:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:06.350 12:42:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:06.350 12:42:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:06.350 12:42:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:06.350 12:42:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:06.350 12:42:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:06.350 12:42:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:06.350 12:42:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:06.350 12:42:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:06.350 12:42:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:06.350 12:42:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:06.350 12:42:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:06.350 12:42:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:06.350 12:42:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.350 12:42:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.350 12:42:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.350 12:42:59 -- paths/export.sh@5 -- # export PATH 00:29:06.351 12:42:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:06.351 12:42:59 -- nvmf/common.sh@46 -- # : 0 00:29:06.351 12:42:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:06.351 12:42:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:06.351 12:42:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:06.351 12:42:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:06.351 12:42:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:06.351 12:42:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:06.351 12:42:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:06.351 12:42:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:06.351 12:42:59 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:06.351 12:42:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:06.351 12:42:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:06.351 12:42:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:06.351 12:42:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:06.351 12:42:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:06.351 12:42:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:06.351 12:42:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:06.351 12:42:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:06.351 12:42:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:06.351 12:42:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:06.351 12:42:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:06.351 12:42:59 -- common/autotest_common.sh@10 -- # set +x 00:29:08.253 12:43:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:08.253 12:43:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:08.253 12:43:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:08.253 12:43:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:08.253 12:43:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:08.253 12:43:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:08.253 12:43:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:08.253 12:43:01 -- nvmf/common.sh@294 -- # net_devs=() 00:29:08.253 12:43:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:08.253 12:43:01 -- nvmf/common.sh@295 -- # e810=() 00:29:08.253 12:43:01 -- nvmf/common.sh@295 -- # local -ga e810 00:29:08.253 12:43:01 -- nvmf/common.sh@296 -- # x722=() 00:29:08.253 12:43:01 -- nvmf/common.sh@296 -- # local -ga x722 00:29:08.253 12:43:01 -- nvmf/common.sh@297 -- # mlx=() 00:29:08.253 12:43:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:08.253 12:43:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:08.253 12:43:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:08.253 12:43:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:08.253 12:43:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:08.253 12:43:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:08.253 12:43:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:08.253 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:08.253 12:43:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:08.253 12:43:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:08.253 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:08.253 12:43:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:08.253 12:43:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:08.253 12:43:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:08.253 12:43:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:08.253 12:43:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:08.253 12:43:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:08.253 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:08.253 12:43:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:08.253 12:43:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:08.253 12:43:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:08.253 12:43:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:08.253 12:43:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:08.253 12:43:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:08.253 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:08.253 12:43:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:08.253 12:43:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:08.253 12:43:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:08.253 12:43:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:08.253 12:43:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:08.253 12:43:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:08.253 12:43:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:08.253 12:43:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:08.253 12:43:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:08.253 12:43:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:08.253 12:43:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:08.253 12:43:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:08.253 12:43:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:08.253 12:43:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:08.253 12:43:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:08.254 12:43:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:08.254 12:43:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:08.254 12:43:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:08.254 12:43:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:08.254 12:43:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:08.254 12:43:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:08.254 12:43:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:08.254 12:43:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:08.254 12:43:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:08.254 12:43:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:08.254 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:08.254 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.110 ms 00:29:08.254 00:29:08.254 --- 10.0.0.2 ping statistics --- 00:29:08.254 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:08.254 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:29:08.254 12:43:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:08.254 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:08.254 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:29:08.254 00:29:08.254 --- 10.0.0.1 ping statistics --- 00:29:08.254 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:08.254 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:29:08.254 12:43:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:08.254 12:43:01 -- nvmf/common.sh@410 -- # return 0 00:29:08.254 12:43:01 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:08.254 12:43:01 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:09.186 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:09.186 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:09.186 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:10.119 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:10.119 12:43:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:10.119 12:43:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:10.119 12:43:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:10.119 12:43:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:10.119 12:43:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:10.119 12:43:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:10.382 12:43:04 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:10.382 12:43:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:10.382 12:43:04 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:10.382 12:43:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.382 12:43:04 -- nvmf/common.sh@469 -- # nvmfpid=1410947 00:29:10.382 12:43:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:10.382 12:43:04 -- nvmf/common.sh@470 -- # waitforlisten 1410947 00:29:10.382 12:43:04 -- common/autotest_common.sh@819 -- # '[' -z 1410947 ']' 00:29:10.382 12:43:04 -- common/autotest_common.sh@823 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:10.382 12:43:04 -- common/autotest_common.sh@824 -- # local max_retries=100 00:29:10.382 12:43:04 -- common/autotest_common.sh@826 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:10.382 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:10.382 12:43:04 -- common/autotest_common.sh@828 -- # xtrace_disable 00:29:10.382 12:43:04 -- common/autotest_common.sh@10 -- # set +x 00:29:10.382 [2024-07-12 12:43:04.081826] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... 00:29:10.382 [2024-07-12 12:43:04.081900] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:10.382 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.382 [2024-07-12 12:43:04.145790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:10.382 [2024-07-12 12:43:04.251192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:10.382 [2024-07-12 12:43:04.251360] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:10.382 [2024-07-12 12:43:04.251378] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:10.382 [2024-07-12 12:43:04.251390] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:10.382 [2024-07-12 12:43:04.251442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:10.382 [2024-07-12 12:43:04.251502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:10.382 [2024-07-12 12:43:04.251566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:10.382 [2024-07-12 12:43:04.251569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:11.315 12:43:05 -- common/autotest_common.sh@848 -- # (( i == 0 )) 00:29:11.315 12:43:05 -- common/autotest_common.sh@852 -- # return 0 00:29:11.315 12:43:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:11.315 12:43:05 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:11.315 12:43:05 -- common/autotest_common.sh@10 -- # set +x 00:29:11.315 12:43:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:11.315 12:43:05 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:11.315 12:43:05 -- scripts/common.sh@312 -- # local nvmes 00:29:11.315 12:43:05 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:11.315 12:43:05 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:11.315 12:43:05 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:11.315 12:43:05 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:11.315 12:43:05 -- scripts/common.sh@322 -- # uname -s 00:29:11.315 12:43:05 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:11.315 12:43:05 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:11.315 12:43:05 -- scripts/common.sh@327 -- # (( 1 )) 00:29:11.315 12:43:05 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:11.315 12:43:05 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:11.315 12:43:05 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:11.315 12:43:05 -- common/autotest_common.sh@10 -- # set +x 00:29:11.315 ************************************ 00:29:11.315 START TEST spdk_target_abort 00:29:11.315 ************************************ 00:29:11.315 12:43:05 -- common/autotest_common.sh@1104 -- # spdk_target 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:11.315 12:43:05 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:11.315 12:43:05 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:11.316 12:43:05 -- common/autotest_common.sh@10 -- # set +x 00:29:14.594 spdk_targetn1 00:29:14.594 12:43:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:14.594 12:43:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:14.594 12:43:07 -- common/autotest_common.sh@10 -- # set +x 00:29:14.594 [2024-07-12 12:43:07.893841] tcp.c: 659:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:14.594 12:43:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:14.594 12:43:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:14.594 12:43:07 -- common/autotest_common.sh@10 -- # set +x 00:29:14.594 12:43:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:14.594 12:43:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:14.594 12:43:07 -- common/autotest_common.sh@10 -- # set +x 00:29:14.594 12:43:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:14.594 12:43:07 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:14.594 12:43:07 -- common/autotest_common.sh@10 -- # set +x 00:29:14.594 [2024-07-12 12:43:07.926151] tcp.c: 951:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:14.594 12:43:07 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:14.594 12:43:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:14.594 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.871 Initializing NVMe Controllers 00:29:17.871 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:17.871 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:17.871 Initialization complete. Launching workers. 00:29:17.871 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12136, failed: 0 00:29:17.871 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1236, failed to submit 10900 00:29:17.871 success 737, unsuccess 499, failed 0 00:29:17.871 12:43:11 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:17.871 12:43:11 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:17.871 EAL: No free 2048 kB hugepages reported on node 1 00:29:21.167 [2024-07-12 12:43:14.479896] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.479949] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.479965] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.479977] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.479989] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.480001] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.480013] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 [2024-07-12 12:43:14.480025] tcp.c:1574:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f1270 is same with the state(5) to be set 00:29:21.167 Initializing NVMe Controllers 00:29:21.167 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:21.167 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:21.167 Initialization complete. Launching workers. 00:29:21.167 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8751, failed: 0 00:29:21.167 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1227, failed to submit 7524 00:29:21.167 success 365, unsuccess 862, failed 0 00:29:21.167 12:43:14 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:21.167 12:43:14 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:21.167 EAL: No free 2048 kB hugepages reported on node 1 00:29:24.464 Initializing NVMe Controllers 00:29:24.464 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:29:24.464 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:29:24.464 Initialization complete. Launching workers. 00:29:24.464 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30748, failed: 0 00:29:24.464 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2693, failed to submit 28055 00:29:24.464 success 539, unsuccess 2154, failed 0 00:29:24.464 12:43:17 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:29:24.464 12:43:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:24.464 12:43:17 -- common/autotest_common.sh@10 -- # set +x 00:29:24.464 12:43:17 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:24.464 12:43:17 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:29:24.464 12:43:17 -- common/autotest_common.sh@551 -- # xtrace_disable 00:29:24.464 12:43:17 -- common/autotest_common.sh@10 -- # set +x 00:29:25.398 12:43:19 -- common/autotest_common.sh@579 -- # [[ 0 == 0 ]] 00:29:25.398 12:43:19 -- target/abort_qd_sizes.sh@62 -- # killprocess 1410947 00:29:25.398 12:43:19 -- common/autotest_common.sh@926 -- # '[' -z 1410947 ']' 00:29:25.398 12:43:19 -- common/autotest_common.sh@930 -- # kill -0 1410947 00:29:25.398 12:43:19 -- common/autotest_common.sh@931 -- # uname 00:29:25.398 12:43:19 -- common/autotest_common.sh@931 -- # '[' Linux = Linux ']' 00:29:25.398 12:43:19 -- common/autotest_common.sh@932 -- # ps --no-headers -o comm= 1410947 00:29:25.398 12:43:19 -- common/autotest_common.sh@932 -- # process_name=reactor_0 00:29:25.398 12:43:19 -- common/autotest_common.sh@936 -- # '[' reactor_0 = sudo ']' 00:29:25.398 12:43:19 -- common/autotest_common.sh@944 -- # echo 'killing process with pid 1410947' 00:29:25.399 killing process with pid 1410947 00:29:25.399 12:43:19 -- common/autotest_common.sh@945 -- # kill 1410947 00:29:25.399 12:43:19 -- common/autotest_common.sh@950 -- # wait 1410947 00:29:25.657 00:29:25.657 real 0m14.378s 00:29:25.657 user 0m56.876s 00:29:25.657 sys 0m2.495s 00:29:25.657 12:43:19 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:25.657 12:43:19 -- common/autotest_common.sh@10 -- # set +x 00:29:25.657 ************************************ 00:29:25.657 END TEST spdk_target_abort 00:29:25.657 ************************************ 00:29:25.657 12:43:19 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:29:25.657 12:43:19 -- common/autotest_common.sh@1077 -- # '[' 2 -le 1 ']' 00:29:25.657 12:43:19 -- common/autotest_common.sh@1083 -- # xtrace_disable 00:29:25.657 12:43:19 -- common/autotest_common.sh@10 -- # set +x 00:29:25.657 ************************************ 00:29:25.657 START TEST kernel_target_abort 00:29:25.657 ************************************ 00:29:25.657 12:43:19 -- common/autotest_common.sh@1104 -- # kernel_target 00:29:25.657 12:43:19 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:29:25.658 12:43:19 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:29:25.658 12:43:19 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:29:25.658 12:43:19 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:29:25.658 12:43:19 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:29:25.658 12:43:19 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:25.658 12:43:19 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:29:25.658 12:43:19 -- nvmf/common.sh@627 -- # local block nvme 00:29:25.658 12:43:19 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:29:25.658 12:43:19 -- nvmf/common.sh@630 -- # modprobe nvmet 00:29:25.658 12:43:19 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:29:25.658 12:43:19 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:27.035 Waiting for block devices as requested 00:29:27.035 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:27.035 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:27.035 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:27.035 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:27.293 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:27.293 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:27.293 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:27.293 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:27.552 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:27.552 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:27.552 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:27.552 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:27.812 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:27.812 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:27.812 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:28.069 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:28.069 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:28.069 12:43:21 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:29:28.069 12:43:21 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:29:28.069 12:43:21 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:29:28.069 12:43:21 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:29:28.069 12:43:21 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:29:28.069 No valid GPT data, bailing 00:29:28.326 12:43:21 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:29:28.326 12:43:21 -- scripts/common.sh@393 -- # pt= 00:29:28.326 12:43:21 -- scripts/common.sh@394 -- # return 1 00:29:28.326 12:43:21 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:29:28.326 12:43:21 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:29:28.326 12:43:21 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:28.326 12:43:22 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:28.326 12:43:22 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:29:28.326 12:43:22 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:29:28.326 12:43:22 -- nvmf/common.sh@654 -- # echo 1 00:29:28.326 12:43:22 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:29:28.326 12:43:22 -- nvmf/common.sh@656 -- # echo 1 00:29:28.326 12:43:22 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:29:28.326 12:43:22 -- nvmf/common.sh@663 -- # echo tcp 00:29:28.326 12:43:22 -- nvmf/common.sh@664 -- # echo 4420 00:29:28.326 12:43:22 -- nvmf/common.sh@665 -- # echo ipv4 00:29:28.326 12:43:22 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:29:28.326 12:43:22 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:29:28.326 00:29:28.326 Discovery Log Number of Records 2, Generation counter 2 00:29:28.326 =====Discovery Log Entry 0====== 00:29:28.326 trtype: tcp 00:29:28.326 adrfam: ipv4 00:29:28.326 subtype: current discovery subsystem 00:29:28.326 treq: not specified, sq flow control disable supported 00:29:28.326 portid: 1 00:29:28.326 trsvcid: 4420 00:29:28.326 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:29:28.326 traddr: 10.0.0.1 00:29:28.326 eflags: none 00:29:28.326 sectype: none 00:29:28.326 =====Discovery Log Entry 1====== 00:29:28.326 trtype: tcp 00:29:28.326 adrfam: ipv4 00:29:28.326 subtype: nvme subsystem 00:29:28.326 treq: not specified, sq flow control disable supported 00:29:28.326 portid: 1 00:29:28.326 trsvcid: 4420 00:29:28.326 subnqn: kernel_target 00:29:28.326 traddr: 10.0.0.1 00:29:28.326 eflags: none 00:29:28.326 sectype: none 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:28.326 12:43:22 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:28.326 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.611 Initializing NVMe Controllers 00:29:31.611 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:31.612 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:31.612 Initialization complete. Launching workers. 00:29:31.612 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 44323, failed: 0 00:29:31.612 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 44323, failed to submit 0 00:29:31.612 success 0, unsuccess 44323, failed 0 00:29:31.612 12:43:25 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:31.612 12:43:25 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:31.612 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.889 Initializing NVMe Controllers 00:29:34.889 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:34.889 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:34.889 Initialization complete. Launching workers. 00:29:34.889 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79994, failed: 0 00:29:34.889 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20170, failed to submit 59824 00:29:34.889 success 0, unsuccess 20170, failed 0 00:29:34.889 12:43:28 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:34.889 12:43:28 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:29:34.889 EAL: No free 2048 kB hugepages reported on node 1 00:29:38.174 Initializing NVMe Controllers 00:29:38.174 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:29:38.174 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:29:38.174 Initialization complete. Launching workers. 00:29:38.174 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78073, failed: 0 00:29:38.174 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19486, failed to submit 58587 00:29:38.174 success 0, unsuccess 19486, failed 0 00:29:38.174 12:43:31 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:29:38.174 12:43:31 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:29:38.174 12:43:31 -- nvmf/common.sh@677 -- # echo 0 00:29:38.174 12:43:31 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:29:38.174 12:43:31 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:29:38.174 12:43:31 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:29:38.174 12:43:31 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:29:38.174 12:43:31 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:29:38.174 12:43:31 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:29:38.174 00:29:38.174 real 0m12.010s 00:29:38.174 user 0m5.815s 00:29:38.174 sys 0m2.395s 00:29:38.174 12:43:31 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:38.174 12:43:31 -- common/autotest_common.sh@10 -- # set +x 00:29:38.174 ************************************ 00:29:38.174 END TEST kernel_target_abort 00:29:38.174 ************************************ 00:29:38.174 12:43:31 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:29:38.174 12:43:31 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:29:38.174 12:43:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:38.174 12:43:31 -- nvmf/common.sh@116 -- # sync 00:29:38.174 12:43:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:38.174 12:43:31 -- nvmf/common.sh@119 -- # set +e 00:29:38.174 12:43:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:38.174 12:43:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:38.174 rmmod nvme_tcp 00:29:38.174 rmmod nvme_fabrics 00:29:38.174 rmmod nvme_keyring 00:29:38.174 12:43:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:38.174 12:43:31 -- nvmf/common.sh@123 -- # set -e 00:29:38.174 12:43:31 -- nvmf/common.sh@124 -- # return 0 00:29:38.174 12:43:31 -- nvmf/common.sh@477 -- # '[' -n 1410947 ']' 00:29:38.174 12:43:31 -- nvmf/common.sh@478 -- # killprocess 1410947 00:29:38.174 12:43:31 -- common/autotest_common.sh@926 -- # '[' -z 1410947 ']' 00:29:38.174 12:43:31 -- common/autotest_common.sh@930 -- # kill -0 1410947 00:29:38.174 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 930: kill: (1410947) - No such process 00:29:38.174 12:43:31 -- common/autotest_common.sh@953 -- # echo 'Process with pid 1410947 is not found' 00:29:38.174 Process with pid 1410947 is not found 00:29:38.174 12:43:31 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:38.174 12:43:31 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:38.739 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:38.999 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:38.999 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:38.999 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:38.999 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:38.999 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:38.999 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:38.999 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:38.999 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:38.999 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:38.999 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:38.999 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:38.999 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:38.999 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:38.999 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:38.999 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:38.999 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:39.269 12:43:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:39.269 12:43:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:39.269 12:43:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:39.269 12:43:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:39.269 12:43:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:39.269 12:43:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:39.269 12:43:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:41.175 12:43:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:41.175 00:29:41.175 real 0m35.257s 00:29:41.175 user 1m4.912s 00:29:41.175 sys 0m8.168s 00:29:41.175 12:43:34 -- common/autotest_common.sh@1105 -- # xtrace_disable 00:29:41.175 12:43:34 -- common/autotest_common.sh@10 -- # set +x 00:29:41.175 ************************************ 00:29:41.175 END TEST nvmf_abort_qd_sizes 00:29:41.175 ************************************ 00:29:41.175 12:43:35 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@315 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@324 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@338 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@355 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@359 -- # '[' 0 -eq 1 ']' 00:29:41.175 12:43:35 -- spdk/autotest.sh@366 -- # [[ 0 -eq 1 ]] 00:29:41.175 12:43:35 -- spdk/autotest.sh@370 -- # [[ 0 -eq 1 ]] 00:29:41.175 12:43:35 -- spdk/autotest.sh@374 -- # [[ 0 -eq 1 ]] 00:29:41.175 12:43:35 -- spdk/autotest.sh@378 -- # [[ 0 -eq 1 ]] 00:29:41.175 12:43:35 -- spdk/autotest.sh@383 -- # trap - SIGINT SIGTERM EXIT 00:29:41.175 12:43:35 -- spdk/autotest.sh@385 -- # timing_enter post_cleanup 00:29:41.175 12:43:35 -- common/autotest_common.sh@712 -- # xtrace_disable 00:29:41.175 12:43:35 -- common/autotest_common.sh@10 -- # set +x 00:29:41.175 12:43:35 -- spdk/autotest.sh@386 -- # autotest_cleanup 00:29:41.175 12:43:35 -- common/autotest_common.sh@1371 -- # local autotest_es=0 00:29:41.175 12:43:35 -- common/autotest_common.sh@1372 -- # xtrace_disable 00:29:41.175 12:43:35 -- common/autotest_common.sh@10 -- # set +x 00:29:43.075 INFO: APP EXITING 00:29:43.075 INFO: killing all VMs 00:29:43.075 INFO: killing vhost app 00:29:43.075 INFO: EXIT DONE 00:29:44.451 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:29:44.451 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:29:44.451 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:29:44.451 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:29:44.451 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:29:44.451 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:29:44.451 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:29:44.451 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:29:44.451 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:29:44.451 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:29:44.451 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:29:44.451 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:29:44.451 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:29:44.451 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:29:44.451 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:29:44.451 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:29:44.451 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:29:45.858 Cleaning 00:29:45.858 Removing: /var/run/dpdk/spdk0/config 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:29:45.858 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:29:45.858 Removing: /var/run/dpdk/spdk0/hugepage_info 00:29:45.858 Removing: /var/run/dpdk/spdk1/config 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:29:45.858 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:29:45.858 Removing: /var/run/dpdk/spdk1/hugepage_info 00:29:45.858 Removing: /var/run/dpdk/spdk1/mp_socket 00:29:45.858 Removing: /var/run/dpdk/spdk2/config 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:29:45.858 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:29:45.858 Removing: /var/run/dpdk/spdk2/hugepage_info 00:29:45.858 Removing: /var/run/dpdk/spdk3/config 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:29:45.858 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:29:45.858 Removing: /var/run/dpdk/spdk3/hugepage_info 00:29:45.858 Removing: /var/run/dpdk/spdk4/config 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:29:45.858 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:29:45.858 Removing: /var/run/dpdk/spdk4/hugepage_info 00:29:45.858 Removing: /dev/shm/bdev_svc_trace.1 00:29:45.858 Removing: /dev/shm/nvmf_trace.0 00:29:45.858 Removing: /dev/shm/spdk_tgt_trace.pid1145166 00:29:45.858 Removing: /var/run/dpdk/spdk0 00:29:45.858 Removing: /var/run/dpdk/spdk1 00:29:45.858 Removing: /var/run/dpdk/spdk2 00:29:45.858 Removing: /var/run/dpdk/spdk3 00:29:45.858 Removing: /var/run/dpdk/spdk4 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1143471 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1144225 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1145166 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1145648 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1147026 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1148433 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1148753 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1149023 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1149281 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1149599 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1149764 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1149924 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1150105 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1150692 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1153108 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1153408 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1153583 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1153722 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1154158 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1154297 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1154610 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1154750 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1154932 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1155064 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1155248 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1155374 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1155874 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1156029 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1156223 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1156417 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1156547 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1156608 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1156873 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1157036 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1157174 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1157454 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1157602 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1157765 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1157971 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1158189 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1158331 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1158484 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1158753 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1158912 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1159058 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1159330 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1159486 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1159639 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1159904 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1160066 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1160215 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1160487 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1160639 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1160796 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1161033 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1161214 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1161370 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1161551 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1161788 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1161945 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1162091 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1162369 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1162509 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1162679 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1162942 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1163104 00:29:45.858 Removing: /var/run/dpdk/spdk_pid1163252 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1163538 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1163678 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1163841 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1164105 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1164266 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1164456 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1164659 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1166855 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1222329 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1224984 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1232159 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1236070 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1238590 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1239007 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1244089 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1244371 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1247053 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1250815 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1253051 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1259543 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1265064 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1266299 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1266989 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1278210 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1280457 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1283417 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1284625 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1286008 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1286156 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1286428 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1286583 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1287179 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1288542 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1289572 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1290026 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1293642 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1297098 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1300748 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1325138 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1327861 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1331829 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1332804 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1334167 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1337253 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1339775 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1344170 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1344174 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1347114 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1347251 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1347396 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1347672 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1347801 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1348896 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1350120 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1351335 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1352554 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1353769 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1354992 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1358904 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1359328 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1360658 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1361413 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1365188 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1367864 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1371470 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1375219 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1378896 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1379312 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1379853 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1380268 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1380865 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1381351 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1381855 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1382410 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1385069 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1385334 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1389204 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1389382 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1391032 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1396196 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1396205 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1399266 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1401175 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1402760 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1403628 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1405094 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1405983 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1411384 00:29:45.859 Removing: /var/run/dpdk/spdk_pid1411791 00:29:46.120 Removing: /var/run/dpdk/spdk_pid1412197 00:29:46.120 Removing: /var/run/dpdk/spdk_pid1413799 00:29:46.120 Removing: /var/run/dpdk/spdk_pid1414093 00:29:46.120 Removing: /var/run/dpdk/spdk_pid1414501 00:29:46.120 Clean 00:29:46.120 killing process with pid 1115907 00:29:54.232 killing process with pid 1115904 00:29:54.232 killing process with pid 1115906 00:29:54.232 killing process with pid 1115905 00:29:54.232 12:43:47 -- common/autotest_common.sh@1436 -- # return 0 00:29:54.232 12:43:47 -- spdk/autotest.sh@387 -- # timing_exit post_cleanup 00:29:54.232 12:43:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:54.232 12:43:47 -- common/autotest_common.sh@10 -- # set +x 00:29:54.232 12:43:47 -- spdk/autotest.sh@389 -- # timing_exit autotest 00:29:54.232 12:43:47 -- common/autotest_common.sh@718 -- # xtrace_disable 00:29:54.232 12:43:47 -- common/autotest_common.sh@10 -- # set +x 00:29:54.232 12:43:47 -- spdk/autotest.sh@390 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:29:54.232 12:43:47 -- spdk/autotest.sh@392 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:29:54.232 12:43:47 -- spdk/autotest.sh@392 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:29:54.232 12:43:47 -- spdk/autotest.sh@394 -- # hash lcov 00:29:54.232 12:43:47 -- spdk/autotest.sh@394 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:29:54.232 12:43:47 -- spdk/autotest.sh@396 -- # hostname 00:29:54.232 12:43:47 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:29:54.232 geninfo: WARNING: invalid characters removed from testname! 00:30:20.754 12:44:12 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:22.651 12:44:16 -- spdk/autotest.sh@398 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:25.179 12:44:18 -- spdk/autotest.sh@399 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:27.706 12:44:21 -- spdk/autotest.sh@400 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:30.230 12:44:24 -- spdk/autotest.sh@401 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:33.507 12:44:26 -- spdk/autotest.sh@402 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:30:35.438 12:44:29 -- spdk/autotest.sh@403 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:30:35.698 12:44:29 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:35.698 12:44:29 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:30:35.698 12:44:29 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:35.698 12:44:29 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:35.698 12:44:29 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.698 12:44:29 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.698 12:44:29 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.698 12:44:29 -- paths/export.sh@5 -- $ export PATH 00:30:35.698 12:44:29 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:35.698 12:44:29 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:30:35.698 12:44:29 -- common/autobuild_common.sh@435 -- $ date +%s 00:30:35.698 12:44:29 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1720781069.XXXXXX 00:30:35.698 12:44:29 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1720781069.CGYK9L 00:30:35.698 12:44:29 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:30:35.698 12:44:29 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:30:35.698 12:44:29 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:30:35.698 12:44:29 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:30:35.698 12:44:29 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:30:35.698 12:44:29 -- common/autobuild_common.sh@451 -- $ get_config_params 00:30:35.698 12:44:29 -- common/autotest_common.sh@387 -- $ xtrace_disable 00:30:35.698 12:44:29 -- common/autotest_common.sh@10 -- $ set +x 00:30:35.698 12:44:29 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:30:35.698 12:44:29 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:30:35.698 12:44:29 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:35.698 12:44:29 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:30:35.698 12:44:29 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:30:35.698 12:44:29 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:30:35.698 12:44:29 -- spdk/autopackage.sh@19 -- $ timing_finish 00:30:35.698 12:44:29 -- common/autotest_common.sh@724 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:30:35.698 12:44:29 -- common/autotest_common.sh@725 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:30:35.698 12:44:29 -- common/autotest_common.sh@727 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:35.698 12:44:29 -- spdk/autopackage.sh@20 -- $ exit 0 00:30:35.698 + [[ -n 1073595 ]] 00:30:35.698 + sudo kill 1073595 00:30:35.709 [Pipeline] } 00:30:35.731 [Pipeline] // stage 00:30:35.737 [Pipeline] } 00:30:35.756 [Pipeline] // timeout 00:30:35.761 [Pipeline] } 00:30:35.778 [Pipeline] // catchError 00:30:35.784 [Pipeline] } 00:30:35.802 [Pipeline] // wrap 00:30:35.808 [Pipeline] } 00:30:35.825 [Pipeline] // catchError 00:30:35.835 [Pipeline] stage 00:30:35.837 [Pipeline] { (Epilogue) 00:30:35.852 [Pipeline] catchError 00:30:35.854 [Pipeline] { 00:30:35.869 [Pipeline] echo 00:30:35.871 Cleanup processes 00:30:35.878 [Pipeline] sh 00:30:36.166 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:36.166 1426307 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:36.181 [Pipeline] sh 00:30:36.469 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:30:36.469 ++ grep -v 'sudo pgrep' 00:30:36.469 ++ awk '{print $1}' 00:30:36.469 + sudo kill -9 00:30:36.469 + true 00:30:36.482 [Pipeline] sh 00:30:36.768 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:30:46.745 [Pipeline] sh 00:30:47.034 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:30:47.034 Artifacts sizes are good 00:30:47.049 [Pipeline] archiveArtifacts 00:30:47.057 Archiving artifacts 00:30:47.288 [Pipeline] sh 00:30:47.574 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:30:47.589 [Pipeline] cleanWs 00:30:47.598 [WS-CLEANUP] Deleting project workspace... 00:30:47.598 [WS-CLEANUP] Deferred wipeout is used... 00:30:47.604 [WS-CLEANUP] done 00:30:47.606 [Pipeline] } 00:30:47.623 [Pipeline] // catchError 00:30:47.631 [Pipeline] sh 00:30:47.905 + logger -p user.info -t JENKINS-CI 00:30:47.913 [Pipeline] } 00:30:47.928 [Pipeline] // stage 00:30:47.933 [Pipeline] } 00:30:47.949 [Pipeline] // node 00:30:47.954 [Pipeline] End of Pipeline 00:30:47.988 Finished: SUCCESS